Cambrian-P: Pose-Grounded Video Understanding Figure 1
arXiv preprint2026-05-21

Cambrian-P: Pose-Grounded Video Understanding

Jihan Yang, Zifan Zhao, Xichen Pan, Shusheng Yang, Junyi Zhang, Bingyi Kang, Hu Xu, Saining Xie

New York University UC Berkeley Meta FAIR

6D位姿估计

论文针对视频 MLLM 将帧当作孤立 2D 图像、缺少跨视角几何锚点而空间推理薄弱的问题,提出 Cambrian-P:为每帧加入可学习相机 token,并用轻量位姿回归头和交错训练、随机抖动采样把相机位姿作为监督信号。结果显示其在 VSI-Bench 等空间推理任务提升约 4.5–6.5%,泛化到多项视频 QA,并在 ScanNet 流式位姿估计上达到 SOTA。

SADGE: Structure and Appearance Domain Gap Estimation of Synthetic and Real Data Figure 1
arXiv preprint2026-05-21

SADGE: Structure and Appearance Domain Gap Estimation of Synthetic and Real Data

Patryk Bartkowiak, Bartosz Kotrys, Dominik Michels, Soren Pirk, Wojtek Palubicki

Adam Mickiewicz University, Kiel University

6D位姿估计仿真到现实

针对合成数据是否值得用于真实任务训练仍需反复试训的问题,SADGE提出在训练前同时估计外观相似性与几何一致性,并用受约束双线性交互建模二者的非线性互补关系。论文在5类合成到真实基准、15个数据集变体和检测、分割、6D位姿等任务上验证,该指标与下游迁移性能相关性最高,Pearson r=0.879、Spearman ρ=0.768,优于单独的外观或几何指标。

REACH: Hand Pose Estimation from Room Corners Figure 1
arXiv preprint2026-05-21

REACH: Hand Pose Estimation from Room Corners

Shu Nakamura, Ryo Kawahara, Genki Kinoshita, Ryosuke Hirai, Yasutomo Kawanishi, Shohei Nobuhara, Ko Nishino

Graduate School of Informatics, Kyoto University RIKEN Kyoto Institute of Technology

6D位姿估计手部姿态

REACH面向远距离、低分辨率且常被遮挡的室内手部3D姿态估计,动机是用房间角落固定相机替代穿戴设备或近距离密集相机,以支持自然行为理解。核心洞察是远景虽看不清手,却能捕捉全身姿态、跨视角互补和时间连续性;REACH-Net用Transformer融合手、身体与多视角时序特征,并配套构建含50人日常活动的大规模REACH数据集。实验显示其在远距离和严重遮挡场景下优于既有方法。

Bounding-Box Trajectories Matter for Video Anomaly Detection Figure 1
arXiv preprint2026-05-21

Bounding-Box Trajectories Matter for Video Anomaly Detection

Inpyo Song, Jangwon Lee

6D位姿估计

这篇论文针对视频异常检测中过度依赖人体姿态、难以覆盖车辆等非人目标且姿态估计成本高的问题,指出检测跟踪阶段已有的多类别边界框轨迹本身就是强异常线索。TrajVAD用归一化流建模正常轨迹分布,并可按可靠性融合人体姿态;纯轨迹版在ShanghaiTech取得87.7% AP、MSAD最佳,融合姿态后达88.6% AUROC和90.9% AP。

AIGaitor: Privacy-preserving and cloud-free motion analysis for everyone, using edge computing Figure 1
arXiv preprint2026-05-20

AIGaitor: Privacy-preserving and cloud-free motion analysis for everyone, using edge computing

Lauhitya Reddy, Trisha M. Kesar, Hyeokhyen Kwon

6D位姿估计人体姿态

针对临床步态/运动捕捉依赖昂贵实验室或云端 GPU、带来成本、培训、联网与隐私门槛的问题,AIGaitor 将单目无标记动捕的 2D/3D 姿态估计、优化和骨架下游分析完整迁移到 iPhone 端侧神经加速器。实验显示,iPhone 14 处理 10 秒 4K60 视频约 77 秒,考虑上传后可匹敌或超过 H200 云端流程,轻量 ViTPose-s 可实时提取关键点,骨架步态分类达亚毫秒级。

CHOIR: Contact-aware 4D Hand-Object Interaction Reconstruction Figure 1
arXiv preprint2026-05-20

CHOIR: Contact-aware 4D Hand-Object Interaction Reconstruction

Hao Xu, Yilin Liu, Yinqiao Wang, Chi-Wing Fu, Niloy J. Mitra

The Chinese University of Hong Kong, Hong Kong, University College London, University College London, Adobe Research, Niloy J. Mitra

6D位姿估计手部姿态三维重建

CHOIR面向开放世界单目操作视频中手与未知物体易因遮挡、深度歧义而错位的问题,将接触显式作为耦合信号来重建4D手物交互。方法先用视觉先验得到粗序列,再通过生成式射线深度校正对齐手物相对位置,并在动态接触约束下联合优化形状、6D位姿和手部运动。实验显示其在HO3D及野外视频上提升了物体重建、物理合理性与时间稳定性。

Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video Figure 1
ICIP 20262026-05-20

Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video

Hiroyuki Deguchi, Ryosuke Hori, Kotaro Amaya, Tsubasa Maruyama, Mitsunori Tada, Hideo Saito

6D位姿估计人体姿态

该文针对单目第一视角人体姿态只能估相对运动、易受尺度歧义和轨迹漂移影响的问题,提出用预扫描3D点云作为全局几何先验的 Map-Mono-Ego:先用合成视图与 HLoc 获得地图锚定相机位姿,再经内点过滤与 SLAM 平滑轨迹,最后驱动扩散式人体运动估计。作者还构建 AIST-Living 数据集,实验显示其在全局一致姿态估计上明显优于现有基线。

VBT-MPC: Vision-Based Tactile MPC for Contour Following Figure 1
IEEE Robotics and Automation Letters2026-05-19

VBT-MPC: Vision-Based Tactile MPC for Contour Following

Edison Velasco-Sanchez, Luis F. Recalde, Guanrui Li, Pablo Gil

AUROVA Lab, Computer Science Research, Institute, University of Alicante, Alicante, Spain, the Worcester Polytechnic Institute, Robotics Engineering, Worcester, MA 01609, USA

6D位姿估计

面向表面检测等需持续接触并沿物体轮廓运动的操作任务,本文提出 VBT-MPC:直接在无标记视觉触觉图像的轮廓特征空间做模型预测控制,将接触保持、视野内可观测性和输入约束纳入优化,避免单独位姿估计和级联力控;同时用分割、直线拟合与 EKF 提取并过采样轮廓特征。仿真和真实多材质、多几何物体实验显示,其相较改造的触觉视觉伺服基线具有更好的轮廓跟踪表现。

How You Move Tells What You'll Do: Trajectory-Conditioned Egocentric Prediction Figure 1
arXiv preprint2026-05-19

How You Move Tells What You'll Do: Trajectory-Conditioned Egocentric Prediction

Technology, Computer Science

Khoury College of Computer Sciences, Northeastern University, Boston, Korea Advanced Institute of Science and Technology, Daejeon, Department of Mathematics and Computer Science, University of Catania, Italy

6D位姿估计

本文针对第一人称视频未来动作高度多解、语言意图过粗的问题,提出用未来头戴相机6DoF轨迹作为更细粒度的意图条件。TrajPilot先从起止视觉上下文预测候选轨迹,再在动作对齐嵌入空间中驱动因果动作预测。实验显示其在Ego-Exo4D、Ego4D GoalStep、EgoPER等规划与无目标预测任务上超过VLM和结构化规划器,且长时域优势更明显,并可在RGB估计位姿下保持有效。

Depth2Pose: A Pose-Based Benchmark for Monocular Depth Estimation without Ground-Truth Depth Figure 1
arXiv preprint2026-05-19

Depth2Pose: A Pose-Based Benchmark for Monocular Depth Estimation without Ground-Truth Depth

Viktor Kocur, Sithu Aung, Gabrielle Flood, Yaqing Ding, Lukas Bujnak, Torsten Sattler, Zuzana Kukelova

Faculty of Mathematics, Physics and Informatics, Comenius University in Bratislava, Visual Recognition Group, Faculty of Electrical Engineering, Czech Technical University in Prague, Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague

6D位姿估计彩色深度数据集/基准

针对单目深度仍依赖逐像素真值和全局误差、难反映 SfM/SLAM 等几何任务可用性的评价问题,Depth2Pose 将预测深度与特征匹配送入深度感知相对位姿求解器,用相机位姿精度替代深度真值评测,并发布含雕塑与植被等困难场景的 D2P 数据集。实验显示该指标在常规数据上与标准深度指标相关,但现有方法在 D2P 上泛化并不稳定。

CAD-Free Learning of Spacecraft Pose Estimators via NeRF-Based Augmentations Figure 1
arXiv preprint2026-05-20

CAD-Free Learning of Spacecraft Pose Estimators via NeRF-Based Augmentations

Antoine Legrand, Renaud Detry, Christophe De Vleeschouwer

Department of Electrical Engineering (ELEN), ICTEAM, UCLouvain, Department of Electrical Engineering (ESAT), KU Leuven, Department of Mechanical Engineering (MECH), KU Leuven, Aerospacelab

6D位姿估计三维重建航天器

面向在轨服务/碎片清除中缺少可靠 CAD、且纯合成渲染难以覆盖真实光照材质的问题,论文用少量目标图像训练 NeRF,再生成带位姿标签、视角一致且外观随机化的增强数据,用于训练单目航天器 6D 位姿估计器。实验表明,仅 25–400 张真实感图像即可训练可用模型;在已有大规模 CAD 合成集上加入 NeRF 增强也能提升域外泛化和对剧烈光照变化的鲁棒性。

Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction Figure 1
arXiv preprint2026-05-20

Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction

Zongwu Xie, Yonglong Zhang, Yifan Yang, Yang Liu, and Baoshi Cao

6D位姿估计仿真到现实航天器

面向卫星视觉 6D 位姿中真实标注稀缺、纯渲染存在外观域差的问题,论文提出按部件感知的结构保持风格迁移:利用标定采集、ArUco 测姿和 CAD 渲染构造弱配对数据,将真实图像的部件级风格按掩码注入合成图,同时用对比、自正则和边缘约束保留几何标注。实验在 5000 张渲染图和 100 张真实图上进行,FID/KID 降至 54.32/0.048,训练 GDRNet 后 ADD 通过率和 AUC 提升至 0.260/0.611。

EpiDiffVO: Geometry-Aware Epipolar Diffusion for Robust Visual Odometry Figure 1
arXiv preprint2026-05-19

EpiDiffVO: Geometry-Aware Epipolar Diffusion for Robust Visual Odometry

Prateeth Rao

Prateeth Rao, Manuscript received April 19, 2021; revised August

6D位姿估计相机位姿

该文针对视觉里程计中密集匹配冗余、直接回归缺少几何可解释性且易受宽基线和噪声影响的问题,提出稀疏极线匹配框架:用扩散过程校正关键点到极线一致性,再结合深度构建 Steiner 图并由 GNN 选择信息量高的对应点,最后通过可微 SVD 求本质矩阵与相机相对位姿。在 TartanAir 和 KITTI SLAM 上,结果显示其可减少对应点冗余并保持较稳健的位姿估计,但具体相对增益幅度文中片段未充分说明。

StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video Figure 1
arXiv preprint2026-05-18

StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video

Huajian Zeng, Chaohua Yao, Yuantai Zhang, Jiaqi Yang Rolandos Alexandros Potamias

Mohamed bin Zayed University of Artificial Intelligence, {}^{2~} University of Illinois at Urbana-Champaign, {}^{3~} Imperial College London

6D位姿估计手部姿态

面向从第一视角视频监督机器人双手操作,论文关注手部出画和手物遮挡导致的世界系双手4D运动估计不稳。StableHand的核心是把观测可靠性拆成左右手腕平移与手指关节四个质量通道,并将其注入flow matching的调度、速度目标、DiT调制和ODE初始化,以保留可信观测、重建低质片段。在HOT3D和ARCTIC上达到SOTA,W-MPJPE较最强基线降低约20–25%,遮挡严重序列收益最大。

Efficient Sparse-to-Dense Visual Localization via Compact Gaussian Scene Representation and Accelerated Dense Pose Estimation Figure 1
arXiv preprint2026-05-18

Efficient Sparse-to-Dense Visual Localization via Compact Gaussian Scene Representation and Accelerated Dense Pose Estimation

Zizhuo Li, Songchu Deng, Linfeng Tang, Jiayi Ma

6D位姿估计相机位姿高斯泼溅

面向机器人/AR等对低延迟6D相机定位的需求,论文指出STDLoc的Feature 3DGS把颜色与特征耦合,造成存储冗余,且密集PnP匹配带来计算瓶颈。LiteLoc去除与定位无关的颜色场,构建无颜色解耦高斯特征场,并用几何-特征聚类仅保留约5%代表性密集匹配。实验称在7-Scenes等场景优于STDLoc,同时减少约94%存储、带来约19倍鲁棒估计加速。

UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation Figure 1
arXiv preprint2026-05-18

UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation

Tianhao Han, Haoyang Zhang, Liang Xie, Haochen Chang, Kun Gao, Yuan Cheng, Pengfei Ren, Erwei Yin : 1 School of Computer Science, Telecommunications, rpf@bupt.edu.cn, yinerwei1985@gmail.com

School of Computer Science, Shanghai Jiao Tong University, Beijing University of Posts and Telecommunications, Sun Yat-sen University, Peking University, Defense Innovation Institute, Academy of Military Sciences, Tianjin Artificial Intelligence Innovation Center

6D位姿估计手部姿态点云

针对3D手姿态自监督学习依赖噪声2D伪标签、训练不稳定且缺少细粒度时空建模的问题,UST-Hand用条件归一化流显式建模姿态不确定性并采样多假设,再映射到统一概率3D点云空间,通过时空Point Transformer融合多视角与视频线索迭代细化。在HanCo、DexYCB和OakInk上,相比现有自监督方法MPVPE最高降低37.8%。

LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos Figure 1
arXiv preprint2026-05-17

LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos

Chenyi Xu, Yihao Wu, Liqi Yan, Chao Yang, Jianhui Zhang, Fangli Guan, Pan Li

Hangzhou Dianzi University

6D位姿估计三维重建

针对长单目动态视频中局部4D重建难以跨片段保持统一坐标、而长程跟踪又缺少稠密几何的问题,LongDPM将视频切成重叠块,在冻结局部预测器之上引入静态感知重叠抽象、置信加权配准、跨块身份关联与轨迹引导融合。实验显示其在PointOdyssey、Kubric-F/G上降低稠密跟踪EPE,并在TUM-dynamics相机位姿ATE上取得最佳结果。

Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants Figure 1
arXiv preprint2026-05-16

Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants

Divya Joshi, J.D. Peiffer, Colleen Peyton, R. James Cotton

Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, IL, Northwestern University, Chicago, IL, Northwestern University, Evanston, IL

6D位姿估计人体姿态医学/手术

针对婴儿早期运动障碍筛查依赖专家目测、难以规模化的问题,本文用8相机无标记动捕数据系统评估 MeTRAbs-ACAE、SAM 3D Body 与 Sapiens 在婴儿全身3D姿态/生物力学重建中的适用性,并尝试将单目3D估计接入 MuJoCo 逆运动学模型。结果显示 Sapiens 重投影误差最低、几何一致性最好,而 SAM 3D Body 提供更完整的3D信息,位置误差约19–28 mm,可区分临床相关运动模式,但整体仍受婴儿场景精度与关键点定义限制。

Generalizable and Actionable Parts Pose Estimation with Symmetry Annotation-Free Learning Strategy Figure 1
arXiv preprint2026-05-16

Generalizable and Actionable Parts Pose Estimation with Symmetry Annotation-Free Learning Strategy

Wenxiao Chen, Xueyu Yuan, Liu Liu, Di Wu, Dan Guo

6D位姿估计

面向跨类别机器人操作,GAPart 级 6D 位姿估计受部件对称导致的多解性和对称轴/面对标注依赖限制。SAFAG 将旋转回归设计为候选四元数到最终聚合的两阶段细化,并用自监督概率分布隐式估计对称轴/面,构造等价位姿监督而无需对称标注。在 GAPartNet 及真实实验中,其旋转、平移误差多数优于 GAPartNet、GASEM、DFGAP 等基线,消融显示对称建模贡献显著。

Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction Figure 1
arXiv preprint2026-05-16

Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction

Kejun Ren, Lei Jin, Tianxin Huang, Lianming Xu, Telecommunications, Beijing, China School of Computing, Data Science

Beijing University of Posts and Telecommunications, Beijing, China, School of Computing and Data Science, The University of Hong Kong

6D位姿估计三维重建

论文针对常内存流式3D重建在长序列中易漂移的问题,指出现有TTT3R式逐token门控幅度受限且几乎不随帧变化,导致有效记忆仅约3帧。作者提出无需训练、无参数、无额外前向的自适应帧级门控AFG,用内部特征变化连续近似SLAM关键帧选择。六个基准上,AFG在长TUM-RGBD序列将ATE降低51%,Bonn深度AbsRel降12.8%,KITTI位姿超过LongStream和Keyframe-VO。

IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation Figure 1
arXiv preprint2026-05-15

IVGT: Implicit Visual Geometry Transformer for Neural Scene Representation

Yuqi Wu ^, Tianyu Hu, Wenzhao Zheng, Yuanhui Huang, Haowen Sun, Jie Zhou, Jiwen Lu Intelligent Vision Group

Intelligent Vision Group, Tsinghua University

6D位姿估计

针对无位姿多视图重建中显式点图冗余、表面不连续且难以直接渲染的问题,IVGT用Transformer聚合跨视角信息,在规范坐标系中学习可连续查询的隐式SDF与颜色场,并用2D监督和3D正则跨数据集训练。实验显示其可单次前向泛化到新场景,在网格/点云重建、新视角合成、深度/法线与相机位姿估计上取得较强表现。

Not All Tasks Quantize Equally: Fisher-Guided Quantization for Visual Geometry Transformer Figure 1
arXiv preprint2026-05-15

Not All Tasks Quantize Equally: Fisher-Guided Quantization for Visual Geometry Transformer

Yipu Zhang, Jintao Cheng, Weilun Feng, Jiehao Luo Chuanguang Yang, Zhulin An, Yongjun Xu, Computer Engineering, Engineering

Department of Electronic and Computer Engineering, HKUST, State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, University of Chinese Academy of Sciences, School of Data Science and Engineering, South China Normal University, Xiamen Institute of Data Intelligence

6D位姿估计

面向VGGT这类一次前向同时预测深度、相机位姿和点图的3D重建模型,论文关注低比特PTQ在多任务共享骨干中“各任务并不等敏感”的问题。核心做法是用对角Fisher信息估计任务、Transformer块与通道级量化敏感性,并将其融入可学习仿射变换校准,优先保护关键成分。实验显示FGQ在4-bit下优于现有PTQ基线,最高相对提升39%,尤其缓解点图重建退化。

Cross-Modal Registration Between 3D and 2D Fingerprints via Pose-Aware Unwrapping and Point-Cloud Fusion Figure 1
arXiv preprint2026-05-15

Cross-Modal Registration Between 3D and 2D Fingerprints via Pose-Aware Unwrapping and Point-Cloud Fusion

Xiongjun Guan ^{ @orcidlink }, Jianjiang Feng ^{ @orcidlink }, Jie Zhou ^{ @orcidlink }

6D位姿估计点云

针对3D指纹难以接入既有2D指纹系统、且受局部扫描不完整和姿态不一致影响的问题,论文将3D点云作为跨模态几何桥梁,提出非参数展开、细节点引导的点云融合、椭圆截面姿态归一化与姿态感知2D-3D配准的一体化预处理框架。在150指自采多模态数据上,融合误差集中约0.09 mm,2D-3D投影达到脊线级精度,并提升真实匹配分数。

DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation Figure 1
arXiv preprint2026-05-15

DecomPose: Disentangling Cross-Category Optimization Contention for Category-Level 6D Object Pose Estimation

Yifan Gao, Lu Zou, Zhangjin Huang, Guoping Wang

6D位姿估计物体位姿类别级位姿

本文关注类别级 6D/9D 位姿估计中多类别共享训练带来的负迁移:几何差异大的类别在共享对应模块中产生梯度冲突。DecomPose 先用梯度诊断定位跨类别竞争,再按难度分组路由到不同对应分支,并用非对称容量稳定优化。实验在 REAL275、CAMERA25、HouseCat6D 上显示其能降低类别间干扰并提升位姿精度。

Unsupervised 3D Human Pose Estimation via Conditional Multi-view Ancestral Sampling Figure 1
arXiv preprint2026-05-15

Unsupervised 3D Human Pose Estimation via Conditional Multi-view Ancestral Sampling

Ryohei Goto, Takuya Fujihashi, Shunsuke Saruwatari

The University of Osaka

6D位姿估计人体姿态多视角

针对3D人体姿态标注稀缺且监督式2D-3D lifting在瑜伽等跨域极端姿态上泛化差的问题,本文把大规模2D姿态序列训练的运动扩散先验引入单目3D估计,提出cMAS,在多虚拟视角投影的扩散噪声流形上优化3D姿态,并加入2D观测与骨骼解剖约束。Yoga90实验显示其优于Video-to-Pose3D、MotionBERT和ElePose,但仍受单目深度歧义与上游2D检测误差限制。

SOCC-ICP: Semantics-Assisted Odometry based on Occupancy Grids and ICP Figure 1
arXiv preprint2026-05-14

SOCC-ICP: Semantics-Assisted Odometry based on Occupancy Grids and ICP

Johannes Scherer 1, Sebastian Hirt, Henri Meeß

6D位姿估计相机位姿

面向激光里程计与下游规划常用语义占据栅格割裂、需维护重复地图的问题,SOCC-ICP将在线位姿估计直接建立在滚动3D语义占据栅格上:体素同时存储占据概率、均值/协方差和语义分布,并按局部平面性自适应选择点到点或点到面ICP,结合射线自由空间更新抑制动态物体。实验显示其在多类场景中精度接近主流LiDAR里程计,退化几何下仍稳健;有语义标签时还能进一步提升精度。

FU-MPC: Frontier- and Uncertainty-Aware Model Predictive Control for Efficient and Accurate UAV Exploration with Motorized LiDAR Figure 1
arXiv preprint2026-05-14

FU-MPC: Frontier- and Uncertainty-Aware Model Predictive Control for Efficient and Accurate UAV Exploration with Motorized LiDAR

Jianping Li, Pengfei Wan, Zhongyuan Liu, Yi Wang, Yiheng Chen, Xinhang Xu, Rui Jin, Boyu Zhou, Lihua Xie

6D位姿估计点云航天器

针对固定安装 LiDAR 无人机在未知环境中需靠机体运动扩展视野、易牺牲探索效率和定位稳定性的问题,FU-MPC 将电机化旋转 LiDAR 的扫描方向显式作为控制变量,在分层前沿规划上用 MPC 联合优化前沿收益与基于 Fisher 信息的方向相关定位不确定性,并用轻量替代模型满足机载实时性。仿真和实飞显示,其相比固定扫描和仅不确定性策略能更快扩展覆盖,同时保持更稳健的 SLAM 定位。

From Sparse to Dense: Spatio-Temporal Fusion for Multi-View 3D Human Pose Estimation with DenseWarper Figure 1
arXiv preprint2026-05-14

From Sparse to Dense: Spatio-Temporal Fusion for Multi-View 3D Human Pose Estimation with DenseWarper

Ling Li, Changjie Chen, Yuyan Wang, Jiaqing Lyu, Kenglun Chang, Yiyun Chen, THUAI, BNRist, Beijing, Dalian, China Apple, Technology (Guang Zhou, Guang Zhou, Manchester

Department of Computer Science, THUAI, BNRist, Tsinghua University, Beijing, China, Dalian University of Technology, Dalian, China, Hong Kong University of Science and Technology (Guang Zhou), Guang Zhou, China, University of Manchester, Manchester, UK

6D位姿估计人体姿态多视角

多视角3D人体姿态估计通常依赖同一时刻的密集同步图像,计算冗余且难利用相邻帧时序信息。本文提出稀疏交错输入,让不同相机在错开的时间采样,并用DenseWarper基于极线几何交换热图、结合可变形卷积做时空补全,再三角化得到3D姿态。Human3.6M和MPI-INF-3DHP实验显示,仅用稀疏输入即可超过传统密集多视角方案并达到SOTA,同时理论上可将输出帧率提升到相机数倍。

Rethinking Graph Convolution for 2D-to-3D Hand Pose Lifting Figure 1
arXiv preprint2026-05-13

Rethinking Graph Convolution for 2D-to-3D Hand Pose Lifting

Chanyoung Kim, Donghyun Kim, Dong-Hyun Sim, Seong Jae Hwang, WHATs Lab @emory.edu

Emory University, Yonsei University, WHATs Lab

6D位姿估计手部姿态

论文质疑2D到3D手部姿态提升中“固定骨架邻接GCN”是否仍是最佳结构先验,采用仅含关节嵌入、图距离位置编码和4层Transformer的受控模型隔离lifting模块。核心洞察是手部拓扑更适合作为软位置先验,而非硬邻接约束;输入自适应的空间注意力在FPHA上将MPJPE从匹配参数/感受野GCN的12.36 mm降至10.09 mm,AUC达80.0%。

Doppler Prompting for Stable mmWave-based Human Pose Estimation Figure 1
arXiv preprint2026-05-13

Doppler Prompting for Stable mmWave-based Human Pose Estimation

Shuntian Zheng, Jiaqi Li, Xiaoman Lu, Shuai He, Yu Guan

6D位姿估计人体姿态

本文针对毫米波人体姿态估计中轨迹抖动的问题:Doppler 含有帧内运动线索,但直接与距离-角度幅值融合会把杂波、多径等非人体运动误当作肢体动态。作者提出 PULSE,将 Doppler 先转为带置信度筛选的运动 prompt,再在局部受约束地调制空间结构推理。三套单人/多人数据集上,方法同时提升逐帧精度与时间稳定性,说明受控利用 Doppler 比简单融合更有效。

GenCape: Structure-Inductive Generative Modeling for Category-Agnostic Pose Estimation Figure 1
arXiv preprint2026-05-13

GenCape: Structure-Inductive Generative Modeling for Category-Agnostic Pose Estimation

Jiyong Rao, Yu Wang 1 Corresponding author: yuwangtj@yeah.net, shengjiezhao@tongji.edu.cn, Shengjie Zhao 1 Corresponding author: yuwangtj@yeah.net, shengjiezhao@tongji.edu.cn School of Computer Science, Technology

School of Computer Science and Technology, Tongji University

6D位姿估计类别级位姿

GenCape面向少样本类别无关位姿估计中结构先验难迁移、人工骨架或文本提示成本高且对噪声支持样本敏感的问题,核心思路是从支持图像生成实例级潜在关键点图:i-SVAE迭代推断软邻接矩阵,CGT再将多种图假设融合为查询相关结构。其在MP-100的1-shot和5-shot设置下显著优于图支持基线,并接近文本支持方法。

OCH3R: Object-Centric Holistic 3D Reconstruction Figure 1
arXiv preprint2026-05-13

OCH3R: Object-Centric Holistic 3D Reconstruction

Yi Du, Yang You, Xiang Wan

Stanford University

6D位姿估计三维重建

OCH3R面向机器人操作中单目图像难以同时获得实例、6D位姿与可编辑三维形状的问题,避免传统“先分割再逐物体重建”带来的误差累积和随物体数增长的开销。其核心是用48层Transformer一次预测CLIP语义、深度、NOCS与每像素3D Gaussian,并通过规范空间监督训练物体级高斯表示。实验显示其在室内桌面场景的深度、开放词汇分割、RGB-only类别级6D位姿和非模态重建上优于基线,推理速度相对多阶段流程有数量级提升。

AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects Figure 1
arXiv preprint2026-05-13

AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects

Danrui Li, Jiahao Zhang, Bernhard Egger Moitreya Chatterjee, Suhas Lohit, Tim K. Marks, Anoop Cherian Rutgers, USA, Australia, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany Mitsubishi Electric Research Laboratories (MERL, USA danrui.li@rutgers.edu, jiahao.zhang@anu.edu.au, bernhard.egger@fau.de

Rutgers, The State University of New Jersey, USA, The Australian National University, Australia, Mitsubishi Electric Research Laboratories (MERL), USA

6D位姿估计

该文针对现有装配数据多停留在简化家具和最终位姿、难以反映工业零件复杂几何与可执行轨迹的问题,构建含2789个工业对象、图文说明书、CAD部件和6DoF轨迹的AssemblyBench,并提出AssemblyDyno用Transformer联合对齐说明步骤与3D点云,预测装配顺序和运动轨迹;实验中最终位姿成功率较基线提升约12%,物理仿真可行率约33%对比基线约3%。

WildPose: A Unified Framework for Robust Pose Estimation in the Wild Figure 1
arXiv preprint2026-05-12

WildPose: A Unified Framework for Robust Pose Estimation in the Wild

Jianhao Zheng, Liyuan Zhu, Zihan Zhu, ETH Zürich, wildpose.github.io

Stanford University, ETH Zürich

6D位姿估计

针对单目SLAM/SfM在动态场景中因静态世界假设导致位姿退化、而现有动态方法难兼顾静态场景的问题,WildPose将冻结的MASt3R三维感知特征接入DROID式可微BA,训练新的更新算子,并用多层特征构建高容量运动掩码作为BA权重。实验显示其在Wild-SLAM、Bonn等动态数据,以及TUM、7-Scenes、Sintel等静态或低自运动场景均优于既有方法。

EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras Figure 1
arXiv preprint2026-05-12

EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras

Luming Wang, Hao Shi, Jiajun Zhai, Kailun Yang, such as lighting sensitivity, depth ambiguity, by introducing (Middle) EgoEVHands, the first large-scale, characterized by its HDR properties, 3D geometric constraints, complexity

the National Research Center for Optical Instrumentation, Zhejiang University, Hangzhou 310027, China (

6D位姿估计手部姿态事件相机多视角

面向AR/VR、HCI和机器人中的第一视角双手交互,论文针对RGB易受模糊/光照影响、单目事件相机深度歧义与遮挡问题,提出双目事件流端到端框架EgoEV-HandPose,并用KeypointBEV将特征提升到BEV空间、通过重投影迭代细化深度与运动学一致性;同时构建EgoEVHands数据集。实验在低光和双手遮挡下达到30.54 mm MPJPE与86.87%手势Top-1准确率,优于RGB双目和既有事件方法。

Enhancing Domain Generalization in 3D Human Pose Estimation through Controllable Generative Augmentation Figure 1
arXiv preprint2026-05-12

Enhancing Domain Generalization in 3D Human Pose Estimation through Controllable Generative Augmentation

Xinhao Hu, Yiyi Zhang, Liqing Zhang, Jianfu Zhang

Shanghai Jiao Tong University

6D位姿估计人体姿态

针对单目3D人体姿态估计在室内/室外、真实/虚拟等域切换下性能下降的问题,论文将域泛化从“只扩增关节姿态”推进到视频级可控生成:跨数据集融合动作、场景与相机轨迹,生成带2D/3D标注的RGB序列,并用2D一致性过滤减轻生成伪影。Human3.6M与PMR上的实验显示,该数据增强可提升KTPFormer等模型在未见域上的鲁棒性,但增益可能部分来自更大规模合成数据。

4DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimation Figure 1
arXiv preprint2026-05-12

4DVGGT-D: 4D Visual Geometry Transformer with Improved Dynamic Depth Estimation

Ying Zang, Xuanyi Liu, Yidong Han, Deyi Ji, Chaotao Ding, Yuanqi Hu, Qi Zhu, Xuanfu Li, Jin Ma, Lingyun Sun, Tianrun Chen, Lanyun Zhu

6D位姿估计彩色深度

针对VGGT等静态3D基础模型在动态视频中将相机自运动与物体运动耦合、导致位姿和深度退化的问题,4DVGGT-D提出免训练的渐进解耦:先用动态掩码抑制稳定相机位姿,再通过拓扑子空间“手术”和置信度贝叶斯融合细化静/动态深度。DyCheck上点云指标较VGGT4D明显提升,如Distance Mean从0.0646降至0.0516,且运行开销很小。

PoseBridge: Bridging the Skeletonization Gap for Zero-Shot Skeleton-Based Action Recognition Figure 1
arXiv preprint2026-05-12

PoseBridge: Bridging the Skeletonization Gap for Zero-Shot Skeleton-Based Action Recognition

Sanghyeon Lee, Jinwoo Kim, Daegu, South Korea @knu.ac.kr

School of Computer Science and Engineering, Kyungpook National University, Daegu, South Korea

6D位姿估计

本文针对零样本骨架动作识别中“先骨架化再对齐”导致物体与人-物交互语义丢失的问题,提出 PoseBridge:从同一人体姿态估计过程的中间特征中提取姿态锚定语义,并通过骨架条件桥接与语义原型适配注入骨架-文本对齐。实验在 NTU、PKU 和 Kinetics 上均有提升,在更复杂的 Kinetics PURLS 八个划分中较最强基线提高 13.3–17.4 点。

Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice Figure 1
arXiv preprint2026-05-11

Learning Point Cloud Geometry as a Statistical Manifold: Theory and Practice

Jinwoo Lee, Jiwoo Kim, Woojae Shin, Giseop Kim, Hyondong Oh

6D位姿估计点云

针对 LiDAR 点云稀疏、非均匀导致局部几何估计受视角和邻域选择影响的问题,论文将点云几何形式化为由逐点 3D 高斯分布诱导的统计流形,并用自监督网络 POLI 预测点级协方差/椭球表示,在保留几何归纳偏置的同时无需标注。实验显示该表示可无结构改动接入定位、建图、位姿等管线,并稳定提升多类机器人感知任务的鲁棒性与精度。

HYPERPOSE: Hyperbolic Kinematic Phase-Space Attention for 3D Human Pose Estimation Figure 1
arXiv preprint2026-05-11

HYPERPOSE: Hyperbolic Kinematic Phase-Space Attention for 3D Human Pose Estimation

Vinduja T, Ashish M, vinduja.pcse25@diat.ac.in, musaleashish2911@gmail.com

6D位姿估计人体姿态

该文针对3D人体姿态估计中欧氏特征空间难以保留骨架运动树结构的问题,提出在Lorentz双曲空间内进行时空推理的HyperPose。核心是HKPSA将测地邻近、速度一致性与多跳骨架偏置结合,并用多尺度窗口时间注意力和黎曼损失约束骨长、速度。实验在Human3.6M与MPI-INF-3DHP上报告36.0mm、34.17mm MPJPE,优于所列欧氏基线,但跨数据集泛化仍文中未充分说明。

A Real-Calibrated Synthetic-First Data Engine Figure 1
arXiv preprint2026-05-10

A Real-Calibrated Synthetic-First Data Engine

Yukang Shen

Kennesaw State University

6D位姿估计仿真到现实

针对低数据场景中合成图像数量易扩张但与真实分布不匹配的问题,本文提出一个“真实校准”的合成优先数据引擎,用少量真实样本作为统计锚点,对可控扩散生成数据进行多阶段筛选、导出与可复现实验编排,而非改进生成模型本身。人体姿态实验显示,真实数据加筛选合成数据优于真实基线,但纯合成训练明显落后,说明收益主要来自数据编排与真实锚定,域差仍是限制。

L2A: Learning to Accumulate Pose History for Accurate 3D Human Pose Estimation Figure 1
arXiv preprint2026-05-12

L2A: Learning to Accumulate Pose History for Accurate 3D Human Pose Estimation

Zehua Wang, Changwang Mei, Huaijiang Sun, Pengqi Hu, Technology, Lenovo relaxwang0714@gmail.com @njust.edu.cn, yinzy7@lenovo.com

Nanjing University of Science and Technology

6D位姿估计人体姿态

本文关注2D到3D人体姿态提升中跨层历史特征利用不足的问题,指出顺序式时空建模会造成层间表示漂移,导致早期细粒度结构和短时运动线索难以复用。L2A采用时空并行Transformer保持表示一致,并通过HPA累积前序层特征、LPA压缩为结构化历史姿态表示;实验显示在基准上达到SOTA,但具体增益幅度需结合完整表格判断。

Egocentric Whole-Body Human Mesh Recovery with Prior-Guided Learning Figure 1
arXiv preprint2026-05-09

Egocentric Whole-Body Human Mesh Recovery with Prior-Guided Learning

Soyeon Na, Seung Young Noh, Ju Yong Chang

6D位姿估计人体姿态

本文针对头戴单目第一视角图像缺少可靠 SMPL/SMPL-X 标注、现有方法难以恢复手和面部细节的问题,提出面向全身网格恢复的先验引导框架:用与 3D 关节对齐的优化式伪标注监督身体,迁移外视角 HMR 基础模型,并结合扩散姿态先验与确定性鱼眼去畸变。多个人体第一视角基准实验显示,其全身重建优于现有方法,且优化式伪标注明显比回归式伪标注更准确。

Hierarchical Prompting with Dual LLM Modules for Robotic Task and Motion Planning Figure 1
arXiv preprint2026-05-08

Hierarchical Prompting with Dual LLM Modules for Robotic Task and Motion Planning

Karolina Źróbek, Tessa Pulli, Paweł Gajewski, Antonio Galiza Cerdeira Gonzalez, Bipin Indurkhya

6D位姿估计机器人操作

面向家用服务机器人难以把含糊自然语言可靠落到物理动作的问题,论文将任务规划与三维空间约束拆成双 LLM 层级提示:高层 ReAct 代理负责意图分解与工具调用,低层子模块结合 YOLOX-GDRNet 的物体检测与 6D 位姿做几何放置推理。系统在 24 个桌面操作场景中达到 86% 成功率,但运动执行仍为简化 stub,真实可迁移性文中未充分说明。

6D Pose Estimation via Keypoint Heatmap Regression with RGB-D Residual Neural Networks Figure 1
arXiv preprint2026-05-08

6D Pose Estimation via Keypoint Heatmap Regression with RGB-D Residual Neural Networks

Ismail Aljosevic, Politecnico di Torino, ismail.aljosevic@studenti.polito.it

6D位姿估计点云彩色深度

面向遮挡、杂乱和弱纹理物体下的机器人6D位姿估计难题,论文采用“检测—关键点热图—PnP RANSAC”的模块化路线,并比较FPS/CPS关键点、激活函数与学习率策略;其主要扩展是在ResNet18热图回归中加入RGB-D双流交叉融合,让深度特征多阶段参与关键点定位。在LINEMOD子集上,最佳RGB模型ADD均值84.50%,RGB-D提升至92.41%,但各训练改动的独立增益来源文中未充分说明。

Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images Figure 1
arXiv preprint2026-05-08

Seeing Across Skies and Streets: Feedforward 3D Reconstruction from Satellite, Drone, and Ground Images

Qiwei Wang, Zhongyao Tuo, Xianghui Ze, Yujiao Shi

ShanghaiTech University, Shanghai, China, Nanjing University of Science and Technology

6D位姿估计三维重建航天器

针对地面到卫星定位长期受限于平面运动假设、只能估计位置与航向的问题,论文引入单张无人机图像作为中间视角,补足卫星俯视图缺失的高度、俯仰和横滚线索,并提出前馈模型 Cross3R 同时重建三视角点云与相机 6D 位姿。作者还构建含 27.8 万图像的 CrossGeo 数据集;实验显示其在 CrossGeo 上优于前馈 3D 基线,在未用 KITTI 训练时也超过多种专用跨视角方法。

Offline-Online Hierarchical 3D Global Relocalization With Synthetic LiDAR Sensing and Descriptor-Space Retrieval Figure 1
arXiv preprint2026-05-08

Offline-Online Hierarchical 3D Global Relocalization With Synthetic LiDAR Sensing and Descriptor-Space Retrieval

Jiahua Ren, Kai Shen, Muhua Zhang, Lei Ma

6D位姿估计相机位姿点云仿真到现实

面向机器人在大尺度3D地图中丢失初始位姿后难以及时全局重定位的问题,论文将昂贵的6D搜索拆成离线采样与在线检索:先在占据栅格中约束采样可行位置,用虚拟LiDAR生成合成点云并预建Scan Context描述子库,在线再由真实扫描检索粗位姿并经GN-ICP精配准。实机户外实验报告平均约3秒重定位、8厘米精度,相比全局匹配类方法主要提升在线计算效率。

VIMCAN: Visual-Inertial 3D Human Pose Estimation with Hybrid Mamba-Cross-Attention Network Figure 1
arXiv preprint2026-05-08

VIMCAN: Visual-Inertial 3D Human Pose Estimation with Hybrid Mamba-Cross-Attention Network

Zepeng Yang, Junxuan Bai, Hao Li, Ju Dai, Junjun Pan, Yongfeng Yin, Bin Li, Chinese Academy of Sciences

Beihang University, Peng Cheng Laboratory, Capital University of Physical Education and Sports, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences

6D位姿估计人体姿态

针对视觉人体姿态从2D升3D的深度歧义,以及Transformer在长序列视觉-惯性融合中计算量随长度二次增长的问题,VIMCAN将Mamba的线性时序建模与Cross-Attention的跨模态空间关联建模结合,输入RGB关键点和可穿戴IMU数据进行3D人体姿态估计。在TotalCapture和3DPW上MPJPE分别为17.2 mm、45.3 mm,并在消费级硬件上超过60 FPS,显示出精度与实时性的折中优势。

Task-Oriented Communication for Human Action Understanding via Edge-Cloud Co-Inference Figure 1
arXiv preprint2026-05-08

Task-Oriented Communication for Human Action Understanding via Edge-Cloud Co-Inference

Jingyi Liu, Cheng Yuan, Lijun He, Jun Zhang, Jiawei Shao

6D位姿估计

面向边缘摄像头的人体动作理解,论文指出直接上传视频给云端 VLM 会带来带宽、时延和隐私成本。TOAU 将边缘端单目姿态估计得到的关节序列用 VQ-VAE 离散成运动 token,只传码本索引,再在云端对齐到 VLM/LLM 表征做指令微调推理。三项基准显示其在精度接近视频传输方案的同时,将传输量降至约 1%、系统时延降至约 20%。

Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization Figure 1
arXiv preprint2026-05-08

Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization

Miso Lee

Sungkyunkwan University

6D位姿估计相机位姿三维重建高斯泼溅

论文针对光度优化的高斯特征场用于视觉定位时,单个高斯体积导致多像素对应同一3D点、冗余高斯缺乏多视角一致性,从而使PnP不稳定的问题。SplitGS-Loc通过混合高斯式拆分细化对应关系,并利用光栅化组合权重筛选稳定高斯、直接聚合判别特征,构建紧凑特征场;实验显示其在室内外定位基准达到SOTA,且无需逐场景训练或迭代位姿细化。

AsyncEvGS: Asynchronous Event-Assisted Gaussian Splatting for Handheld Motion-Blurred Scenes Figure 1
arXiv preprint2026-05-08

AsyncEvGS: Asynchronous Event-Assisted Gaussian Splatting for Handheld Motion-Blurred Scenes

Jun Dai, Renbiao Jin, Bo Xu, Yutian Chen, Linning Xu, Mulin Yu, Tianfan Xue, Shi Guo

6D位姿估计手部姿态事件相机三维重建高斯泼溅

针对手持三维扫描中严重运动模糊会破坏 NeRF/3DGS 重建、而现有事件辅助方法受低分辨率和硬同步限制的问题,AsyncEvGS提出高分辨率异步 RGB-Event 双相机流程:用事件重建锐化强度图,并借助 VGGT 做跨模态位姿初始化,再以结构驱动事件损失和视图一致性正则稳定优化。其新建 AsyncEv-Deblur 数据集,并在该数据集和既有基准上取得 SOTA,显示异步事件信息能显著提升模糊场景重建鲁棒性。

Dr-BA: Separable Optimization for Direct Radar Bundle Adjustment & Localization Figure 1
RSS 20262026-05-07

Dr-BA: Separable Optimization for Direct Radar Bundle Adjustment & Localization

Daniil Lisus, Cedric Le Gentil, Timothy D. Barfoot

6D位姿估计

面向雨雪等恶劣天气下可靠建图与定位,Dr-BA绕开传统旋转雷达先提稀疏点云再配准的路线,直接利用2D雷达强度图做束调整,并用可分优化/VarPro将位姿估计与密集地图估计解耦,使复杂度随地图规模线性增长;在5条路线、206 km实车数据上取得雷达BA与跨次定位SOTA,但在特征稀少的农田、森林等场景仍明显退化。

OneViewAll: Semantic Prior Guided One-View 6D Pose Estimation for Novel Objects Figure 1
arXiv preprint2026-05-07

OneViewAll: Semantic Prior Guided One-View 6D Pose Estimation for Novel Objects

Yang Luo, Yan Gong, Yongsheng Gao, Jie Zhao, Xinyu Zhang, Huaping Liu

6D位姿估计未知物体

针对真实机器人场景中只有单个 RGB-D 参考视图、缺少 CAD 模型的未知物体 6D 位姿估计,OneViewAll 将传统渲染比较改为投影比较,在投影等变空间直接对齐参考与查询,并引入类别/场景、对称性和 patch 级语义先验以缓解遮挡、对称和视角变化。实验显示其在 LINEMOD 上用单视图达到 92.5% ADD-0.1,显著高于 One2Any 的 52.6%,且在多个数据集保持较低延迟。

TriDE: Triangle-Consistent Translation Directions for Global Camera Pose Estimation Figure 1
arXiv preprint2026-05-07

TriDE: Triangle-Consistent Translation Directions for Global Camera Pose Estimation

Francisco Chen, Yiran Wang, Davis

Department of Mathematics, University of California, Davis

6D位姿估计相机位姿

针对全局 SfM 中成对平移方向虽局部合理却在视图图中相互矛盾的问题,TriDE 将相机三角形共面一致性作为高阶验证信号,通过边方向与加权三角形之间的消息传递,在保留原图连通性的同时修正弱边候选,而非直接做敏感的全局非凸优化。实验显示其显著提升方向精度并改善后续相机位置估计,理论上还给出随机腐败模型下的精确恢复相变界。

EgoEMG: A Multimodal Egocentric Dataset with Bilateral EMG and Vision for Hand Pose Estimation Figure 1
arXiv preprint2026-05-07

EgoEMG: A Multimodal Egocentric Dataset with Bilateral EMG and Vision for Hand Pose Estimation

Ziheng Xi, Jiayi Yu, Yitao Wang, Yanbo Duan, Jianjiang Feng

Department of Automation, Tsinghua University

6D位姿估计手部姿态数据集/基准

针对手部姿态估计中视觉易受遮挡/模糊影响、EMG又缺少同步第一视角数据的问题,EgoEMG构建了双腕16通道EMG、IMU、第一视角RGB、外部RGB-D与MANO标注的双手数据集,并统一EMG、视觉及融合三类基准。结果显示跨用户泛化仍是EMG主要瓶颈,WiLoR视觉单模态最强,而EMG与轻量视觉残差融合可稳定带来增益,但对更强视觉模型是否仍有效文中未充分说明。

Syn4D: A Multiview Synthetic 4D Dataset Figure 1
arXiv preprint2026-05-06

Syn4D: A Multiview Synthetic 4D Dataset

Zeren Jiang, Yushi Lan, Yihang Luo, Yufan Deng, Zihang Lai, Edgar Sucar, Christian Rupprecht, Iro Laina, Diane Larlus, Chuanxia Zheng, Andrea Vedaldi

6D位姿估计仿真到现实数据集/基准多视角

针对动态场景4D重建与跟踪缺少大规模、稠密且可靠几何标注的问题,Syn4D用Unreal程序化构建多视角合成视频,整合专业场景、动态资产与人体动画,并提供相机、深度、点图、稠密2D/3D轨迹和人体姿态标注,支持任意像素跨时间跨相机反投影。实验显示,用该数据训练可提升几何感知新视角合成、4D重建/跟踪和人体姿态估计,增益可能主要来自数据规模与标注完备性。

Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation Figure 1
arXiv preprint2026-05-05

Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation

China linsy21@mails.tsinghua.edu.cn, China xuezhou08@gmail.com, China zhanghongwen@bnu.edu.cn, China anliang@mail.tsinghua.edu.cn, Dongping Li ByteDance Hangzhou, China lidongping83@gmail.com, Shaohui Jiao ByteDance Beijing, China jiaoshaohui@bytedance.com, China liuyebin@mail.tsinghua.edu.cn

Tsinghua University, Beijing Normal University, ByteDance

6D位姿估计多视角三维重建

Mix3R针对稀疏多视角重建中前馈方法几何不完整、生成方法与输入不对齐的问题,将π3式点图/位姿预测与TRELLIS式3D生成通过Mixture-of-Transformers联合起来,先生成对齐的稀疏体素、点图和相机,再用基于2D-3D重叠的注意力偏置无训练地引导纹理几何生成。实验在Toys4k和GSO上显示其输入对齐、几何/纹理质量和相机位姿精度均优于多类基线,但真实场景泛化受训练数据与冻结解码器限制。

Can Multimodal Large Language Models Understand Pathologic Movements? A Pilot Study on Seizure Semiology Figure 1
arXiv preprint2026-05-05

Can Multimodal Large Language Models Understand Pathologic Movements? A Pilot Study on Seizure Semiology

Lina Zhang, Tonmoy Monsoor, Mehmet Efe Lorasdagi, Prateik Sinha, Chong Han, Peizheng Li, Yuan Wang, Jessica Pasqua, Colin McCrimmon, Rajarshi Mazumder, Vwani Roychowdhury

6D位姿估计

针对癫痫等病理性不自主运动依赖人工判读、标注稀缺且传统分类器缺乏解释性的问题,本文将通用多模态大模型零样本用于发作视频的半定量症状识别,并用人脸裁剪、姿态估计、音频降噪等特征定向预处理增强信号。90段临床视频上,MLLM在18个可比特征中13项优于微调CNN/ViT,10/20项经预处理提升,且正确预测解释多与癫痫专家推理一致,但细微高频动作仍是短板。

HumanSplatHMR: Closing the Loop Between Human Mesh Recovery and Gaussian Splatting Avatar Figure 1
arXiv preprint2026-05-04

HumanSplatHMR: Closing the Loop Between Human Mesh Recovery and Gaussian Splatting Avatar

Yeheng Zong, Pou-Chun Kung, Yike Pan, Seth Isaacson, Yizhou Chen Ram Vasudevan

Yeheng Zong Pou-Chun Kung Yike Pan Seth Isaacson Yizhou Chen, University of Michigan

6D位姿估计三维重建高斯泼溅

该文针对单目视频中人体网格估计与高保真头像重建相互割裂的问题:前者易过拟合2D视角、后者依赖错误SMPL会损害新姿态泛化。HumanSplatHMR将HMR与3D Gaussian头像放入同一优化闭环,通过可微渲染把光度、分割和深度损失反传到姿态与全局位姿,并用CAMEL在衣物灵活性和网格约束间折中。实验显示其相对姿态恢复和头像基线同时提升SMPL精度与新视角渲染质量。

Temporally Consistent Object 6D Pose Estimation for Robot Control Figure 1
IEEE Robotics and Automation Letters2026-05-04

Temporally Consistent Object 6D Pose Estimation for Robot Control

Kateryna Zorina, Vojtech Priban, Mederic Fourmy, Josef Sivic, Vladimir Petrik

Czech Technical University in Prague

6D位姿估计物体位姿机器人操作

面向将单目 RGB 6D 位姿估计用于机器人反馈控制时的抖动、漏检和离群值问题,论文把逐帧估计放入在线因子图平滑框架,联合物体运动模型与显式测量不确定性,并分轨处理多实例和离散对称性。实验显示该方法在真实/合成位姿基准上优于逐帧结果,并在 Panda 机械臂跟踪任务中比原始估计更稳定、可实时运行。

Observability Conditions and Filter Design for Visual Pose Estimation via Dual Quaternions Figure 1
arXiv preprint2026-05-03

Observability Conditions and Filter Design for Visual Pose Estimation via Dual Quaternions

Nicholas B. Andrews, Kristi A. Morgansen

6D位姿估计

针对传统 PnP 在噪声、离群点和遮挡/量测丢失下缺乏动态记忆的问题,本文用双四元数统一建模 SE(3) 相对位姿与运动,并以李代数可观性分析给出位置向量和单位视线量测下的局部可观条件,解释了 P3P 共线退化。进一步设计双四元数李群 UKF,仿真中相较现成 PnP 提升位姿精度并增强遮挡鲁棒性。

Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds Figure 1
arXiv preprint2026-05-01

Depth-Guided Privacy-Preserving Visual Localization Using 3D Sphere Clouds

Heejoon Moon, Jongwoo Lee, Jeonggon Kim, Je Hyeong Hong

6D位姿估计相机位姿彩色深度

针对私有视觉定位地图可被稀疏点云重建、且既有线云会遭密度攻击还原几何的问题,论文提出将地图点提升为穿过质心的 3D 球云线表示,使攻击退化到质心;再用稀疏化、假点与描述子复用抑制直接反演,并借助设备 ToF 深度补足平移尺度。在公开 RGB-D 数据上,其隐私保护与运行时间具竞争力,位姿精度相较深度引导定位方法未出现过度损失。

A Model-based Visual Contact Localization and Force Sensing System for Compliant Robotic Grippers Figure 1
arXiv preprint2026-05-01

A Model-based Visual Contact Localization and Force Sensing System for Compliant Robotic Grippers

Kaiwen Zuo, Shuyuan Yang, Zonghe Chua

Manuscript received: February 5, 2026; Revised

6D位姿估计机器人操作

为在不破坏软夹爪结构的情况下获取抓取力,本文面向腕部 RGB-D 相机提出模型驱动的视觉力感知系统:用关键点驱动 SOFA 逆有限元,并结合在线三维重建、6D 位姿估计与迭代接触定位处理遮挡和未知物体。实验中加载阶段力估计 RMSE 为 0.23 N、NRMSD 为 2.11%,完整抓取过程为 0.48 N、4.34%,显示其适合实时软夹爪间接力估计。

MAEPose: Self-Supervised Spatiotemporal Learning for Human Pose Estimation on mmWave Video Figure 1
arXiv preprint2026-04-30

MAEPose: Self-Supervised Spatiotemporal Learning for Human Pose Estimation on mmWave Video

Xijia Wei, Yuan Fang, Kevin Chetty, Youngjun Cho, Nadia Bianchi-Berthouze

University College London

6D位姿估计人体姿态

针对毫米波人体姿态估计依赖点云/静态谱图预处理、丢失雷达视频时空信息且难利用未标注数据的问题,MAEPose将RD/RA谱图直接视作视频,用MAE自监督预训练ViT学习运动表征,并以多帧热图解码保持关节空间对应。在三数据集留一人验证中,MPJPE较监督基线最高降22.1%,旁人零样本干扰仅增6.5%误差,消融显示预训练和热图头是主要增益来源。

Adaptive Geodesic Conformal Prediction for Egocentric Camera Pose Estimation Figure 1
arXiv preprint2026-04-30

Adaptive Geodesic Conformal Prediction for Egocentric Camera Pose Estimation

Aishani Pathak

Arizona State University

6D位姿估计相机位姿

面向 AR/辅助设备中的第一视角相机位姿估计,论文指出仅给点估计不够,还需有覆盖保证的不确定区域;标准 conformal prediction 虽能达整体 90% 覆盖,却在最难帧显著失效。作者用 SE(3) 测地非一致性揭示欧氏评分会错判难例,并提出 DINOv2-Bridge 自适应阈值,在跨参与者、测试无图像条件下将困难帧覆盖率由约 0.75 提升到约 0.93,同时维持整体 90% 覆盖。

From Images2Mesh: A 3D Surface Reconstruction Pipeline for Non-Cooperative Space Objects Figure 1
arXiv preprint2026-04-30

From Images2Mesh: A 3D Surface Reconstruction Pipeline for Non-Cooperative Space Objects

Bala Prenith Reddy Gopu, Patrick Quinn, George M. Nehma, Madhur Tiwari, Matt Ueckermann, David Hinckley, Christopher McKenna

6D位姿估计三维重建

面向主动清除和在轨服务中对非合作空间目标几何与状态的需求,本文提出从单目在轨巡检视频生成显式表面网格的五阶段流程,串联抽帧、SAM3去背景、COLMAP位姿估计、Neuralangelo重建与PPISP光度校正。实验在STS-119与ADRAS-J公开真实影像上表明,去背景是相机注册成功的关键,原始帧直接处理会失败;曝光校正对简单目标有质性改善,但复杂结构阴影区域效果受光照条件限制。

LA-Pose: Latent Action Pretraining Meets Pose Estimation Figure 1
arXiv preprint2026-04-30

LA-Pose: Latent Action Pretraining Meets Pose Estimation

Zhengqing Wang, Saurabh Nair, Prajwal Chidananda, Pujith Kachana, Samuel Li, Matthew Brown, Yasutaka Furukawa

Wayve Simon Fraser University

6D位姿估计

针对前馈位姿估计依赖昂贵3D标注、难以利用海量驾驶视频的问题,LA-Pose将Genie式逆/正向动力学自监督预训练得到的“潜在动作”重用为自车运动表征,再用少量高质量3D标注微调轻量位姿头。其核心洞察是驾驶动作与相机运动强相关,帧间预测瓶颈会压缩出位姿信息;在Waymo和PandaSet上较近期前馈方法位姿精度提升超过10%,但倒车等稀有运动仍不稳定,增益可能部分来自大规模视频预训练数据。

Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations Figure 1
arXiv preprint2026-04-29

Reconstruction by Generation: 3D Multi-Object Scene Reconstruction from Sparse Observations

Andrii Zadaianchuk, Leonardo Barcellona, Lennard Schuenemann, Christian Gumbsch, Zehao Wang, Muhammad Zubair Irshad, Fabien Despinoy, Rahaf Aljundi, Stratis Gavves, Sergey Zakharov

6D位姿估计物体位姿三维重建

面向机器人 real-to-sim 中稀疏 RGB-D 观测难以重建遮挡多物体场景的问题,RecGen 将生成式 3D 先验与相机坐标系下的形状、部件和 6D 位姿联合概率估计结合,避免先生成再配准的误差传播,并通过遮挡合成数据、姿态条件纹理和单/多视角训练增强鲁棒性。实验显示其在强遮挡、对称和部件级场景中优于 SAM3D,几何、纹理和位姿分别提升 30.1%、9.1%、33.9%,且训练网格少约 80%。

SnapPose3D: Diffusion-Based Single-Frame 2D-to-3D Lifting of Human Poses Figure 1
arXiv preprint2026-04-29

SnapPose3D: Diffusion-Based Single-Frame 2D-to-3D Lifting of Human Poses

Alessandro Simoni, Riccardo Catalini, Davide Di Nucci, Guido Borghi, Davide Davoli, Lorenzo Garattoni, Gianpiero Francesca, Yuki Kawana, Roberto Vezzani

6D位姿估计人体姿态

针对单帧2D到3D人体姿态提升中的深度歧义与关节不确定性,SnapPose3D用条件扩散模型在2D姿态和人体周围多尺度视觉特征约束下生成多种3D假设,并通过聚合得到最终姿态,避免依赖视频序列和跟踪。文中在Human3.6M、H36MA和MPI-INF-3DHP上报告优于现有方法,并指出假设间一致性可反映预测可靠性。

Recipes for Calibration Checks in Safety-Critical Applications Figure 1
arXiv preprint2026-04-29

Recipes for Calibration Checks in Safety-Critical Applications

Romeo Valentin

Vaughn College of Aeronautics and Technology, American Institute of Aeronautics and Astronautics

6D位姿估计

面向机器人位姿估计等安全关键系统,论文指出仅看点估计精度不足,必须验证预测不确定性是否校准。其核心是把校准检查拆成数据模型、度量、假设和检验四个可替换模块,并加入只拒绝过度自信、允许工程容差的安全化设定。实验在天气预测和粒子滤波定位上给出离线 KS 与在线 e-value 监控示例,展示同一框架能产生可部署的通过/拒绝决策。

Decoupled Prototype Matching with Vision Foundation Models for Few-Shot Industrial Object Detection Figure 1
arXiv preprint2026-04-29

Decoupled Prototype Matching with Vision Foundation Models for Few-Shot Industrial Object Detection

Nilusha Jayawickrama, Risto Ojala

6D位姿估计

面向工业产线中物体频繁更换、标注与CAD模型获取成本高的问题,论文提出DPM-VFM:将类别无关分割提案与视觉基础模型特征解耦,用少量参考图构建类别原型并做相似度匹配,无需微调即可接入新物体。在三个BOP工业数据集上按2D检测协议评估,相比训练自由方法AP提升6.9%,但主要瓶颈仍来自提案质量与遮挡场景。

Evaluation of Pose Estimation Systems for Sign Language Translation Figure 1
arXiv preprint2026-04-27

Evaluation of Pose Estimation Systems for Sign Language Translation

Catherine O'Brien, Gerard Sant, Mathias Müller, Sarah Ebling

ZHAW Zurich University of Applied Sciences

6D位姿估计

针对手语翻译中姿态估计器常被当作实现细节、默认使用 MediaPipe/OpenPose 的问题,本文在同一 SLT 管线中系统比较 8 类全身/高容量估计器,并结合时间抖动、手部缺失和遮挡分析解释下游差异。结果显示 SDPose 与 Sapiens 翻译最好(BLEU 约 11.5,高于 MediaPipe 约 10),Sapiens 在遮挡样例中 15/15 正确,而手部关键点缺失与较低 BLEU/BLEURT 明显相关。

Phase-Separated Complex Hilbert PCA on Markerless 3D Pose Estimation Data: A Global Phase Network and Its Extension to a Continuous Field on the Body Surface Figure 1
arXiv preprint2026-04-27

Phase-Separated Complex Hilbert PCA on Markerless 3D Pose Estimation Data: A Global Phase Network and Its Extension to a Continuous Field on the Body Surface

Hiromitsu Goto, Tao Tao, Zheng-Lin Chia

Faculty of Information Engineering, Kanazawa Gakuin University, Kanazawa, Japan, Hiromitsu Goto

6D位姿估计

针对传统运动链分析局限于相邻关节配对、或依赖力板和惯性参数的问题,本文将分阶段复Hilbert PCA用于无标记3D姿态速度序列,把全身协调用单个复特征向量表示,并扩展到1079个体表网格顶点形成连续相位场。在单被试14次锤击实验中,方法显示躯干锚定的全局相位结构,下挥较上挥具有更高Mode-1贡献和跨试次一致性,并与CRP及动能动员方差呈显著对应,但泛化性仍受单被试数据限制。

Unconstrained Multi-view Human Pose Estimation with Algebraic Priors Figure 1
arXiv preprint2026-04-27

Unconstrained Multi-view Human Pose Estimation with Algebraic Priors

Xiaolin Qin, Qianlei Wang, Jiacen Liu, Chaoning Zhang, Fei Zhu, Zhang Yi

Chengdu Institute of Computer Applications, Chinese Academy of Sciences, Chengdu 610213, China, Chinese Academy of Sciences, Hong Kong 999077, China, School of Computer Science, Sichuan University, Chengdu 610065, China

6D位姿估计人体姿态多视角

该文针对多视角人体3D姿态估计对精确相机标定依赖过强、难以用于野外视频和临时相机网络的问题,提出无标定框架:用Transformer回归器替代显式三角化,引入Gröbner基校正损失约束多视图代数几何关系,并用时间等变整流缓解尺度歧义。实验称在标准基准上刷新无标定多视角姿态估计结果,缩小与全标定方法的差距。

A Pose-only Geometric Constraint for Multi-Camera Pose Adjustment Figure 1
arXiv preprint2026-04-26

A Pose-only Geometric Constraint for Multi-Camera Pose Adjustment

Shunkun Liang, Banglei Guan, Bin Li, Qifeng Yu, Yang Shang

6D位姿估计相机位姿多视角

多相机在导航和重建中带来大量冗余观测,使传统 BA 同时优化位姿与三维点时计算负担加重。本文以广义相机统一建模,提出由两条基准观测隐式表示三维点的 pose-only 几何约束,并据此只优化系统位姿,同时用不确定性椭球选择基准观测、优化后再做统计最优重建。合成与真实数据表明,相比常规 BA 可显著提速,位姿精度保持或略有提升。

Deploy DINO with Many-to-Many Association Figure 1
arXiv preprint2026-04-26

Deploy DINO with Many-to-Many Association

Haodong JIANG, Mingzhe LI, Junfeng WU

Cyber University of Korea, University of Hong Kong

6D位姿估计

这篇论文针对监督式图像匹配在域外场景泛化差的问题,尝试直接用冻结的 DINO/DINOv3 特征做几何匹配。作者指出其语义特征在相似实例和部件间天然存在歧义,因此用多对多候选关联提升召回,并从似然角度重释 MCM,提出线性评估的 HCM 来替代昂贵的最大匹配评分。以相机位姿估计验证,零样本 DINO 配合多对多关联和 HCM 在 OOD 数据上可接近或超过专用匹配模型。

Geometry-Conditioned Diffusion for Occlusion-Robust In-Bed Pose Estimation Figure 1
arXiv preprint2026-04-26

Geometry-Conditioned Diffusion for Occlusion-Robust In-Bed Pose Estimation

Navid Aslankhani Khameneh, Marco Carletti, Verona, Italy EVS - Embedded Vision Systems Srl, Italy

Department of Computer Science, University of Verona, Verona, Italy

6D位姿估计

针对被毯子严重遮挡时床上人体姿态难以标注、依赖多模态传感或可见源图像生成数据不易扩展的问题,本文将遮挡增强改写为由骨架几何条件驱动的生成任务,提出 Pose-LDM 直接从关键点合成盖毯图像,摆脱成对图像和像素级源图约束。SLP 实验表明,其在重遮挡下取得最高严格关键点定位精度,整体检测接近配对扩散和全监督训练,说明增益主要来自几何条件的数据增强设计。

Keypoint-based Dynamic Object 6-DoF Pose Tracking via Event Camera Figure 1
arXiv preprint2026-04-25

Keypoint-based Dynamic Object 6-DoF Pose Tracking via Event Camera

Zhe Wang, Qijin Song, Zihao Li, Jingyu Xiao, Weibang Bai

6D位姿估计事件相机

面向高速运动物体在RGB相机下易受运动模糊、低光照和初始化依赖影响的问题,本文用事件相机构建基于关键点的6DoF跟踪流程:从时间表面检测关键点,结合事件极性、空间位置与局部密度连续跟踪,并通过2D-3D哈希匹配和EPnP求解位姿。实验表明其在仿真和真实事件场景中较现有事件方法具有更好的精度与鲁棒性。

PASR: Pose-Aware 3D Shape Retrieval from Occluded Single Views Figure 1
arXiv preprint2026-04-24

PASR: Pose-Aware 3D Shape Retrieval from Occluded Single Views

Jiaxin Shi, Guofeng Zhang, Wufei Ma, Naifu Liang, Adam Kortylewski, San Diego, CISPA Helmholtz Center for Information Security

Shanghai Jiao Tong University Johns Hopkins University, University of California, San Diego CISPA Helmholtz Center for Information Security

6D位姿估计

针对单视角3D形状检索在真实遮挡、视角变化和未见网格上易失效的问题,PASR将检索改写为位姿感知的特征级 analysis-by-synthesis:训练时把DINOv3的2D patch特征蒸馏到点级3D编码器,推理时联合优化候选形状与6D位姿来重建输入特征图。该方法在Pix3D和Pascal3D上取得Top-1 81.59%和76.43%,遮挡场景相对最佳基线提升11.09%和7.15%,并兼具姿态估计与分类能力。

Non-Minimal Sampling and Consensus for Prohibitively Large Datasets Figure 1
arXiv preprint2026-04-24

Non-Minimal Sampling and Consensus for Prohibitively Large Datasets

Seong Hun Lee, Patrick Vandewalle, Javier Civera

6D位姿估计数据集/基准

面对密集匹配或全对全假设带来的海量对应和极高外点率,传统 RANSAC/全局优化常受内存与计算限制。NONSAC 的关键洞察是固定抽取多个非最小子集,用任意鲁棒估计器独立生成假设,再以残差/一致性评分选择模型,避免全量评估并利用子集中内点率波动。实验覆盖相对位姿、PnP 和点云配准,在 25 万对应、99.9% 外点的无对应配准中仍可约 30 秒恢复变换,TLP 评分整体最稳。

Adaptive vs. Static Robot-to-Human Handover: A Study on Orientation and Approach Direction Figure 1
arXiv preprint2026-04-24

Adaptive vs. Static Robot-to-Human Handover: A Study on Orientation and Approach Direction

Federico Biagi, Dario Onfiani, Simone Silenzi, Cristina Iani, Luigi Biagiotti

6D位姿估计手部姿态机器人操作

针对传统机器人递物常用固定目标位姿、迫使人调整抓取姿态的问题,本文提出依据用户手腕姿态和后续任务实时调整交付6D位姿的自适应框架,并用受约束平滑轨迹降低动态跟踪带来的不可预测性。14人实验显示,相比静态递物,自适应方案显著降低眨眼率和NASA-TLX负荷,可靠性信任有所提升,但总体信任量表差异并不完全显著。

PoseFM: Relative Camera Pose Estimation Through Flow Matching Figure 1
arXiv preprint2026-04-24

PoseFM: Relative Camera Pose Estimation Through Flow Matching

Dominik Kuczkowski, Laura Ruotsalainen

Department of Computer Science, University of Helsinki

6D位姿估计相机位姿

针对单目视觉里程计在弱纹理、模糊、动态场景中易受歧义影响且常用确定性回归缺乏不确定性建模的问题,PoseFM将帧间相机位姿估计改写为Flow Matching生成任务,利用光流提供稠密视觉线索,并通过连续ODE从噪声采样位姿分布。实验在TartanAir、KITTI和TUM-RGBD上达到与主流帧间单目VO相当的表现,部分序列取得最低ATE,并可通过采样给出不确定性。

Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM Figure 1
arXiv preprint2026-04-24

Flow4DGS-SLAM: Optical Flow-Guided 4D Gaussian Splatting SLAM

Yunsong Wang, Gim Hee Lee School of Computing

School of Computing, National University of Singapore

6D位姿估计相机位姿三维重建高斯泼溅

针对动态场景中传统3DGS-SLAM常把运动物体剔除、难以同时稳定跟踪与重建的问题,Flow4DGS-SLAM利用深度与光流拟合相机自运动,生成类别无关运动掩码并初始化位姿;同时以关键帧显式高斯中心、场景流传播、自适应插入和GMM建模时变不透明度/旋转来加速4D重建。实验显示其在相机跟踪、动态重建/渲染质量和训练效率上优于已有方法。

Revisiting Geometric Obfuscation with Dual Convergent Lines for Privacy-Preserving Image Queries in Visual Localization Figure 1
arXiv preprint2026-04-24

Revisiting Geometric Obfuscation with Dual Convergent Lines for Privacy-Preserving Image Queries in Visual Localization

Jeonggon Kim, Heejoon Moon

6D位姿估计相机位姿

面向云端视觉定位中图像查询易被反演或几何恢复攻击泄露隐私的问题,论文重新审视几何混淆,提出 Dual Convergent Lines:用中央分割线上的两个固定锚点将关键点提升为线,使邻域线要么收敛到锚点、要么近似平行,从而让恢复优化病态化。实验显示其在室内和大规模室外数据上更抗隐私攻击,同时保持可用的相机位姿估计效率与精度。

Agentic AI for Personalized Physiotherapy: A Multi-Agent Framework for Generative Video Training and Real-Time Pose Correction Figure 1
arXiv preprint2026-04-22

Agentic AI for Personalized Physiotherapy: A Multi-Agent Framework for Generative Video Training and Real-Time Pose Correction

Abhishek Dharmaratnakar, Srivaths Ranganathan, Anushree Sinha, Debanshu Das

6D位姿估计

针对居家康复缺少个性化监督、动作错误率高的问题,论文提出由临床信息抽取、生成式示范视频、实时姿态估计和诊断反馈组成的多智能体闭环,将医嘱约束转为运动范围限制并用 MediaPipe 本地检测关节角度。主要结果仍偏概念验证:文中给出 Python 原型和预估低延迟指标,临床效果与相对现有方案的增益尚未充分说明。

FingerEye: Continuous and Unified Vision-Tactile Sensing for Dexterous Manipulation Figure 1
arXiv preprint2026-04-23

FingerEye: Continuous and Unified Vision-Tactile Sensing for Dexterous Manipulation

Zhixuan Xu, Yichen Li, Xuanye Wu, Tianyu Qiu, Technology

National University of Singapore RoboScience, Huazhong University of Science and Technology South China University of Technology

6D位姿估计机器人操作

面向灵巧操作中接触前、接触瞬间到接触后的连续感知缺口,FingerEye将指尖双目RGB视觉、柔性环形结构和AprilTag位姿估计结合,用同一低成本传感流同时提供近距几何线索与6D接触力矩代理信号。作者进一步构建数字孪生和视觉-触觉模仿学习策略,在少量真实数据配合仿真增强下完成硬币立起、芯片拾取、取信和注射器操作等任务,显示其主要价值在于更稳定的接触初始化与跨外观泛化。

MAPRPose: Mask-Aware Proposal and Amodal Refinement for Multi-Object 6D Pose Estimation Figure 1
arXiv preprint2026-04-22

MAPRPose: Mask-Aware Proposal and Amodal Refinement for Multi-Object 6D Pose Estimation

Yang Luo, Yan Gong, Yongsheng Gao, Xiaoying Sun, Jie Zhao

6D位姿估计物体位姿

面向遮挡、杂乱场景中多物体/新物体6D位姿估计的初始化漂移与推理低效问题,MAPRPose将可见掩码约束的2D-3D对应用于生成少量几何一致候选,并用非模态掩码重建完整物体来重对齐ROI;同时把渲染比较和RGB-XYZ重投影张量化,并行细化所有假设。在BOP上AR达76.5%,较FoundationPose高3.1%,多物体推理快43倍。

BALTIC: A Benchmark and Cross-Domain Strategy for 3D Reconstruction Across Air and Underwater Domains Under Varying Illumination Figure 1
arXiv preprint2026-04-21

BALTIC: A Benchmark and Cross-Domain Strategy for 3D Reconstruction Across Air and Underwater Domains Under Varying Illumination

Michele Grimaldi, David Nakath, Oscar Pizarro, Jonatan Scharff Willners, Ignacio Carlucho, Yvan R. Petillot

6D位姿估计数据集/基准三维重建

针对水下与空中介质切换、光照变化导致传统三维重建评测不足的问题,BALTIC构建了含13组序列的受控跨域基准,并用水箱、单目相机和Vive轨迹提供真值,比较COLMAP、NeRF与3DGS。结果显示,水下会显著削弱SfM并影响后续神经表示;少量相似光照的空中图像可提供几何和辐射先验,提升完整性与轨迹稳定性。简单白平衡下3DGS在受控纹理场景表现接近专用水下方法,但真实复杂环境鲁棒性仍有限。

Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes Figure 1
International Journal of Computer Vision2026-04-20

Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classes

Csaba Beleznai, Margrit Gelautz

Austrian Institute of Technology

6D位姿估计

针对工业和机器人场景中无纹理对称物体会让同一外观对应多个旋转标签、进而干扰6D位姿网络训练的问题,论文从旋转数值表示本身入手,提出按物体对称阶数改造三角表示的 SARR,使规范化姿态在视觉上唯一且连续。基于 T-LESS 和 ITODD,标准 CNN 在对称敏感指标 AR_C 上超过已有方法,并优于矩阵、欧拉角、四元数和 6D 表示训练的同类网络。

Identifying Ethical Biases in Action Recognition Models Figure 1
arXiv preprint2026-04-20

Identifying Ethical Biases in Action Recognition Models

Ana Băltărețu, Pascal Benschop, Jan van Gemert EEMCS, The Netherlands @tudelft.nl

EEMCS, Delft University of Technology, The Netherlands

6D位姿估计

本文关注动作识别模型在安防、医疗等高风险场景中可能因肤色等外观属性产生不公平预测的问题。作者用 BEDLAM 生成时序一致、可控改变单一身份属性的合成视频,以隔离运动与外观因素来审计 HAR 模型。实验显示视角和背景会显著影响准确率,只有部分真实数据训练模型能较好泛化到合成视频;各模型对肤色变化均有敏感性,但多重校正后未发现特定肤色对之间的显著偏置。

PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty Figure 1
arXiv preprint2026-04-20

PCM-NeRF: Probabilistic Camera Modeling for Neural Radiance Fields under Pose Uncertainty

Shravan Venkatraman, Rakesh Raj Madavan

6D位姿估计三维重建

针对 SfM 位姿含离群误差时 NeRF/神经表面重建易被错误视角拖入局部最优的问题,PCM-NeRF在SG-NeRF上为每个相机引入可学习的SE(3)均值与方差,并用匹配与渲染置信度约束不确定性,使高不确定视角自动降低位姿更新步长。实验显示其在严重位姿异常场景中提升Chamfer Distance和F-Score,尤其改善复杂几何重建,且几乎不改渲染管线。

Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation Figure 1
Displays2026-04-20

Dual-stream Spatio-Temporal GCN-Transformer Network for 3D Human Pose Estimation

Jiawen Duan, Jian Xiang, Zhiqiang Li, Linlin Xue, Wan Xiang

Zhejiang University of Science and Technology, University of Wisconsin–Madison

6D位姿估计人体姿态

针对单目2D到3D人体姿态提升中Transformer偏重全局依赖、易忽略局部骨架结构和通道交互的问题,论文提出MixTGFormer,以双流时空Mixformer将GCN嵌入Transformer,并用SE层补充通道建模,实现局部骨架关系与全局时空关系的融合。在Human3.6M和MPI-INF-3DHP上分别取得37.6mm和15.7mm的P1误差,报告优于现有方法。

HyKey: Hyperspectral Keypoint Detection and Matching in Minimally Invasive Surgery Figure 1
International Journal of Computer Assisted Radiology and Surgery2026-04-19

HyKey: Hyperspectral Keypoint Detection and Matching in Minimally Invasive Surgery

Chiara Di Vece, Zhehua Mao, Sierra Bonilla, Chloe He, Joao Ramalhinho, Tobias Czempiel, Sophia Bano, Danail Stoyanov

University College London, Ecolab (United Kingdom)

6D位姿估计医学/手术

针对微创手术场景纹理弱、光照复杂导致RGB关键点不稳定的问题,HyKey将快照式高光谱立方体用于关键点检测与描述,通过混合3D-2D CNN联合建模光谱-空间特征,并结合单应增强与极线约束训练。在双模态腹腔镜数据上,其相较SuperPoint、ALIKE等RGB基线更稳,达到96.62%平均匹配准确率和10°位姿估计67.18% mAA。

TSM-Pose: Topology-Aware Learning with Semantic Mamba for Category-Level Object Pose Estimation Figure 1
arXiv preprint2026-04-18

TSM-Pose: Topology-Aware Learning with Semantic Mamba for Category-Level Object Pose Estimation

Jinshuo Liu, Bingtao Ma, Junlin Su, Guanyuan Pan, Beining Wu, Cheng Yang, Jiaxuan Lu

Hangzhou Dianzi University, Shanghai Artificial Intelligence Laboratory

6D位姿估计物体位姿类别级位姿

面向类别级6D位姿估计中未见实例的形变、遮挡与噪声带来的泛化难题,TSM-Pose从仅依赖局部几何/简单池化的局限出发,引入拓扑提取器建模点云的全局结构,并用带类别语义 token 的 TwinMamba 聚合关键点长程依赖,缓解稀疏关键点的语义稀释。论文在 REAL275、CAMERA25 和 HouseCat6D 上报告优于现有 SOTA。

PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems Figure 1
arXiv preprint2026-04-17

PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems

Weijie Wang, Songlong Xing, Zhengyu Zhao, Nicu Sebe, Italy, Fondazione Bruno Kessler, China @unitn.it, zhengyu.zhao@xjtu.edu.cn

University of Trento, Italy Fondazione Bruno Kessler, Italy Xi’an Jiaotong University, China

6D位姿估计三维重建

针对现有3D重建投毒多把整条管线当黑盒、难解释且迁移性有限的问题,本文指出SfM初始化才是MVS、NeRF、3DGS等系统共享的几何薄弱环节。PoInit-of-View通过在多视图对应点处制造跨视图梯度/光度不一致,破坏关键点匹配、位姿估计和三角化,并给出对应崩塌分析;在多系统黑盒迁移中相较单视图基线PSNR、SSIM攻击效果分别提升25.1%和16.5%。

Fast Online 3D Multi-Camera Multi-Object Tracking and Pose Estimation Figure 1
arXiv preprint2026-04-16

Fast Online 3D Multi-Camera Multi-Object Tracking and Pose Estimation

Linh Van Ma, Tran Thien Dat Nguyen, Moongu Jeon

6D位姿估计物体位姿多视角

针对多相机3D多目标跟踪与位姿估计中3D标注昂贵、深度3D模型难以实时且泛化受限的问题,论文把跨视角匹配建模为多传感器多目标滤波,并对Bayes最优MS-GLMB滤波作大幅近似,用2D框和2D姿态检测及一系列低成本线性分配在线恢复世界坐标下轨迹与位姿。实验显示其在多数据集和相机断连/重连场景下显著快于现有方法,精度基本不降,但相对依赖3D训练的方法仍受2D检测质量限制。

GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow Figure 1
arXiv preprint2026-04-17

GaussianFlow SLAM: Monocular Gaussian Splatting SLAM Guided by GaussianFlow

Dong-Uk Seo, Jinwoo Jeon, Student Member, IEEE, Eungchang Mason Lee, Member, Hyun Myung, Senior Member

Korea Advanced Institute of Science and Technology

6D位姿估计相机位姿三维重建高斯泼溅

针对单目 3DGS-SLAM 缺少深度几何约束、易陷入局部最优并造成位姿与地图相互劣化的问题,GaussianFlow SLAM 将高斯投影运动与稠密光流对齐,以闭式梯度同时约束场景结构和相机位姿,并用归一化误差驱动增密/剪枝清理不稳定高斯。实验显示其在公开数据集上提升渲染质量和跟踪精度,达到优于现有单目高斯 SLAM 的结果,但系统仍非实时。

Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees Figure 1
arXiv preprint2026-04-16

Vision-Based Safe Human-Robot Collaboration with Uncertainty Guarantees

Jakob Thumm, Marian Frei, Tianle Ni, Matthias Althoff, Marco Pavone

Stanford University, RWTH Aachen University, Shanghai Jiao Tong University, Technical University of Munich

6D位姿估计机器人操作

面向人机协作中视觉感知误差和分布外输入会破坏安全证明的问题,本文用双目2D姿态协方差、三角化与运动预测实现端到端不确定性传播,并以共形预测集给未来关节位置置信界,同时用梯度式OOD检测和历史预测替代维持连续运行。在Human3.6M和真实SARA shield实验中,精度接近现有方法,预测保守性较ISO式模型降低约11倍,真实运行中断减少36.0%。

Zero-Shot Retail Theft Detection via Orchestrated Vision Models: A Model-Agnostic, Cost-Effective Alternative to Trained Single-Model Systems Figure 1
arXiv preprint2026-04-16

Zero-Shot Retail Theft Detection via Orchestrated Vision Models: A Model-Agnostic, Cost-Effective Alternative to Trained Single-Model Systems

Haileab Yagersew

Addis Ababa, Ethiopia

6D位姿估计

针对零售盗窃检测依赖私有数据训练、部署费用高的问题,Paza 不训练专用模型,而是用 YOLO/ByteTrack/姿态估计持续筛选可疑行为,仅在停留时间与动作信号触发时调用可替换的 VLM 做多帧遮藏判断。预过滤将 VLM 调用降约 240 倍;在 DCSASS 合成数据上零样本精度 89.5%、特异性 92.8%、召回 59.3%,并给出每店约 50–100 美元/月的成本估算,但真实场景泛化仍需验证。

Efficient closed-form approaches for pose estimation using Sylvester forms Figure 1
arXiv preprint2026-04-16

Efficient closed-form approaches for pose estimation using Sylvester forms

Jana Vráblíková, Ezio Malis, Laurent Busé

6D位姿估计

本文针对实时6D位姿估计中闭式最小二乘求解仍受高阶消元矩阵拖慢的问题,将Sylvester形式引入隐藏变量resultant框架,把四元数约束下的多项式求解从既有9阶降到7/8阶,从而构造更紧凑的消元矩阵。方法覆盖混合3D-3D对应与3D-2D PnP;实验显示精度基本保持与deg9及主流PnP相当,运行时间进一步降低,如PnP中deg7快于deg9。

Interpretable Human Activity Recognition for Subtle Robbery Detection in Surveillance Videos Figure 1
arXiv preprint2026-04-15

Interpretable Human Activity Recognition for Subtle Robbery Detection in Surveillance Videos

Bryan Jhoan Cazáres Leyva, Ulises Gachuz Davila, José Juan González Fonseca, Juan Irving Vasquez, Vanessa A. Camacho-Vázquez, Sergio Isahí Garrido-Castañeda

6D位姿估计

针对“抢夺后逃跑”这类短暂、非暴力且易与正常互动混淆的监控事件,论文提出用 YOLO 姿态关键点替代端到端黑箱识别,显式构造手部速度、伸臂、距离和相对运动等可解释特征,并以随机森林加时间滞回稳定报警。实验在 staged 数据和独立网络视频上显示一定跨场景泛化,并在 Jetson Nano 上实现实时运行;但数据规模有限,实际部署鲁棒性仍需进一步验证。

UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception Figure 1
arXiv preprint2026-04-15

UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception

Ziming Wang HKU

6D位姿估计机器人操作

UMI-3D针对原UMI依赖单目视觉SLAM、在遮挡、动态场景和弱纹理环境中易丢跟踪的问题,将低成本轻量LiDAR集成到腕部采集器,并通过硬件同步与时空标定对齐视觉和点云,获得更稳定的尺度一致位姿。实验显示其在常规操作上保持高成功率,并能采集和学习窗帘拉动、开门/抽屉、大型柔性物体等原视觉方案较难覆盖的任务。

SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation Figure 1
IEEE Transactions on Circuits and Systems for Video Technology2026-04-15

SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation

Songlin Du, Xiaoyong Lu, Yaping Yan, Guobao Xiao, Xiaobo Lu, Takeshi Ikenaga

Southeast University, Tongji University, Waseda University

6D位姿估计

SceneGlue针对跨视角特征匹配中过度依赖局部描述子、难以利用场景级上下文的问题,提出无需场景级标注的场景感知匹配框架:用波形位置编码增强关键点表示,并将自注意力与交叉注意力并行化,同时通过Visibility Transformer显式估计跨视角可见区域。实验覆盖单应、位姿估计、图像匹配和视觉定位,显示其在精度、鲁棒性与可解释性上优于既有匹配方法。

RMGS-SLAM: Real-time Multi-sensor Gaussian Splatting SLAM Figure 1
arXiv preprint2026-04-14

RMGS-SLAM: Real-time Multi-sensor Gaussian Splatting SLAM

Dongen Li, Yi Liu, Junqi Liu, Zewen Sun, Zefan Huang, Shuo Sun, Jiahui Liu, Chengran Yuan, Hongliang Guo, Francis E. H. Tay, Marcelo H. Ang

6D位姿估计相机位姿三维重建高斯泼溅

RMGS-SLAM针对大规模真实场景中3DGS-SLAM难以同时满足低延迟定位、连续致密重建和长期一致性的问题,提出紧耦合激光雷达-惯性-视觉框架,并将位姿估计、高斯初始化与全局高斯优化并行化;其级联初始化结合前馈预测和voxel-PCA几何先验,回环则直接在全局高斯图上用Gaussian-GICP构造约束。实验显示其在公开与自建同步多传感器户外数据上兼顾实时性、定位精度和渲染质量。

GGD-SLAM: Monocular 3DGS SLAM Powered by Generalizable Motion Model for Dynamic Environments Figure 1
ICRA 20262026-04-14

GGD-SLAM: Monocular 3DGS SLAM Powered by Generalizable Motion Model for Dynamic Environments

Yi Liu, Haoxuan Xu, Hongbo Duan, Keyu Fan, Zhengyang Zhang, Peiyu Zhuang, Pengting Luo, Houde Liu

6D位姿估计相机位姿三维重建高斯泼溅

GGD-SLAM针对单目3DGS SLAM在动态场景中依赖静态假设、易受行人等动态物体干扰的问题,核心洞察是动态性需由跨帧时序关系判断。方法用FIFO历史帧队列和序列注意力提取可泛化运动语义,结合动态特征增强、静态高斯KD-tree补全遮挡背景及自适应SSIM损失,降低误分割对位姿和建图的影响。真实动态数据集实验显示,其相机位姿估计和稠密重建达到SOTA水平。

ReefMapGS: Enabling Large-Scale Underwater Reconstruction by Closing the Loop Between Multimodal SLAM and Gaussian Splatting Figure 1
arXiv preprint2026-04-13

ReefMapGS: Enabling Large-Scale Underwater Reconstruction by Closing the Loop Between Multimodal SLAM and Gaussian Splatting

Daniel Yang, Jungseok Hong, John J. Leonard, Yogesh Girdhar

Massachusetts Institute of Technology

6D位姿估计相机位姿三维重建高斯泼溅

针对水下珊瑚礁大尺度稠密重建中 SfM 计算昂贵、纯视觉 SLAM 易受浑浊低纹理影响的问题,ReefMapGS 将多模态位姿图 SLAM 与增量式 3D Gaussian Splatting 闭环耦合:从地标附近低不确定区域建模,用可微渲染局部细化相机位姿,再作为因子回写全局优化。实验在两处真实礁区实现无需 COLMAP 的重建,轨迹最长约 700 m,重建质量和 AUV 全局位姿精度优于多种基线,运行时间约 3 小时,快于 SfM 流程。

AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation Figure 1
arXiv preprint2026-04-13

AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation

Mingyang Li, Haofan Xu, Haowen Sun, Xinzhe Chen, Sihua Ren, Liqi Huang, Xinyang Sui, Chenyang Miao, Jiawei Ye, Qiongjie Cui, Zeyang Liu, Xingyu Chen, Xuguang Lan School of Artificial Intelligence, Equal contribution, Corresponding authors

School of Artificial Intelligence, Xi’an Jiaotong University

6D位姿估计机器人操作数据集/基准

AffordSim针对现有仿真数据生成在功能区接触上要么依赖逐物体人工标注、要么被通用抓取器误导的问题,将开放词汇3D affordance预测前置,用语言任务生成场景与查询,在预测区域内采样抓取并用运动规划筛选。其50任务、500+物体基准中,无需逐物体标注即可达到人工接触标注93%的采集成功率,困难组合任务为89%,训练的VLA策略零样本迁移到真实FR3平均成功率24%。

LEADER: Learning Reliable Local-to-Global Correspondences for LiDAR Relocalization Figure 1
arXiv preprint2026-04-13

LEADER: Learning Reliable Local-to-Global Correspondences for LiDAR Relocalization

Jianshi Wu, Minghang Zhu, Dunqiang Liu, Wen Li, Sheng Ao Siqi Shen, Chenglu Wen, Efficient Computing, Ministry of Education of China, School of Informatics, China School of Engineering Mathematics, Technology

Fujian Key Laboratory of Urban Intelligent Sensing and Computing, Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, China, School of Engineering Mathematics and Technology, University of Bristol

6D位姿估计相机位姿点云

LEADER面向GNSS受限场景中的单帧LiDAR重定位,针对现有SCR方法对航向变化敏感、且把退化区域预测等同处理导致外点影响大的问题,引入基于投影与循环卷积的鲁棒几何编码器,并用截断相对可靠性损失筛选高可信局部到全局对应,再经RANSAC求6D位姿;在Oxford RobotCar和NCLT上分别将位置误差相对降低24.1%和73.9%,NCLT达到0.31 m精度。

ViserDex: Visual Sim-to-Real for Robust Dexterous In-hand Reorientation Figure 1
arXiv preprint2026-04-13

ViserDex: Visual Sim-to-Real for Robust Dexterous In-hand Reorientation

I Introduction

6D位姿估计手部姿态仿真到现实

针对灵巧手内重定向中单目 RGB 难以在遮挡、运动模糊和复杂外观下稳定估计物体位姿的问题,ViserDex 将 3D Gaussian Splatting 接入仿真训练,并在高斯表示上做物理一致的预渲染域随机化,生成逼真且多样的位姿估计数据;控制端采用课程强化学习与师生蒸馏。实验显示其位姿估计优于传统渲染数据,并在真实 Allegro Hand 上对五类物体实现零样本、复杂光照下的连续重定向。

MonoEM-GS: Monocular Expectation-Maximization Gaussian Splatting SLAM Figure 1
arXiv preprint2026-04-12

MonoEM-GS: Monocular Expectation-Maximization Gaussian Splatting SLAM

Evgenii Kruzhkov, Sven Behnke

the Autonomous Intelligent Systems group, Computer

6D位姿估计相机位姿三维重建高斯泼溅

针对单目几何基础模型输出随视角变化、噪声和尺度漂移会累积破坏地图一致性的问题,MonoEM-GS将预测点云作为观测,构建高斯混合/高斯泼溅地图,并用增量EM融合观测、ICP相对当前地图估计位姿,同时在高斯上存储多模态特征以支持开放集分割。7-Scenes、TUM RGB-D和Replica实验显示其位姿精度不总优于优化式基线,但重建指标多处排名前二,法向一致性和网格清洁度更好。

UDAPose: Unsupervised Domain Adaptation for Low-Light Human Pose Estimation Figure 1
arXiv preprint2026-04-12

UDAPose: Unsupervised Domain Adaptation for Low-Light Human Pose Estimation

Haopeng Chen, Yihao Ai, Kabeen Kim, Robby T. Tan, Yixin Chen

University of Mississippi, National University of Singapore, Duksung Women’s University

6D位姿估计人体姿态仿真到现实

低光场景缺少标注且视觉细节丢失,使人体姿态估计难以从正常光数据泛化。UDAPose用无标注低光图作参考,通过DHF和LCIM在扩散合成中注入真实高频低光特征,并用DCA在Transformer中动态平衡图像线索与姿态先验。实验在ExLPose低光困难集提升10.1 AP,跨数据集EHPT-XC提升7.4 AP。

Point2Pose: Occlusion-Recovering 6D Pose Tracking and 3D Reconstruction for Multiple Unknown Objects Via 2D Point Trackers Figure 1
arXiv preprint2026-04-12

Point2Pose: Occlusion-Recovering 6D Pose Tracking and 3D Reconstruction for Multiple Unknown Objects Via 2D Point Trackers

Tzu-Yuan Lin, Ho Jae Lee, Kevin Doherty, Yonghyeon Lee, Sangbae Kim

6D位姿估计未知物体三维重建

面向开放场景中无 CAD 模型、未知多物体在遮挡下易丢失的问题,Point2Pose 将长时程 2D 点跟踪作为持续数据关联,结合深度提升为物体坐标系关键点、帧到地图配准与在线 TSDF 重建,实现因果 6D 位姿跟踪。实验显示其在重遮挡基准上接近现有最佳,同时补足多物体跟踪与完全遮挡后快速恢复能力,并发布含动捕真值的 YCBMultiTrack 数据集。

Warm-Started Reinforcement Learning for Iterative 3D/2D Liver Registration Figure 1
arXiv preprint2026-04-11

Warm-Started Reinforcement Learning for Iterative 3D/2D Liver Registration

Hanyuan Zhang, Lucas He, Zijie Cheng, Abdolrahim Kadkhodamohammadi, Danail Stoyanov, B R Davidson, Evangeles B. Mazomenos, Matthew. J Clarkson

6D位姿估计

针对腹腔镜肝脏 AR 中术前 CT 与术中视频配准易受形变、遮挡和深度歧义影响,且监督方法常需额外优化细化的问题,本文将 3D/2D 刚性配准建模为序列决策,采用由监督位姿网络 warm-start 的共享编码器和离散动作 RL 策略,自动选择 6DoF 调整步长、方向与停止时机。在公开数据集上平均 TRE 为 15.70±8.18 mm,精度接近带优化的监督方法,同时收敛更快。

VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction Figure 1
arXiv preprint2026-04-11

VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction

Vasiliki Vasileiou, Panagiotis P. Filntisis, Petros Maragos, Kostas Daniilidis

Archimedes, Athena Research Center, Marousi, Greece HERON – Hellenic Robotics Center of Excellence, Athens, Greece, Robotics Institute, Athena Research Center, Marousi, Greece School of ECE, National Technical University of Athens, Greece, University of Pennsylvania

6D位姿估计相机位姿

针对单目头部位姿绝对回归需隐式学习数据集参考系、在大姿态下易退化的问题,VGGT-HPE将任务改写为已知锚点与目标图像间的相对刚体变换预测,并用VGGT几何基础模型经LoRA在合成FLAME双视图上微调,测试时再与锚点位姿组合。仅用合成数据训练即在BIWI取得SOTA,受控实验显示相对预测较绝对回归更准,且优势随锚点—目标差距增大而增强。

Text-Guided 6D Object Pose Rearrangement via Closed-Loop VLM Agents Figure 1
arXiv preprint2026-04-10

Text-Guided 6D Object Pose Rearrangement via Closed-Loop VLM Agents

Sangwon Baik, Gunhee Kim, Mingi Choi, Hanbyul Joo

Seoul National University

6D位姿估计物体位姿

针对VLM在单图、开环条件下难以把文本指令转成精确目标6D位姿的问题,本文将预训练VLM改造成无需训练的闭环代理:反复渲染观察、评估一致性并提出位姿增量,同时用多视角支持视图、物体中心坐标轴可视化和单轴旋转降低3D推理难度。实验称其在Open6DOR V2和SIMPLER上优于既有方法,尤其改善朝向敏感任务,并提升零样本机器人操作成功率。

Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories Figure 1
arXiv preprint2026-04-10

Rays as Pixels: Learning A Joint Distribution of Videos and Camera Trajectories

Wonbong Jang, Shikun Liu, Soubhik Sanyal, Juan Camilo Perez, Kam Woh Ng, Sanskar Agrawal, Juan-Manuel Perez-Rua, Yiannis Douratsos, Tao Xiang

6D位姿估计

针对稀疏视角或位姿歧义下,先估计相机再做视角/视频生成的流水线容易失效的问题,本文把相机射线编码成与视频帧同构的“raxel”图像,并在视频扩散模型中通过解耦自/交叉注意力联合去噪视频与轨迹。单模型可做位姿估计、给定位姿生成视频及联合生成,实验显示其位姿精度有竞争力、相机控制视频质量较好,且预测轨迹与条件生成结果具有自一致性。

Characterizing Lidar Range-Measurement Ambiguity due to Multiple Returns Figure 1
the Satellite Division's International Technical Meeting (Online)/ the Satellite Division's International Technical Meeting (CD-ROM)2026-04-10

Characterizing Lidar Range-Measurement Ambiguity due to Multiple Returns

Jason Rife, Yifan Li

Jason H. Rife and Yifan Li, Tufts University, Tufts University

6D位姿估计点云

面向激光雷达定位中的传感器完整性问题,论文指出同一锥形光束内存在多个散射面时,单一路径量测并非唯一而会呈概率性跳变,进而影响 ICP、NDT 等配准。作者用两种机械旋转雷达的静止序列构建特定像素的时间 CDF,并与邻域空间 CDF 对比,展示墙面较稳定,而角点、玻璃窗、植被等会出现多峰/抖动分布;空间 CDF 可能为即时检测多回波风险提供线索。

Globally Optimal Pose from Orthographic Silhouettes Figure 1
arXiv preprint2026-04-10

Globally Optimal Pose from Orthographic Silhouettes

Agniva Sengupta, Dilara Kuş, Jianning Li, Stefan Zachow Freie Universität Berlin

Zuse Institute Berlin

6D位姿估计

针对机器人操作等场景中仅有未遮挡轮廓、缺少特征对应时的6D位姿估计难题,本文利用正交投影轮廓面积随旋转连续变化的性质,预计算面积响应面并结合椭圆长宽比签名,对旋转空间做分支搜索和SE(3)细化。实验在合成与真实数据上较非线性、多起点和STI-Pose基线显著降低姿态误差,但强遮挡和重噪声下仍会失效。

Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touch Figure 1
arXiv preprint2026-04-10

Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touch

Gabriele M. Caddeo, Pasquale Marra, Lorenzo Natake

Italian Institute of Technology

6D位姿估计手部姿态三维重建

针对抓取/手内操作中手部严重遮挡导致单目三维重建尺度漂移、接触不一致的问题,本文把本体感知的手部几何与多点触觉作为显式物理约束,结合相机对齐 SDF、Structure-VAE 和条件 flow-matching 生成模型,并在训练/采样中加入接触一致与非穿透引导。仿真中相较纯视觉基线提升遮挡下补全与6D位姿精度,并在不同末端执行器的真实人形机器人上验证了迁移,但仍依赖较准的标定和手姿态。

AssemLM: Spatial Reasoning Multimodal Large Language Models for Robotic Assembly Figure 1
arXiv preprint2026-04-10

AssemLM: Spatial Reasoning Multimodal Large Language Models for Robotic Assembly

Zhi Jing, Jinbin Qiao, Ouyang Lu, Jicong Ao Shuang Qiu, Yu-Gang Jiang

Fudan University Institute of Artificial Intelligence (TeleAI), China Telecom, Tianjin University Northwestern Polytechnical University City University of Hong Kong

6D位姿估计机器人操作

面向装配机器人中仅靠2D/VLM难以进行精确三维几何与6D位姿推理的问题,AssemLM将装配手册、文本指令与点云统一到多模态大模型,并用专门点云编码器提取细粒度几何和旋转特征;同时构建含90万余样本、精确6D标注的AssemBench。实验显示其在多类装配场景的6D位姿推理达到SOTA,并在真机多步装配中验证可用性。

E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimation Figure 1
arXiv preprint2026-04-09

E-3DPSM: A State Machine for Event-Based Egocentric 3D Human Pose Estimation

Mayur Deshmukh, Hiroyasu Akada, Helge Rhodin, Christian Theobalt, Vladislav Golyanik, MPI for Informatics, SIC

MPI for Informatics, SIC Saarland University, SIC Bielefeld University

6D位姿估计人体姿态事件相机

面向头戴事件相机的自我中心3D人体姿态估计,既有方法未充分利用事件流异步、连续、变化驱动特性,易受自遮挡和时序抖动影响。E-3DPSM将姿态估计建模为连续状态机,用潜状态随事件演化并预测3D关节增量,再通过类Kalman可学习融合结合直接姿态回归以抑制漂移。在两个基准上相较EventEgo3D系方法MPJPE最高降低约19%,时序稳定性最高提升2.7倍,并可80Hz实时运行。

From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Tasks Figure 1
arXiv preprint2026-04-08

From Static to Interactive: Adapting Visual in-Context Learners for User-Driven Tasks

Carlos Schmidt, Simon Reiß

Karlsruhe Institute of Technology

6D位姿估计

现有视觉上下文学习虽能用少量输入输出示例适配新任务,却难以利用用户点击、涂鸦、框选等交互信号,限制了分割、编辑和定向处理中的可控性。本文将交互提示以融合式视觉编码直接写入上下文样例,把 DeLVM 改造成 i-DeLVM,使其可在无需微调时适配未见过的交互形式。实验显示,原有 DeLVM/LVM 往往忽略提示,而 i-DeLVM 在交互分割、定向超分和目标移除上分别带来 IoU、PSNR、LPIPS 的显著改进。

Exploring 6D Object Pose Estimation with Deformation Figure 1
arXiv preprint2026-04-08

Exploring 6D Object Pose Estimation with Deformation

Zhiqiang Liu, Rui Song, Duanmu Chuangqi, Jiaojiao Li, David Ferstl, MagicLeap

State Key Laboratory of ISN, Xidian University MagicLeap

6D位姿估计物体位姿

这篇论文针对现有6D位姿方法默认物体刚性、难以应对纸盒瓶罐等日用品磨损变形的问题,提出DeSOPE数据集:为26类物体采集规范形态与三档变形的高精度扫描并配准,同时提供13.3万RGB-D帧和66.5万位姿标注。实验显示,主流方法随变形加剧性能明显下降,说明变形是当前位姿估计管线的关键短板。

LSGS-Loc: Towards Robust 3DGS-Based Visual Localization for Large-Scale UAV Scenarios Figure 1
arXiv preprint2026-04-07

LSGS-Loc: Towards Robust 3DGS-Based Visual Localization for Large-Scale UAV Scenarios

Xiang Zhang, Tengfei Wang, Fang Xu, Xin Wang, Zongqian Zhan

6D位姿估计相机位姿三维重建高斯泼溅航天器

面向大尺度无人机场景,现有 3DGS 视觉定位常受初始位姿不稳和重建伪影干扰,导致光度优化易失效。LSGS-Loc 将场景无关相对位姿估计与 3DGS 显式尺度约束结合,获得无需场景训练的尺度感知初始化,并用 Laplacian 可靠性掩码避开模糊与漂浮物区域进行细化。在大尺度 UAV 基准上,其对无序查询图像的精度和鲁棒性超过已有 3DGS 定位方法。

A Muon-Accelerated Algorithm for Low Separation Rank Tensor Generalized Linear Models Figure 1
arXiv preprint2026-04-06

A Muon-Accelerated Algorithm for Low Separation Rank Tensor Generalized Linear Models

Xiao Liang, Shuang Li

6D位姿估计

针对张量影像/信号在GLM中直接向量化会破坏多维结构、且LSR-TGLM现有LSRTR反复QR正交投影开销大的问题,本文提出LSRTR-M,在原块坐标框架中用Muon的Newton-Schulz正交化动量更新替代因子矩阵投影。合成线性、逻辑、泊松任务及Vessel MNIST 3D上,方法减少迭代与训练时间,并降低估计/预测误差或保持有竞争力分类表现。

Pickalo: Leveraging 6D Pose Estimation for Low-Cost Industrial Bin Picking Figure 1
arXiv preprint2026-04-06

Pickalo: Leveraging 6D Pose Estimation for Low-Cost Industrial Bin Picking

Alessandro Tarsi ^{ }, Matteo Mastrogiuseppe ^{ }, Saverio Taliani ^{ }, Simone Cortinovis ^{ }, Ugo Pattacini ^{ }

6D位姿估计机器人操作

面向真实工业料箱中遮挡、堆叠严重且高端3D传感成本高的问题,Pickalo将低价腕部RGB-D、多视角主动观测、BridgeDepth深度增强、SAM-6D零样本位姿估计与Pose Buffer时序融合结合,用6D位姿驱动离线抓取库和在线碰撞筛选。在UR5e与RealSense D435i上,密集欧标箱30分钟运行可达约600次/小时,抓取成功率96–99%,消融显示深度增强和位姿缓存对稳定性与吞吐有明显贡献。

WaterSplat-SLAM: Photorealistic Monocular SLAM in Underwater Environment Figure 1
arXiv preprint2026-04-06

WaterSplat-SLAM: Photorealistic Monocular SLAM in Underwater Environment

Kangxu Wang, Shaofeng Zou, Chenxing Jiang, Yixiang Dai, Siang Chen, Shaojie Shen, Guijin Wang

Shaofeng Zou is with Key Laboratory of Marine Robotics, Shenyang 110169, China, University of Chinese Academy of Sciences, Beijing 101408, China

6D位姿估计相机位姿

针对水下单目 SLAM 易受浑浊、散射和低纹理影响,且传统稀疏/多传感器地图难以逼真渲染的问题,WaterSplat-SLAM 将语义水体过滤用于跟踪与深度初始化,并用介质感知 3D Gaussian 与语义引导渲染分离物体和水体,同时通过回环后的高斯调整与合并控冗余。多数据集实验显示其在相机轨迹稳定性、PSNR/SSIM/LPIPS 渲染质量和内存占用上优于多种 NeRF/3DGS SLAM 基线。

Relational Epipolar Graphs for Robust Relative Camera Pose Estimation Figure 1
arXiv preprint2026-04-06

Relational Epipolar Graphs for Robust Relative Camera Pose Estimation

Prateeth Rao, Sachit Rao

International Institute of Information Technology Bangalore

6D位姿估计相机位姿

针对相对相机位姿估计中密集匹配噪声和 RANSAC 式随机采样不稳定的问题,本文将 LoFTR 匹配构造成极线关系图,用空间邻接与 Sampson 误差剪枝,并通过 GNN 消息传递联合回归旋转、平移和本质矩阵。实验称在室内外、大基线与噪声对应场景下较传统共识和学习式基线更稳健,但具体增益与图结构、损失设计的贡献拆分仍需进一步确认。

Efficient Onboard Spacecraft Pose Estimation with Event Cameras and Neuromorphic Hardware Figure 1
arXiv preprint2026-04-05

Efficient Onboard Spacecraft Pose Estimation with Event Cameras and Neuromorphic Hardware

Arunkumar Rathinam, Jules Lecomte, Jost Reelsen, Gregor Lenz, Jules Lecomte Fortiss GmbH Munich, Germany juleslcmt@gmail.com, Germany jost.reelsen@tum.de, Gregor Lenz Paddington Robotics London, United Kingdom lenz.gregor@gmail.com, Axel von Arnim Fortiss GmbH Munich, Germany vonarnim@fortiss.org

University of Luxembourg, Esch-sur-Alzette, Luxembourg, Department of Natural Sciences, Technical University of Munich, Munich, Germany, Paddington Robotics, London, United Kingdom, University of Luxembourg, Technical University of Munich, Paddington Robotics

6D位姿估计事件相机航天器

面向在轨交会/近距离操作中强光照、运动模糊与星载算力受限导致的6D位姿估计难题,论文将事件相机的轻量事件帧表示与Akida神经形态硬件结合,用量化感知训练的MobileNet式关键点网络加PnP求解姿态,并比较多种事件表示。结果显示Akida V1可实现实时低功耗推理,但直接坐标回归受量化噪声影响明显;面向Akida V2的热图模型在云端评测中精度更稳,提示热图式空间分类更适合低精度部署。

Learning 3D Reconstruction with Priors in Test Time Figure 1
arXiv preprint2026-04-04

Learning 3D Reconstruction with Priors in Test Time

Lei Zhou, Haoyu Wu, Akshat Dave

Lei Zhou Haoyu Wu Akshat Dave Dimitris Samaras, Stony Brook University

6D位姿估计三维重建

针对现有多视角 Transformer 只能吃 RGB、而相机位姿/内参/深度等先验在真实系统中常可获得但重训代价高的问题,本文提出测试时约束优化 TCO:不改网络结构,把先验转成输出惩罚项,并结合跨视角光度/几何一致性损失,仅用 LoRA 微调共享解码器。实验在 ETH3D、7-Scenes、NRGBD 等任务上显著降低点图误差,较图像-only 基线误差减半以上,并优于需重训的先验感知前馈方法。

InCaRPose: In-Cabin Relative Camera Pose Estimation Model and Dataset Figure 1
arXiv preprint2026-04-04

InCaRPose: In-Cabin Relative Camera Pose Estimation Model and Dataset

Felix Stillger, Lukas Hahn, Frederik Hasecke, <lastname>@uni-wuppertal.de Aptiv, <firstname>.<lastname>@aptiv.de

6D位姿估计相机位姿数据集/基准

针对车舱监控中鱼眼畸变强、后视镜/相机外参易变化且需毫秒级安全感知的问题,InCaRPose将标定表述为参考图像到目标图像的相对位姿回归,利用冻结DINO系ViT特征、Transformer解码器和轻量预测头,直接在畸变图上输出米制平移。模型仅用6500组合成图像训练即可迁移到真实车舱与未见相机,在7-Scenes上也具竞争力,并报告消费级GPU超过70 FPS。

CT-VoxelMap: Efficient Continuous-Time LiDAR-Inertial Odometry with Probabilistic Adaptive Voxel Mapping Figure 1
arXiv preprint2026-04-04

CT-VoxelMap: Efficient Continuous-Time LiDAR-Inertial Odometry with Probabilistic Adaptive Voxel Mapping

Lei Zhao, Xingyi Li, Tianchen Deng, Chuan Cao, Han Zhang, Weidong Chen

6D位姿估计相机位姿点云

面向快速运动、颠簸地形下离散时间 LiDAR-IMU 里程计难以处理异步密集测量和点云畸变的问题,CT-VoxelMap 将连续时间三次 B 样条的控制点增量作为李群状态估计变量,简化解析雅可比,并用 IMU 在线估计样条拟合误差,结合平面/体素混合特征地图与重估策略提升效率。多组公开数据集实验显示其在多数序列上精度优于对比方法,消融验证各模块有效。

Motion-Adaptive Multi-Scale Temporal Modelling with Skeleton-Constrained Spatial Graphs for Efficient 3D Human Pose Estimation Figure 1
arXiv preprint2026-04-04

Motion-Adaptive Multi-Scale Temporal Modelling with Skeleton-Constrained Spatial Graphs for Efficient 3D Human Pose Estimation

Ruochen Li, Shuang Chen, Wenke E, Farshad Arvin, Amir Atapour-Abarghouei

6D位姿估计人体姿态

这篇论文针对单目视频3D人体姿态估计中全局注意力计算开销高、固定时序尺度难适应不同动作的问题,提出MASC-Pose:用AMTM以多尺度时序分支和可学习融合建模短期/长期运动,用SAGCN在骨架约束下自适应聚合关节邻域特征。Human3.6M与MPI-INF-3DHP实验显示其在保持较高效率的同时取得有竞争力的精度。

OMNI-PoseX: A Fast Vision Model for 6D Object Pose Estimation in Embodied Tasks Figure 1
arXiv preprint2026-04-03

OMNI-PoseX: A Fast Vision Model for 6D Object Pose Estimation in Embodied Tasks

Michael Zhang, Wei Ying, Fangwen Chen, Shifeng Bai, Hanwen Kang

6D位姿估计物体位姿

面向开放世界具身操作中未见物体、遮挡和实时性带来的6D位姿估计难题,OMNI-PoseX将开放词汇感知与SO(3)感知的反射流匹配姿态预测解耦结合,用李代数中的测地速度场替代欧式直接回归,并以轻量多模态融合注入语义与几何线索。实验显示其在基准、零样本仿真场景和抓取系统中优于GenPose++等方法且推理步数少,但部分收益可能也来自大规模真实/合成数据训练。

No Figure
arXiv preprint2026-04-02

ROS 2-Based LiDAR Perception Framework for Mobile Robots in Dynamic Production Environments, Utilizing Synthetic Data Generation, Transformation-Equivariant 3D Detection and Multi-Object Tracking

Lukas Bergs, Tan Chung, Marmik Thakkar, Alexander Moriz, Amon Göppert, Chinnawut Nantabut, Robert Schmitt

Fraunhofer Institute for Production Technology (IPT), Steinbachstr. 17, Aachen 52074, Germany, Robert Schmitt

6D位姿估计物体位姿点云机器人操作仿真到现实

面向动态产线中移动操作机器人对可靠6D位姿与连续跟踪的需求,论文将ROS 2、Isaac Sim合成LiDAR数据训练的变换等变3D检测器TED,以及基于中心位姿的AB3DMOT式多目标跟踪整合为感知框架,以减少真实标注依赖并提升时空一致性。72个动捕验证场景中,单帧位姿IoU为62.6%,加入跟踪后升至83.12%,HOTA达到91.12%。

HyVGGT-VO: Tightly Coupled Hybrid Dense Visual Odometry with Feed-Forward Models Figure 1
arXiv preprint2026-04-02

HyVGGT-VO: Tightly Coupled Hybrid Dense Visual Odometry with Feed-Forward Models

Junxiang Pang, Lipu Zhou, Baojie Chen

6D位姿估计相机位姿

HyVGGT-VO针对VGGT类前馈稠密建图在长序列中只能关键帧低频输出、计算重且易尺度漂移的问题,将传统稀疏VO与VGGT紧耦合:前端在光流跟踪和VGGT tracking head间自适应切换,并用不确定性加权;后端通过轨迹级Sim(3)尺度对齐和分层BA/PGO联合优化位姿与VGGT尺度。在EuRoC和KITTI上,相比既有VGGT方法约快5倍,ATE分别降低85%和12%。

Unifying UAV Cross-View Geo-Localization via 3D Geometric Perception Figure 1
arXiv preprint2026-04-02

Unifying UAV Cross-View Geo-Localization via 3D Geometric Perception

Haoyuan Li, Wen Yang, Fang Xu, Hong Tan, Haijian Zhang, Shengyang Li, Gui-Song Xia

6D位姿估计航天器

针对GNSS受限下无人机斜视图与卫星正射图几何差异导致的检索与位姿估计割裂问题,论文将VGGT重建的局部3D场景渲染为对齐卫星图的BEV,并用候选卫星独立注意力避免多假设干扰,从而在统一流程中完成检索、对齐和3-DoF回归。在重标定University-1652与SUES-200上优于现有方法,达到米级定位并表现出更好泛化。

Hi-LOAM: Hierarchical Implicit Neural Fields for LiDAR Odometry and Mapping Figure 1
arXiv preprint2026-04-02

Hi-LOAM: Hierarchical Implicit Neural Fields for LiDAR Odometry and Mapping

Zhiliu Yang, Jianyuan Zhang, Lianhui Zhao, Jinyu Dai, Zhu Yang

6D位姿估计相机位姿点云

Hi-LOAM针对现有激光里程计依赖监督信号或大场景重建细节不足的问题,将八叉树多层哈希表中的层级隐特征解码为SDF,并用无对应的scan-to-implicit子图匹配联合估计6D位姿与建图。其自监督流程无需预训练,在多个真实与合成数据集上显示出优于现有学习式方法、接近或优于强ICP系基线的定位与重建表现。

Nonlinear Methods for Analyzing Pose in Behavioral Research Figure 1
arXiv preprint2026-04-01

Nonlinear Methods for Analyzing Pose in Behavioral Research

Margaret C. Macpherson, Gaurav Patil, Kelly Miles, Rachel W. Kallen, Sebastian Wallot, Michael J. Richardson

6D位姿估计

针对无标记姿态估计带来的高维、噪声和非平稳时序难题,本文并非提出新的6D位姿估计算法,而是给出面向行为研究的通用分析流程:结合预处理、降维、线性运动学指标与递归量化分析(RQA)来刻画运动动态。三个案例覆盖面部/全身、2D/3D、单人与多人互动,显示该流程可在不同数据形态下提取协调、稳定性和时间结构等行为信息,但定量增益与对比基线文中未充分说明。

Better Rigs, Not Bigger Networks: A Body Model Ablation for Gaussian Avatars Figure 1
arXiv preprint2026-04-03

Better Rigs, Not Bigger Networks: A Body Model Ablation for Gaussian Avatars

Derek Austin dcaustin33@gmai1.com

6D位姿估计高斯泼溅

针对高斯人体头像重建不断堆叠形变网络却仍依赖 SMPL 的问题,论文指出瓶颈可能在上游身体模型而非网络规模:用 SAM-3D-Body 估计的 MHR 替换 SMPL,并将高斯直接绑定到三角面、去除形变 MLP 等模块。通过 MHR/SMPL-X 与姿态转换消融,作者区分了网格表达力和姿态质量的贡献;在 PeopleSnapshot 与 ZJU-MoCap 上取得最高 PSNR,SSIM、LPIPS 也具竞争力。

Human Pose Estimation in Trampoline Gymnastics: Improving Performance Using a New Synthetic Dataset Figure 1
arXiv preprint2026-04-01

Human Pose Estimation in Trampoline Gymnastics: Improving Performance Using a New Synthetic Dataset

Léa Drolet-Roy, Victor Nogues, Sylvain Gaudet, Eve Charbonneau, Mickaël Begon, Lama Séoud

6D位姿估计人体姿态仿真到现实数据集/基准

本文针对蹦床体操中倒置、团身/屈体等极端姿态和非常规视角导致通用人体姿态估计失效的问题,提出从带噪动捕拟合 SMPL,再生成多视角合成蹦床姿态数据 STP 来微调 ViTPose 的流程。实验显示,合成极端动作数据能提升真实蹦床图像的 2D 关键点精度,并进一步改善多视角三角化 3D 重建;最佳模型相较预训练 ViTPose 将 MPJPE 降低 12.5 mm,约提升 19.6%。

PanoAir: A Panoramic Visual-Inertial SLAM with Cross-Time Real-World UAV Dataset Figure 1
arXiv preprint2026-04-01

PanoAir: A Panoramic Visual-Inertial SLAM with Cross-Time Real-World UAV Dataset

Yiyang Wu, Xiaohu Zhang, Yanjin Du, Tongsu Zhang, Chujun Li, Siyang Chen, Guoyi Zhang, Xiangpeng Xu

6D位姿估计相机位姿数据集/基准航天器

针对传统窄视场 VI-SLAM 在无人机快速运动、弱纹理和光照变化下易漂移甚至失效,PanoAir构建了真实全景视觉-惯性 UAV 数据集,并在ERP全景图上设计特征提取与回环闭合以增强约束和全局一致性。实验显示其在自建与公开基准上较现有方法更准确稳健,且可在Jetson Orin NX上以接近PC的效率运行。

MoonAnything: A Vision Benchmark with Large-Scale Lunar Supervised Data Figure 1
arXiv preprint2026-04-01

MoonAnything: A Vision Benchmark with Large-Scale Lunar Supervised Data

Clémentine Grethen, Yuang Shi, Simone Gasparini, Géraldine Morin

National University of Singapore Singapore, Clémentine Grethen

6D位姿估计数据集/基准

针对月面低纹理、强阴影导致通用视觉模型难以用于导航、三维重建和位姿估计的问题,MoonAnything基于真实月形地形与物理渲染构建统一基准:LunarGeo提供双目、深度和标定,LunarPhoto提供SVBRDF与多光照真实太阳配置渲染。数据规模超过13万样本,并用SOTA方法建立基线,主要贡献可能主要来自大规模几何/光度监督数据。

Generating Key Postures of Bharatanatyam Adavus with Pose Estimation Figure 1
arXiv preprint2026-03-31

Generating Key Postures of Bharatanatyam Adavus with Pose Estimation

Jagadish Kashinath Kamble, Jayanta Mukhopadhyay, Debaditya Roy, Partha Pratim Das

Indian Institute of Technology, Ashoka University

6D位姿估计

本文面向婆罗多舞 Adavu 关键姿态的数字化保存与教学,关注传统舞蹈中严格的几何对齐、肢体协调和文化符号难以由通用生成模型保持的问题。方法在 cGAN 与条件扩散中加入基于 MediaPipe 的姿态估计监督,用关键点损失和姿态一致性约束生成结果。实验比较四种配置,显示加入姿态监督后姿态结构、真实感与风格忠实度均有提升,但具体量化增益与数据规模影响文中仍需进一步说明。

Interacting Multiple Model Proprioceptive Odometry for Legged Robots Figure 1
arXiv preprint2026-03-31

Interacting Multiple Model Proprioceptive Odometry for Legged Robots

Wanlei Li, Zichang Chen, Shilei Li, Xiaogang Xiong, Yunjiang Lou

6D位姿估计相机位姿机器人操作

针对腿式机器人在视觉、激光等外感知退化时只能依赖本体里程计、而传统静态点接触假设在打滑和复杂地形下失效的问题,论文将足地接触建模为多假设估计,并用 IMM 滤波在线切换与融合接触模式,同时把足端速度纳入状态以感知滚动/滑移影响。仿真和实机结果显示,该方法在保持相近计算开销下,相比现有本体估计方法获得更高位姿精度和更强鲁棒性。

Hierarchical Visual Relocalization with Nearest View Synthesis from Feature Gaussian Splatting Figure 1
arXiv preprint2026-03-31

Hierarchical Visual Relocalization with Nearest View Synthesis from Feature Gaussian Splatting

Huaqi Tao, Bingxi Liu, Guangcheng Chen, Fulin Tang, Li He, Technology, Shenzhen, Chinese Academy of Sciences, Beijing, China. taohq2024@mail.sustech.edu.cn

Southern University of Science and Technology, Shenzhen, China, Institute of Automation, Chinese Academy of Sciences, Beijing, China

6D位姿估计相机位姿三维重建高斯泼溅

针对层次化视觉重定位依赖稀疏数据库视角、匹配易失效的问题,SplatHLoc以特征高斯泼溅表示场景,在初始检索位姿附近自适应合成更接近查询的虚拟视角,并利用“渲染特征适合粗匹配、图像特征适合细匹配”的洞察设计混合匹配与迭代细化。室内外基准实验显示其提升了初始位姿与整体重定位鲁棒性,并达到新的SOTA。

Event6D: Event-based Novel Object 6D Pose Tracking Figure 1
arXiv preprint2026-03-30

Event6D: Event-based Novel Object 6D Pose Tracking

Jae-Young Kang, Hoonhee Cho : 1, Taeyeop Lee : 1 Minjun Kang, Bowen Wen, Youngho Kim, Kuk-Jin Yoon KAIST, NVIDIA

KAIST, NVIDIA

6D位姿估计物体位姿未知物体事件相机

针对传统 RGB-D 6D 位姿跟踪在高速运动中受运动模糊、低帧率和大位移影响的问题,Event6D 提出 EventTrack6D:利用事件流并以上一帧深度为条件,在深度帧间任意时刻重建强度与深度,再与 CAD 渲染进行 render-and-compare 跟踪。方法无需物体专属训练,可达 120 FPS 以上;仅用合成数据训练后在真实与模拟事件数据上仍能跟踪未知物体。

FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generation Figure 1
arXiv preprint2026-03-30

FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generation

Liuzhou Zhang 1, Zeyu Zhang 2∗, Biao Wu 3, Luyao Tang 4

6D位姿估计

面向实时文本到手语视频生成,论文针对传统“文本到姿态再到视频”流程易累积姿态误差且扩散模型推理昂贵的问题,提出不依赖显式姿态的端到端扩散框架,并利用可训练滑动块注意力在训练和推理中保持一致稀疏计算,聚焦手部等有效运动区域。实验称在不降低视频质量的情况下生成速度提升 3.07×,但具体增益与数据、骨干模型的贡献占比仍需进一步核查。

Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimation Figure 1
arXiv preprint2026-03-29

Demo-Pose: Depth-Monocular Modality Fusion For Object Pose Estimation

Rachit Agarwal, Abhishek Joshi, Sathish Chalasani, Woo Jin Kim

6D位姿估计物体位姿彩色深度

DeMo-Pose针对类别级9DoF物体位姿估计中深度方法缺少RGB语义、既有RGB-D融合对齐不足的问题,将单目检测器提取的语义特征与基于3D图卷积的深度点云表示融合,并用训练期Mesh-Point Loss增强几何约束且不增加推理开销。在REAL275上相较GPV-Pose提升3D IoU 3.2%、姿态精度11.1%,约18 FPS。

Mind the Shape Gap: A Benchmark and Baseline for Deformation-Aware 6D Pose Estimation of Agricultural Produce Figure 1
arXiv preprint2026-03-28

Mind the Shape Gap: A Benchmark and Baseline for Deformation-Aware 6D Pose Estimation of Agricultural Produce

N. Chatzis, A. Tsinouka, K. Papadimitriou, N. Efthymiou, M. Glytsos, G. Retsinas, P. Oikonomou, G. Potamianos, P. Maragos, P. P. Filntisis

K. Papadimitriou 1,2,5, Robotics Institute, Athena Research Center, Marousi, Greece, HERON - Hellenic Robotics Center of Excellence, Athens, Greece, School of Electrical & Computer Engineering, NTUA, Greece, Music Technology, New York University, USA, Department of

6D位姿估计数据集/基准

面向采摘场景中果蔬形变和类内几何差异导致的6D位姿失准,论文提出PEAR基准,提供8类农产品的实例级位姿与3D形变标注,并据此揭示固定模板/缺真实几何会使现有方法最高退化约6倍;同时给出RGB-only的SEED,联合估计位姿与显式格点形变,纯合成训练下在8类中6类优于MegaPose。

Human-Centric Perception for Child Sexual Abuse Imagery Figure 1
arXiv preprint2026-03-28

Human-Centric Perception for Child Sexual Abuse Imagery

Camila Laranjeira, João Macedo, Sandra Avila, Fabrício Benevenuto, Jefersson A. dos Santos

6D位姿估计

面向执法机构处理海量儿童性虐待图像时对可解释自动化线索的需求,论文不直接做黑箱“色情”分类,而是转向人体中心感知子任务。作者构建含骨架关键点与头、胸、髋、手等部位框的 BKPD,并提出后处理关联的 BKP-Association 与端到端 YOLO-BKP。实验在 COCO、BKPD 上取得有竞争力的联合检测/姿态结果,跨域消融和 RCPD 案例显示显性内容域仍带来明显泛化挑战。

Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation Figure 1
arXiv preprint2026-03-28

Autonomous overtaking trajectory optimization using reinforcement learning and opponent pose estimation

Matej Rene Cihlar, Luka Šiktar, Branimir Ćaran, Marko Švaco

University of Zagreb

6D位姿估计

面向多车自动竞速中超车既要安全又要高效、且不能把对手简单视作静态障碍的问题,本文将PPO强化学习超车策略与对手位姿估计闭环结合:用2D LiDAR聚类/矩形拟合和深度相机YOLO检测,经UKF融合得到相对位置,再驱动转角与速度决策。系统在仿真和F1TENTH实车中完成超车,位姿估计RMSE为x/y方向0.0816/0.0531 m,但真实场景仍受传感器更新率、噪声和轨迹振荡限制。

K $α$ LOS finds Consensus: A Meta-Algorithm for Evaluating Inter-Annotator Agreement in Complex Vision Tasks Figure 1
arXiv preprint2026-03-28

K $α$ LOS finds Consensus: A Meta-Algorithm for Evaluating Inter-Annotator Agreement in Complex Vision Tasks

David Tschirschwitz, Volker Rodehorst Bauhaus-Universität Weimar, Germany david.tschirschwitz@uni-weimar.de

6D位姿估计

本文针对视觉/6D位姿等任务中评测受标注噪声限制、传统一致性指标难处理实例对应的问题,提出 KαLOS:先用数据驱动的空间匹配校准定位参数,再将标注转成 Krippendorff α 可用的名义可靠性矩阵,并支持标注者活性、聚类和敏感性诊断。作者用基于真实多标注分布的合成噪声生成器验证其单调性、敏感性和满量程利用,显示可更稳健地区分模型信号与标签噪声。

MultiLoc: Multi-view Guided Relative Pose Regression for Fast and Robust Visual Re-Localization Figure 1
arXiv preprint2026-03-28

MultiLoc: Multi-view Guided Relative Pose Regression for Fast and Robust Visual Re-Localization

Nobel Dang, Bing Li

Clemson University

6D位姿估计相机位姿多视角

MultiLoc针对传统相对位姿回归只依赖成对局部视图、缺乏全局几何约束而导致重定位精度受限的问题,将多个参考图像及其相机位姿在一次前向中融合,把查询图像锚定到局部3D子场景,并用共视性检索替代单纯VPR选参考。实验显示其在WaySpots、Cambridge、Indoor6等重定位任务及MegaDepth、ScanNet、ACID相对位姿估计上超过现有RPR和部分匹配/非回归方法,同时保持实时零样本效率。

Image-based Quantification of Postural Deviations on Patients with Cervical Dystonia: A Machine Learning Approach Using Synthetic Training Data Figure 1
arXiv preprint2026-03-27

Image-based Quantification of Postural Deviations on Patients with Cervical Dystonia: A Machine Learning Approach Using Synthetic Training Data

Roland Stenger, Sebastian Löns, Nele Brügge, Feline Hamami, Alexander Münchau, Theresa Paulus, Anne Weissbach, Gesine M. Sallandt, Tatiana Usnich, Max Borsche, Martje G. Pauly, Lara M. Lange, Markus A. Hobert, Rebecca Herzog, Ana Luísa de Almeida Marcelino, Tina Mainka, Friederike Schumann, Lukas L. Goede, Johanna Reimer, Kirsten E. Zeuner, Julienne Haas, Jos Becktepe, Alexander Baumann, Robin Wolke, Chi Wang Ip, Thorsten Odorfer, Daniel Zeller, Lisa Harder-Rauschenberger, John-Ih Lee, Philipp Albrecht

Department of Neurology, University Medical Center Schleswig-Holstein, Campus Lübeck, Lübeck, Germany, Department of Neurology, University Medical Center Schleswig-Holstein, Campus Kiel, Kiel, Germany, Department of Neurology, Park-Klinik Weißensee, Berlin, Germany, Department of Neurology, Maria Hilf Clinics, Mönchengladbach, Germany, Department of Neurology, TUM Klinikum Rechts der Isar, Munich, Germany, Lisa Harder-Rauschenberger

6D位姿估计仿真到现实医学/手术

针对颈部肌张力障碍评估依赖 TWSTRS 人工量表、主观性强且稀有平移症状样本不足的问题,论文将预训练 6D 头姿估计用于旋转偏差,并用 1.6 万张合成头像训练侧向位移回归模型。多中心验证显示旋转项与专家共识高度相关(r=0.78–0.91),侧移在真实患者上中等相关(r=0.55),在受控合成基准中优于人工评分。

Shared Representation for 3D Pose Estimation, Action Classification, and Progress Prediction from Tactile Signals Figure 1
arXiv preprint2026-03-26

Shared Representation for 3D Pose Estimation, Action Classification, and Progress Prediction from Tactile Signals

Isaac Han, Seoyoung Lee, Sangyeon Park, Ecehan Akan, Yiyue Luo, Joseph DelPreto, Technology (GIST, MIT CSAIL

Gwangju Institute of Science and Technology (GIST), University of Washington, MIT CSAIL

6D位姿估计

针对视觉在人机交互中易受遮挡且有隐私顾虑、而触觉方法又常将位姿/动作/进度割裂建模的问题,论文提出 SCOTTI,用卷积-Transformer 从无线鞋垫压力信号学习共享表示,同时预测 3D 人体位姿、动作类别和完成进度;并采集 15 人约 7 小时、8 类活动数据。实验显示多任务共享相较独立训练和既有方法在三项任务上均更优。

AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation Figure 1
arXiv preprint2026-03-26

AnyHand: A Large-Scale Synthetic Dataset for RGB(-D) Hand Pose Estimation

Chen Si, Yulin Liu, Bo Ai, Jianwen Xie, Rolandos Alexandros Potamias, Chuanxia Zheng, Hao Su

6D位姿估计手部姿态点云彩色深度仿真到现实

针对真实手部3D姿态数据覆盖不足、RGB-D标注稀缺且合成数据缺少遮挡/手臂/对齐深度的问题,AnyHand构建了大规模合成RGB-D手部数据,覆盖单手与手物交互,并加入轻量深度融合模块。实验显示,在不改HaMeR/WiLoR训练框架的情况下加入该数据可提升FreiHAND、HO-3D并增强HO-Cap零微调泛化,收益可能主要来自scaling/data与深度几何线索。

Training-free Detection and 6D Pose Estimation of Unseen Surgical Instruments Figure 1
International Journal of Computer Assisted Radiology and Surgery2026-03-26

Training-free Detection and 6D Pose Estimation of Unseen Surgical Instruments

Lilian Calvet, Matthias Seibold, Siyu Tang, Marc Pollefeys, Philipp Fürnstahl

ETH Zurich, University Hospital of Zurich, University of Zurich

6D位姿估计医学/手术

针对监督式手术器械6D位姿方法依赖大量标注、难以适配新器械的问题,本文提出仅需带纹理CAD模型的免训练多视角流程:用基础模型生成/匹配掩码与渲染模板,经跨视角三角化和几何一致性筛选,再结合跨视角特征评分与遮挡感知轮廓配准细化位姿。在MVPSP真实手术数据上,该方法在受控条件下达到毫米级精度,接近监督方法,同时保持对未见器械的泛化能力。

AG-EgoPose: Leveraging Action-Guided Motion and Kinematic Joint Encoding for Egocentric 3D Pose Estimation Figure 1
arXiv preprint2026-03-26

AG-EgoPose: Leveraging Action-Guided Motion and Kinematic Joint Encoding for Egocentric 3D Pose Estimation

Md Mushfiqur Azam, John Quarles, Kevin Desai

The University of Texas at San Antonio

6D位姿估计人体姿态

针对第一视角鱼眼视频中视角畸变、自遮挡和身体出画导致的3D人体姿态歧义,AG-EgoPose不再只依赖单帧或浅层时序融合,而是将2D关节热图形成的关节级空间token与ActionFormer提取的长短期动作运动线索结合,并用带可学习关节token的Transformer解码器按关节融合时空证据。在EgoPW和SceneEgo等真实数据集上,文中报告其定量和定性结果达到SOTA。

EgoXtreme: A Dataset for Robust Object Pose Estimation in Egocentric Views under Extreme Conditions Figure 1
arXiv preprint2026-03-26

EgoXtreme: A Dataset for Robust Object Pose Estimation in Egocentric Views under Extreme Conditions

Taegyoon Yoon, Yegyu Han, Seojin Ji, Jaewoo Park Sojeong Kim, Taein Kwon, VGG

Seoul National University VGG, University of Oxford

6D位姿估计物体位姿数据集/基准

面向智能眼镜等第一视角应用,论文指出现有6D位姿基准多来自稳定第三视角,难以反映低光、强运动模糊、烟雾遮挡和近距离截断。作者构建EgoXtreme,在工业维护、运动和应急救援中采集15名参与者约775.5分钟视频,用于评测极端条件下的物体位姿鲁棒性。实验显示现有泛化式位姿估计器在该数据上明显失效,低光尤甚;单纯去模糊、去雾或低光增强帮助有限,而引入时序跟踪在快速运动场景更有价值。

OpenCap Monocular: 3D Human Kinematics and Musculoskeletal Dynamics from a Single Smartphone Video Figure 1
arXiv preprint2026-03-25

OpenCap Monocular: 3D Human Kinematics and Musculoskeletal Dynamics from a Single Smartphone Video

Selim Gilon, Emily Y. Miller, Scott D. Uhlrich

Department of Mechanical Engineering, University of Utah, Salt Lake City, Department of Orthopaedic Surgery, University of Utah, Salt Lake City

6D位姿估计人体姿态

针对传统人体运动/肌骨动力学评估依赖昂贵实验室、难以临床和居家规模化的问题,OpenCap Monocular用单个静止手机视频,将WHAM单目3D姿态经物理约束优化映射到生物力学骨架,并结合仿真与机器学习估计力学量。其相对CV+IK将旋转和平移误差降48%/69%,达到4.8°和3.4 cm MAE,步态地反力接近或优于双机OpenCap,并在膝力矩等临床指标上达到有意义精度。

Object Pose Transformer: Unifying Unseen Object Pose Estimation Figure 1
arXiv preprint2026-03-24

Object Pose Transformer: Unifying Unseen Object Pose Estimation

Munich Center for Machine Learning, Toyota Motor Europe

Technical University of Munich Munich Center for Machine Learning Toyota Motor Europe

6D位姿估计物体位姿未知物体

针对未知物体6D位姿中“类别级绝对位姿依赖预设类别、相对位姿又难以给出单视角绝对姿态”的割裂问题,OPT-Pose用一个前馈Transformer联合预测深度、点图、相机参数与NOCS,并以对比学习的物体潜表示实现无类别标签规范化,同时用多视角几何一致性辅助消除歧义。实验在NOCS、HouseCat6D、Omni6DPose和Toyota-Light上同时刷新绝对与相对位姿性能。

PinPoint: Monocular Needle Pose Estimation for Robotic Suturing via Stein Variational Newton and Geometric Residuals Figure 1
arXiv preprint2026-03-24

PinPoint: Monocular Needle Pose Estimation for Robotic Suturing via Stein Variational Newton and Geometric Residuals

Jesse F. d’Almeida, Tanner Watts, Susheela Sharma Stern, James Ferguson, Alan Kuntz, Robert J. Webster III

6D位姿估计机器人操作

面向单目内窥镜下自动缝合的针体6D位姿估计,论文指出深度缺失和弯针旋转对称会导致多模态后验,单点估计易过早选错。PinPoint将图像观测与机器人夹持约束写成解析几何残差,并用带Gauss-Newton预条件的Stein变分Newton粒子推断保留多假设。真实序列中相对粒子滤波将平移误差降至1.00 mm、旋转误差降至13.80°,遮挡缝合时仍保持约1.34 mm误差。

Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors Figure 1
arXiv preprint2026-03-26

Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors

Chuanqing Zhuang, Xin Lu, Zehui Deng, Zhengda Lu, Yiqun Wang, Junqi Diao, Jun Xiao School of Artificial Intelligence, Corresponding Author {zhuangchuanqing, @mails, luzhengda, xiaojun}@ucas.ac.cn yiqun.wang@cqu.edu.cn, diaojunqi19@mails.ucas.edu.cn

School of Artificial Intelligence, University of Chinese Academy of Sciences, Chongqing University Air Force Engineering University \dagger

6D位姿估计彩色深度三维重建高斯泼溅

针对360度视频高斯泼溅仍依赖耗时SfM、且全景球面投影会放大位姿优化不稳定的问题,PFGS360在无位姿输入下重建场景:用高斯内部深度先验建立球面一致的2D-3D对应来估计相机位姿,并通过深度内点感知的稠密化过滤单目深度噪声与高斯离群点。实验显示其在真实和合成360视频上,相比现有pose-free与pose-aware 3DGS,在新视角合成质量和位姿估计精度上均有明显提升。

MultiCam: On-the-fly Multi-Camera Pose Estimation Using Spatiotemporal Overlaps of Known Objects Figure 1
arXiv preprint2026-03-24

MultiCam: On-the-fly Multi-Camera Pose Estimation Using Spatiotemporal Overlaps of Known Objects

Shiyu Li0000-0002-0888-2496, Hannah Schieber0000-0002-5786-3283, Kristoffer Waldow0000-0002-5176-7530, Benjamin Busam 0000-0002-0620-5774, Julian Kreimeier0000-0001-6861-711X, and Daniel Roth, Member, IEEE 0000-0001-5175-1566

6D位姿估计相机位姿多视角

MultiCam 面向 AR/机器人多相机系统中视野受限、动态相机需反复标定且标记物不便使用的问题,利用场景中已知物体的时空视野重叠来在线估计相机位姿。其核心是将实时 6D 物体位姿估计写入时空场景图,并通过对象级 bundle adjustment 关联甚至非同时重叠的相机。论文还构建了含 HMD 与静态相机的多视角数据集,并在 YCB-V、T-LESS 及自建数据上报告相机位姿精度优于现有方法。

Instrument-Splatting++: Towards Controllable Surgical Instrument Digital Twin Using Gaussian Splatting Figure 1
arXiv preprint2026-03-25

Instrument-Splatting++: Towards Controllable Surgical Instrument Digital Twin Using Gaussian Splatting

Shuojue Yang, Zijian Wu, Chengjiaao Liao, Qian Li, Daiyun Shen, Chang Han Low, Septimiu E. Salcudean, Yueming Jin

6D位姿估计三维重建高斯泼溅医学/手术

面向手术机器人 Real2Sim 中真实内窥视频难以获得精确器械位姿、现有 3DGS 多只能回放而不可控的问题,本文用 CAD 分部几何预训练构建可运动的高斯器械资产,并结合语义渲染对比、合成训练的夹爪尖点网络和 RTL 交替修正位姿与纹理。实验在 EndoVis17/18、SAR-RARP 和自建数据上显示更好的外观、几何一致性与位姿恢复,并能通过未见姿态合成提升关键点检测。

WiFi2Cap: Semantic Action Captioning from Wi-Fi CSI via Limb-Level Semantic Alignment Figure 1
arXiv preprint2026-03-24

WiFi2Cap: Semantic Action Captioning from Wi-Fi CSI via Limb-Level Semantic Alignment

Tzu-Ti Wei, Chu-Yu Huang, Yu-Chee Tseng, Jen-Jee Chen

National Yang Ming Chiao Tung University

6D位姿估计

针对室内摄像头隐私受限、而 Wi-Fi CSI 以往多停留在姿态估计或动作分类的问题,WiFi2Cap尝试直接从CSI生成细粒度动作描述。其关键思路是用视频-文本教师模型把语义空间迁移给CSI学生,并加入镜像一致性损失缓解左右肢体混淆,再通过前缀调优语言模型生成文本。作者还构建CSI-RGB-句子同步数据集,实验显示在BLEU-4、METEOR、ROUGE-L、CIDEr、SPICE上均优于基线。

CAM3R: Camera-Agnostic Model for 3D Reconstruction Figure 1
arXiv preprint2026-03-23

CAM3R: Camera-Agnostic Model for 3D Reconstruction

Namitha Guruprasad, Abhay Yadav, Cheng Peng, Rama Chellappa

Namitha Guruprasad

6D位姿估计三维重建

CAM3R针对现有前馈三维重建模型过度依赖针孔相机、在鱼眼和全景等宽视场图像上几何退化的问题,显式解耦相机几何与场景几何:用Ray Module估计逐像素光线方向,用Cross-view Module预测径向距离、点图和相对位姿,并通过Ray-Aware Global Alignment融合多视图。实验显示其在针孔、鱼眼、全景数据上的位姿估计和重建均达到新的SOTA,尤其改善跨相机模型场景。

PAM: A Pose-Appearance-Motion Engine for Sim-to-Real HOI Video Generation Figure 1
arXiv preprint2026-03-25

PAM: A Pose-Appearance-Motion Engine for Sim-to-Real HOI Video Generation

Mingju Gao, Kaisen Yang, Huan-ang Gao, Bohan Li, Ao Ding, Wenyi Li, Yangcheng Yu, Jinkun Liu, Shaocong Xu, Yike Niu, Haohan Chi, Hao Chen, Hao Tang, Yu Zhang, Li Yi, BAAI

Peking University Tsinghua University BAAI SJTU, Eastern Institute of Technology University of Cambridge

6D位姿估计仿真到现实

PAM针对HOI生成中姿态、外观、运动割裂以及依赖真实首帧、完整姿态序列而难以仿真到现实的问题,提出仅用初始/目标姿态和物体几何驱动的三阶段引擎:先生成手部轨迹,再用深度、分割、关键点条件生成首帧与视频。在DexYCB上FVD降至29.13、MPJPE为19.37mm,OAKINK2上FVD由68.76降至46.31,合成视频还能让50%真实数据训练的手姿态模型接近100%真实数据基线。

Bayesian Active Object Recognition and 6D Pose Estimation from Multimodal Contact Sensing Figure 1
arXiv preprint2026-03-22

Bayesian Active Object Recognition and 6D Pose Estimation from Multimodal Contact Sensing

Haodong Zheng, Gabriele M. Caddeo, Andrei C. Jalba, Wijnand A. IJsselsteijn, Lorenzo Natale, Raymond H. Cuijpers

6D位姿估计

针对视觉在遮挡、光照差或杂乱场景下不可靠、单次触觉又过于局部的问题,本文将接触视为多模态证据,在贝叶斯粒子滤波中融合腕部力/力矩、GelSight局部几何和无接触自由空间约束,并用当前置信度主动选择可达触碰点。仿真和Franka Panda上11个YCB物体实验显示,该融合比仅用力/力矩更快、更稳定,平均约4次动作完成识别、6次完成位姿估计。

Geometrically Plausible Object Pose Refinement using Differentiable Simulation Figure 1
arXiv preprint2026-03-22

Geometrically Plausible Object Pose Refinement using Differentiable Simulation

Anil Zeybek, Rhys Newbury, Snehal Dikhale, Nawid Jamali, Soshi Iba, Akansel Cosgun

Monash University, Australia, Honda Research Institute, USA, Technical University of Munich, Germany

6D位姿估计物体位姿

面向灵巧手内操作中遮挡导致的6D位姿估计不可信问题,论文将物体位姿作为可微变量,联合可微物理、可微渲染与视觉—触觉信号,在传感器一致性和非穿透、接触等物理约束间动态选择梯度进行细化。仿真实验显示,相比ICP可显著降低手—物体交叠体积:初值较准时降73%,高不确定初值下降超过87%,同时平移和姿态误差也降低;但真实机器人迁移仍未验证。

PiLoT: Neural Pixel-to-3D Registration for UAV-based Ego and Target Geo-localization Figure 1
arXiv preprint2026-03-21

PiLoT: Neural Pixel-to-3D Registration for UAV-based Ego and Target Geo-localization

Xiaoya Cheng, Long Wang, Yan Liu, Xinyi Liu Hanlin Tan, Yu Liu, Maojun Zhang

National University of Defense Technology, Zhejiang University, Westlake University, Hangzhou Dianzi University

6D位姿估计航天器

PiLoT针对无人机在GNSS受限环境中依赖VIO/GNSS与激光测距、易漂移且硬件复杂的问题,将自定位与目标地理定位统一为视频像素到地理参考3D地图的配准。其关键在于双线程渲染/定位框架、带精确几何标注的大规模合成数据,以及结合随机搜索和梯度细化的JNGO优化器;实验显示其在公开与自采基准上优于现有方法,并可在Jetson Orin上超过25 FPS运行。

Current state of the multi-agent multi-view experimental and digital twin rendezvous (MMEDR-Autonomous) framework Figure 1
arXiv preprint2026-03-21

Current state of the multi-agent multi-view experimental and digital twin rendezvous (MMEDR-Autonomous) framework

Logan Banker, Michael Wozniak, Mohanad Alameer, Smriti Nandan Paul, David Meisinger, Grant Baer, Trevor Hunting, Ryan Dunham, Jay Kamdar

6D位姿估计多视角

面向近地目标增多带来的在轨服务、碎片清除与自主交会需求,论文提出 MMEDR-Autonomous 作为多智能体多视角交会的 GNC 集成框架,将轻量级单目 6D 位姿网络、强化学习制导、控制障碍函数安全约束与硬件在环试验台统一起来。主要结果仍偏阶段性:导航通过多尺度特征与真实感增强缓解域差,制导侧分析奖励、状态与超参对学习稳定性的影响,整体尚在走向多智能体闭环实验验证,实际任务级增益文中未充分说明。

Benchmarking Efficient & Effective Camera Pose Estimation Strategies for Novel View Synthesis Figure 1
arXiv preprint2026-03-20

Benchmarking Efficient & Effective Camera Pose Estimation Strategies for Novel View Synthesis

Jhacson Meza, Martin R. Oswald, Torsten Sattler

6D位姿估计相机位姿数据集/基准

面向 NeRF/3DGS 等新视角合成对高精度相机位姿和快速重建的双重需求,论文构建了评估 SfM 效率—效果权衡的基准,并比较少量局部特征、前馈位姿回归与经典 SfM 精修等策略。结果显示,经典 SfM 仅用约 512 个特征也可显著提速且保持较好精度,而以前馈模型初始化再用局部匹配和 BA 精修通常取得最佳折中,说明经典 SfM 在 Transformer 回归方法出现后仍很关键。

Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation Figure 1
arXiv preprint2026-03-20

Cov2Pose: Leveraging Spatial Covariance for Direct Manifold-aware 6-DoF Object Pose Estimation

Nassim Ali Ousalah, Peyman Rostami, Vincent Gaudillière Emmanuel Koumandakis, Anis Kacem, Enjie Ghorbel, Djamila Aouada CVI, Interdisciplinary Centre for Security, Reliability, Trust (SnT, CNRS, Inria, LORIA, F-54000 Nancy, France, ENSI, manos@infiniteorbits.io, vincent.gaudilliere@loria.fr

CVI 2 , Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, Cristal Laboratory, ENSI, University of Manouba

6D位姿估计物体位姿

针对RGB单图6D位姿中直接回归速度快但精度弱的问题,Cov2Pose认为全局池化丢失了与姿态相关的空间二阶统计。方法将骨干特征做协方差池化为SPD矩阵,并用BiMap等流形感知层压缩,再通过可微Cholesky编码连续回归6D旋转与平移。实验在LineMOD、Occ-LineMOD和YCB-Video等基准上优于既有直接回归方法,遮挡场景也显示二阶统计与连续表示的增益。

FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision Figure 1
arXiv preprint2026-03-20

FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision

Zekai Wu, Shuqi Fan, Mengyin Liu, Yuhua Luo, Xincheng Lin, Ming Yan, Junhao Wu, Xiuhong Lin, Yuexin Ma, Chenglu Wen, Lan Xu, Siqi Shen, Computing, Efficient Computing, Ministry of Education of China, School of Informatics, Medicine

Fujian Key Laboratory of Urban Intelligent Sensing and Computing, Xiamen University, Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, School of Informatics, Xiamen University, National Institute for Data Science in Health and Medicine, Xiamen University, ShanghaiTech University

6D位姿估计人体姿态事件相机

面向体育等高速动作中毫秒级时序判定缺少高频标注数据的问题,FlashCap用闪烁LED与事件相机低带宽采集1000Hz人体运动真值,并构建含事件、RGB、LiDAR、IMU的FlashMotion数据集;其ResPose将事件作为RGB姿态锚点的残差信号,在高时间分辨率HPE中较RGB插值降低约40% MPJPE,并实现毫秒级动作计时。

Morphology-Consistent Humanoid Interaction through Robot-Centric Video Synthesis Figure 1
arXiv preprint2026-03-20

Morphology-Consistent Humanoid Interaction through Robot-Centric Video Synthesis

Weisheng Xu, Jian Li, Yi Gu, Bin Yang, Haodong Chen, Shuyi Lin, Mingqian Zhou, Jing Tan, Qiwei Wu, Xiangrui Jiang, Taowen Wang, Jiawen Wen, Qiwei Liang, Jiaxi Zhang, Renjing Xu, Shenzhen

Hong Kong University of Science and Technology (Guangzhou), Harbin Institute of Technology, Shenzhen Shenzhen University University of Cambridge

6D位姿估计机器人操作

针对人形机器人从人类视频或动作重定向中容易因形态差异产生接触错位、且任务策略训练成本高的问题,Dream2Act改为直接让视频生成模型合成“机器人自身”完成任务的第三视角视频,再经机器人原生2D/3D姿态恢复、URDF约束IK和全身控制执行。在Unitree G1的踢球、坐沙发、击打沙袋、抱箱等实验中,总成功率达37.5%,而传统重定向为0%,但系统仍是离线零样本规划,实时闭环能力文中未充分说明。

IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v1 Figure 1
arXiv preprint2026-03-20

IUP-Pose: Decoupled Iterative Uncertainty Propagation for Real-time Relative Pose Regression via Implicit Dense Alignment v1

Jun Wang, Xiaoyan Huang

6D位姿估计相机位姿

针对传统匹配+RANSAC难端到端、ViT式相对位姿回归又过重的问题,IUP-Pose将旋转与平移解耦,先用轻量双向交叉注意力做隐式密集对齐,再通过旋转单应性和不确定性在两次旋转、一次平移阶段间传播特征与位姿。MegaDepth1500上AUC@20°达73.3%,仅37M参数、70 FPS;但室内大视角变化下仍有退化。

UniPR: Unified Object-level Real-to-Sim Perception and Reconstruction from a Single Stereo Pair Figure 1
arXiv preprint2026-03-20

UniPR: Unified Object-level Real-to-Sim Perception and Reconstruction from a Single Stereo Pair

Chuanrui Zhang, Yingshuang Zou, Zhengxian Wu, Yonggen Ling 2, 3 ⁣ † ^ { } Yuxiao Yang, Ziwei Wang 1 ^ { } NTU, Tencent Robotics X, HKUST, THU

Tencent Robotics X, Futian Laboratory, HKUST

6D位姿估计物体位姿多视角三维重建

面向机器人 real-to-sim 中多模块检测、分割、重建与位姿估计带来的误差累积、低效率和尺度不准问题,UniPR 从单对双目图像端到端并行重建场景内多物体。其关键是利用双目几何消除尺度歧义,并用姿态感知形状表示在观测坐标中联合编码位姿与几何,避免类别规范空间。实验显示其在大词表 LVS6D 上能保持物体真实比例,并相较逐物体生成式流程获得显著加速,最高约 100×。

LoD-Loc v3: Generalized Aerial Localization in Dense Cities using Instance Silhouette Alignment Figure 1
arXiv preprint2026-03-20

LoD-Loc v3: Generalized Aerial Localization in Dense Cities using Instance Silhouette Alignment

Shuaibang Peng, Juelin Zhu, Xia Li, Kun Yang, Maojun Zhang, Yu Liu, Shen Yan

National University of Defense Technology, Northwestern Polytechnical University

6D位姿估计航天器

该文针对无人机在密集城市中依赖高精地图成本高、LoD-Loc v2 跨场景泛化差且语义轮廓易产生位姿歧义的问题,提出用合成流程构建 10 万张实例级建筑标注的 InsLoD-Loc,并将定位从语义轮廓匹配改为实例轮廓对齐,结合 LoD 模型实例化与 SAM 微调提取建筑实例。实验显示其在公共基准和自建密集城市场景上超过现有方法,尤其在 2m/2° 指标下报告约 2000% 提升。

Measuring 3D Spatial Geometric Consistency in Dynamic Generated Videos Figure 1
arXiv preprint2026-03-19

Measuring 3D Spatial Geometric Consistency in Dynamic Generated Videos

Weijia Dou, Wenzhao Zheng, Weiliang Chen, Yu Zheng, Jie Zhou, Jiwen Lu

6D位姿估计

针对生成视频虽逼真但常出现背景扭曲、透视错误等3D几何不一致,而FVD等指标难以区分真实前景运动与结构崩坏的问题,论文提出SGC:先分离静态背景,再基于深度与特征轨迹在多个局部区域估计相机位姿,用位姿分歧度量几何稳定性。实验显示该指标能在真实与多类生成视频中发现既有指标遗漏的关键几何失败。

Generalized Hand-Object Pose Estimation with Occlusion Awareness Figure 1
arXiv preprint2026-03-20

Generalized Hand-Object Pose Estimation with Occlusion Awareness

Hui Yang, Wei Sun, Jian Liu, Jian Xiao, Tao Xie, Hossein Rahmani, Ajmal Saeed Mian, Nicu Sebe, Gim Hee Lee

6D位姿估计物体位姿手部姿态

面向单张 RGB 中手-物交互的 6D/3D 位姿估计,论文关注未见物体、新交互和重遮挡下视觉线索缺失导致的泛化瓶颈。GenHOI 的核心是把物体状态、手部构型与交互模式写成层次语义提示,并结合 RGB、预测点云和文本的多模态掩码建模,以及手部关节/旋转先验作为稳定空间参考来推断缺失约束。作者在 DexYCB 与 HO3Dv2 上报告达到 SOTA,但具体增益来源仍需看消融细节。

SEAR: Simple and Efficient Adaptation of Visual Geometric Transformers for RGB+Thermal 3D Reconstruction Figure 1
arXiv preprint2026-03-19

SEAR: Simple and Efficient Adaptation of Visual Geometric Transformers for RGB+Thermal 3D Reconstruction

Vsevolod Skorokhodov, Chenghao Xu, Shuo Sun, Olga Fink, Malcolm Mielle

6D位姿估计三维重建

针对RGB预训练几何Transformer在RGB-热红外联合输入时会产生跨模态位姿/尺度错位的问题,SEAR主张无需大规模多模态重训,只用LoRA适配器、热红外相机token和避免依赖配对对应的batch策略进行参数高效微调(少于5%参数)。在约1.5万RGB-T对上训练后,其在三维重建和相机位姿估计上超过6个基线,AUC@30提升约29%/30%,且推理开销接近原VGGT,并新增异步RGB-T基准数据集。

EdgeCrafter: Compact ViTs for Edge Dense Prediction via Task-Specialized Distillation Figure 1
arXiv preprint2026-03-19

EdgeCrafter: Compact ViTs for Edge Dense Prediction via Task-Specialized Distillation

Longfei Liu, Yongjie Hou, Yang Li, Qirui Wang, Youyang Sha, Yongjun Yu, Yinzhi Wang, Peizhe Ru, Xuanlong Yu, Project leader, Corresponding authors

Intellindust AI Lab

6D位姿估计

EdgeCrafter面向边缘设备上检测、分割与姿态估计中“小ViT精度效率不如CNN/YOLO”的问题,核心洞察是瓶颈在任务特化表征不足而非ViT本身。方法用检测适配后的DINOv3大模型蒸馏紧凑ViT,并以卷积stem、插值加线性投影替代重型多尺度结构。COCO上ECDet-S以少于10M参数达51.7 AP,ECPose-X达74.8 AP,高于YOLO26Pose-X的71.6 AP。

PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagery Figure 1
arXiv preprint2026-03-18

PanoVGGT: Feed-Forward 3D Reconstruction from Panoramic Imagery

Yijing Guo, Mengjun Chao, Luo Wang, Tianyang Zhao Haizhao Dai, Yingliang Zhang, Jingyi Yu, Sudo

ShanghaiTech University Sudo

6D位姿估计三维重建

针对透视相机前馈重建模型难以处理360°全景畸变、拼接易产生漂移的问题,PanoVGGT将置换等变Transformer扩展到球面域,引入球面位置编码、三轴SO(3)旋转增强和随机锚定,同时构建含深度与6DoF位姿的PanoCity数据集。实验显示其在新数据集和标准基准上精度、鲁棒性与跨域泛化较强,但部分收益可能主要来自更匹配的大规模数据。

Gesture-Aware Pretraining and Token Fusion for 3D Hand Pose Estimation Figure 1
arXiv preprint2026-03-18

Gesture-Aware Pretraining and Token Fusion for 3D Hand Pose Estimation

Rui Hong

George Mason University

6D位姿估计手部姿态

针对单目 RGB 手部 3D 姿态在遮挡、深度歧义和大幅关节变化下仅依赖几何约束不足的问题,论文把离散手势语义作为归纳偏置:先用 InterHand2.6M 的粗/细手势标签预训练 HRNet,再以手势嵌入引导逐关节 token Transformer 回归 MANO 参数。实验显示该预训练可稳定提升单手精度,并能直接迁移到 EANet 降低误差。

MessyKitchens: Contact-rich object-level 3D scene reconstruction Figure 1
arXiv preprint2026-03-17

MessyKitchens: Contact-rich object-level 3D scene reconstruction

Junaid Ansari, Ran Ding, Fabio Pizzati, Ivan Laptev

6D位姿估计物体位姿三维重建

面向机器人操作和动画中需要无穿透、接触合理的物体级三维场景重建,本文指出现有真实数据集标注精度和接触质量不足。作者构建了含100个杂乱厨房真实场景、130个物体及高精度位姿/接触标注的 MessyKitchens,并在 SAM 3D 上加入多物体解码器 MOD 进行联合形状与位姿预测。实验显示该数据集注册误差和物体互穿优于既有基准,MOD 在 MessyKitchens、GraspNet-1B 和 HouseCat6D 上均超过现有方法。

M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAM Figure 1
arXiv preprint2026-03-17

M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAM

Kerui Ren, Guanghao Li, Changjian Jiang, Yingxiang Xu, Tao Lu, Linning Xu, Junting Dong, Jiangmiao Pang, Mulin Yu, Bo Dai

6D位姿估计相机位姿多视角三维重建高斯泼溅

M³针对未标定单目视频流式重建中位姿精度不足、动态场景易漂移的问题,将多视角基础模型加上专门的密集匹配头,并与单目高斯泼溅SLAM紧耦合,利用动态区域抑制和跨推理内参对齐提升跟踪与重建稳定性。实验显示其在室内外基准上达到领先表现,在ScanNet++上较VGGT-SLAM 2.0降低ATE RMSE 64.3%,较ARTDECO提升PSNR 2.11 dB。

FSMC-Pose: Frequency and Spatial Fusion with Multiscale Self-calibration for Cattle Mounting Pose Estimation Figure 1
arXiv preprint2026-03-17

FSMC-Pose: Frequency and Spatial Fusion with Multiscale Self-calibration for Cattle Mounting Pose Estimation

Fangjing Li, Zhihai Wang, Xinxin Ding, Yao Zhu <ee_zhuy@zju.edu.cn>, Ronghua Gao, Rong Wang, NERCITA

Beijing Jiaotong University, Tsinghua University, Griffith University

6D位姿估计

面向奶牛发情监测中密集牛群、背景杂乱和个体遮挡导致的爬跨姿态难估计问题,FSMC-Pose采用轻量级自顶向下框架,将频率—空间融合骨干CattleMountNet与多尺度空间/通道自校准头SC2Head结合,并构建MOUNT-Cattle数据集。实验在联合基准上较强基线提升AP/AR,同时仅约2.70M参数、4.41 GFLOPs,可在普通GPU上实时推理。

Learning Human-Object Interaction for 3D Human Pose Estimation from LiDAR Point Clouds Figure 1
arXiv preprint2026-03-17

Learning Human-Object Interaction for 3D Human Pose Estimation from LiDAR Point Clouds

Daniel Sungho Jung, Dohee Cho, Kyoung Mu Lee

6D位姿估计人体姿态点云

面向自动驾驶中行人携物、骑车等场景,论文指出 LiDAR 人体姿态估计在交互区域易受人/物点空间混淆和手脚点稀疏失衡影响。HOIL 通过多 HOI 数据预训练交互先验,引入交互感知对比学习区分人/物特征,并用接触感知部件池化保留关键稀疏部位;在 Waymo、SLOPER4D 上较现有方法取得更低 MPJPE 和更高 PCK,消融显示接触区域建模是主要增益来源。

Severe Domain Shift in Skeleton-Based Action Recognition:A Study of Uncertainty Failure in Real-World Gym Environments Figure 1
arXiv preprint2026-03-16

Severe Domain Shift in Skeleton-Based Action Recognition:A Study of Uncertainty Failure in Real-World Gym Environments

Aaditya Khanal1, Junxiu Zhou1

6D位姿估计

这篇论文关注骨架动作识别从受控3D多视角数据部署到真实健身房单目2D姿态时的安全失效。核心洞察是,高OOD AUROC并不等于可安全选择性分类,模型在域外仍会自信犯错。实验中Skeleton Transformer在NTU-120达63.2%,零样本到Gym2D和UCF101仅1.6%/1.16%,50%覆盖率下风险仍达99.6%;轻量微调门控可改善校准并降低错误发声率。

Pointing-Based Object Recognition Figure 1
arXiv preprint2026-03-16

Pointing-Based Object Recognition

Lukáš Hajdúch, Viktor Kocur

6D位姿估计

面向人机交互中机器人理解人类指向意图的问题,本文用单目 RGB 构建模块化管线,将目标检测、MediaPipe 姿态、MoGe 单目深度和图像描述模型结合,把2D指向射线提升到3D空间并用文本描述校正误分类。自建桌面指向数据集结果显示,深度信息在物体重叠和复杂场景中显著提升识别稳定性,YOLO/OWL-ViT 配合 MoGe 普遍优于2D方案,captioning 进一步改善部分混淆类别。

Fast Volume Alignment by Frequency-Marched Newton Figure 1
arXiv preprint2026-03-16

Fast Volume Alignment by Frequency-Marched Newton

Fabian Kruse, Vinith Kishore, Ivan Dokmanić

Department of Mathematics and Computer Science, University of Basel, Basel

6D位姿估计

面向冷冻电镜断层子图平均中大量三维体数据的6D位姿对齐,论文将传统离散匹配滤波改写为SO(3)上的连续优化:先用低带宽SO(3)-FFT粗搜候选,再随频率递增用Wigner-D展开的闭式梯度/ Hessian做Newton细化,并交替用FFT更新平移。实验显示其在合成旋转估计中达亚度精度且显著快于穷举搜索,接入RELION5后重建质量保持到Nyquist局部分辨率,同时位姿细化耗时降低超过10倍。

Enhancing Hands in 3D Whole-Body Pose Estimation with Conditional Hands Modulator Figure 1
CVPR 20262026-03-16

Enhancing Hands in 3D Whole-Body Pose Estimation with Conditional Hands Modulator

Gyeongsik Moon

Korea University

6D位姿估计手部姿态人体姿态

针对全身3D姿态估计中手部监督不足、手部模型又缺少全局身体约束的问题,Hand4Whole++将冻结的全身估计器与手部估计器模块化结合,用轻量CHAM把手部特征调制到全身特征流,并通过可微刚体对齐迁移MANO手指姿态与形状。实验显示其显著提升手部精度,并带动整体全身姿态质量改善,但代价是依赖两个预训练模型、运行开销增加。

Expanding mmWave Datasets for Human Pose Estimation with Unlabeled Data and LiDAR Datasets Figure 1
arXiv preprint2026-03-15

Expanding mmWave Datasets for Human Pose Estimation with Unlabeled Data and LiDAR Datasets

Zhuoxuan Peng, Boan Zhu, Xingjian Zhang, Wenying Li, Technology zpengac@cse.ust.hk, @connect.ust.hk, gchan@cse.ust.hk

The Hong Kong University of Science and Technology

6D位姿估计人体姿态点云数据集/基准

针对毫米波点云人体姿态数据标注稀缺、设备与姿态多样性不足导致泛化差的问题,论文提出 EMDUL:用带时间一致性约束的伪标签器标注未标注毫米波数据,并通过闭式转换器将已标注 LiDAR 点云模拟为毫米波点云,尤其用基于运动流的点过滤刻画毫米波对运动部位更敏感的成像特性。在 MM-Fi、mmBody 与 LiDAR 数据集上的实验显示,扩展数据训练可使域内和跨域误差分别降低 15.1% 和 18.9%。

eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation Figure 1
arXiv preprint2026-03-15

eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation

Prithvi Jai Ramesh, Kaustav Chanda, Krishna Vinod, Joseph Raj Vishal Yezhou Yang, Bharatesh Chakravarthi

School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA

6D位姿估计事件相机机器人操作

针对室内跟随导航在低照度和快速运动下 RGB 感知易失效、事件相机尚缺少端到端控制数据的问题,eNavi 采集真实 TurtleBot RGB-事件流与专家动作,并用时间对齐和里程计动作重建支撑模仿学习;其双 MobileNet 加 Transformer 的后融合策略在 12 种训练设置中较 RGB-only/Event-only 降低动作预测误差,尤其在未见低光场景更稳健。

Vision-guided Autonomous Dual-arm Extraction Robot for Bell Pepper Harvesting Figure 1
arXiv preprint2026-03-14

Vision-guided Autonomous Dual-arm Extraction Robot for Bell Pepper Harvesting

Kshitij Madhav Bhat, Tom Gao, Abhishek Mathur, Rohit Satishkumar, Francisco Yandun, Dominik Bauer, Nancy Pollard

the Robotics Institute, Carnegie Mellon University, Pittsburgh, PA

6D位姿估计机器人操作

面向露天甜椒采收中光照变化、遮挡和果梗定位困难导致单臂系统难以稳定剪切的问题,论文提出 VADER 双臂移动机器人,将抓取臂与切割臂解耦,并用端侧 RGB-D 感知、粗到细的果实/果梗标注数据支持检测与高精度位姿估计。系统在现实条件试验中采收成功率超过 60%,单果周期低于 100 秒,并加入 GELLO 遥操作兜底;但与单臂方案相比的增益来源仍部分依赖系统集成与数据质量。

Sky2Ground: A Benchmark for Site Modeling under Varying Altitude Figure 1
arXiv preprint2026-03-14

Sky2Ground: A Benchmark for Site Modeling under Varying Altitude

Zengyan Wang, Sirshapan Mitra, Rajat Modi, Grace Lim

Zengyan Wang, Sirshapan Mitra, Rajat Modi, Grace Lim, Yogesh Rawat, Center for Research In Computer Vision, University of Central Florida

6D位姿估计数据集/基准

本文针对地面、航拍、卫星三类视角联合定位与重建缺少统一基准的问题,构建含51个地点的真实/合成 Sky2Ground,并指出卫星视角会显著破坏现有模型的跨视角对齐。作者进一步提出带卫星隔离注意力和课程训练的 SkyNet,以航拍作为桥接逐步纳入卫星视角,在 RRA@5、RTA@5 上分别较现有方法提升9.6和18.1个百分点。

VIRD: View-Invariant Representation through Dual-Axis Transformation for Cross-View Pose Estimation Figure 1
arXiv preprint2026-03-13

VIRD: View-Invariant Representation through Dual-Axis Transformation for Cross-View Pose Estimation

School of Electrical Engineering, KAIST, Hanwha Aerospace @kaist.ac.kr @hanwha.com

Urban Robotics Lab, School of Electrical Engineering, KAIST

6D位姿估计

面向城市中 GNSS 易失效时的跨视角全局定位,VIRD 针对地面图与卫星图视角差大、空间对应弱的问题,提出双轴变换表征:用极坐标变换对齐水平方向,并以上下文增强位置注意力缓解垂直错位,再通过视角重建损失强化不变性。在无需方向先验下,KITTI 与 VIGOR 上中位位置/朝向误差较 SOTA 分别降低 50.7%/76.5% 和 18.0%/46.8%。

Coherent Human-Scene Reconstruction from Multi-Person Multi-View Video in a Single Pass Figure 1
arXiv preprint2026-03-13

Coherent Human-Scene Reconstruction from Multi-Person Multi-View Video in a Single Pass

Sangmin Kim, Minhyuk Hwang, Geonho Cha, Dongyoon Wee, Jaesik Park

6D位姿估计多视角三维重建

针对多视角多人视频中人体与场景重建常依赖检测、重识别或优化预处理的问题,CHROMM将Pi3X几何先验与Multi-HMR人体先验统一到单次前向框架,并用头—骨盆尺度校正、多视角无优化融合和几何式跨视角关联提升一致性。在EMDB、RICH、EgoHumans、EgoExo4D上,其全局人体运动与多视角姿态精度具竞争力,速度较优化式方法提升超过8倍。

CM-Bench: A Comprehensive Cross-Modal Feature Matching Benchmark Bridging Visible and Infrared Images Figure 1
arXiv preprint2026-03-13

CM-Bench: A Comprehensive Cross-Modal Feature Matching Benchmark Bridging Visible and Infrared Images

Liangzheng Sun, Mengfan He, Xingyu Shao, Binbin Li, Zhiqiang Yan, Chunyu Li, Ziyang Meng, Fei Xing

School of Instrument Science and Opto-Electronics Engineering, Beijing Information Science and Technology University, Beijing 100192, China, Department of Precision Instrument, Tsinghua University, Beijing 100084, China

6D位姿估计数据集/基准

针对红外-可见光匹配缺少统一评测、跨模态外观差异导致定位与位姿估计不稳的问题,CM-Bench系统评测30种稀疏、半稠密和稠密匹配器,覆盖单应、相对位姿和地理定位,并加入自适应预处理与ThermoSat红外-卫星数据集。结果显示RoMa/MINIMA类稠密方法整体最强,困难定位协议下性能明显下降,预处理带来一致但方法相关的增益。

BehaviorVLM: Unified Finetuning-Free Behavioral Understanding with Vision-Language Reasoning Figure 1
arXiv preprint2026-03-12

BehaviorVLM: Unified Finetuning-Free Behavioral Understanding with Vision-Language Reasoning

30332 anqiwu@gatech.edu

Georgia Institute of Technology, Georgia Institute of Technology, Emory University

6D位姿估计

针对动物姿态与行为分析高度依赖人工标注、无监督分段难解释的问题,BehaviorVLM将预训练VLM/LLM组织成可核查的多阶段推理流程:用量子点候选点、时空与跨视角约束完成3D关键点标注,并以聚类、视频描述和语义合并生成行为段。作者报告仅需3帧人工种子、无需微调即可在六视角小鼠数据和MABe2022上获得可复查的姿态轨迹与可解释行为标签,但具体增益幅度文中未充分说明。

Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videos Figure 1
arXiv preprint2026-03-14

Dense Dynamic Scene Reconstruction and Camera Pose Estimation from Multi-View Videos

Shuo Sun, Unal Artan, Malcolm Mielle, Achim J. Lilienthal, Martin Magnusson

6D位姿估计相机位姿多视角三维重建

论文面向多台自由移动相机同时拍摄动态场景时的稠密重建与相机位姿估计,针对单目尺度漂移、视角重叠有限和动态物体破坏几何一致性等问题,提出两阶段框架:先用时空连接图和宽基线前馈初始化实现多相机一致跟踪,再用宽基线光流优化跨相机与时序深度一致性。作者还发布含动捕真值的 MultiCamRobolab 数据集,并在合成与真实基准上相较前馈重建模型取得更好跟踪、重建效果且显存更低。

Real-time Rendering-based Surgical Instrument Tracking via Evolutionary Optimization Figure 1
arXiv preprint2026-03-13

Real-time Rendering-based Surgical Instrument Tracking via Evolutionary Optimization

Hanyang Hu, Zekai Liang, Florian Richter, Michael C. Yip, Senior Member, IEEE

Department of Electrical and Computer Engineering, University of California San Diego, La Jolla, CA USA

6D位姿估计医学/手术

针对手术机器人器械因遮挡、细长铰接结构和关节读数噪声导致的实时6D跟踪困难,论文用CMA-ES替代梯度式可微渲染优化,并结合GPU批量渲染、分割/关键点观测和卡尔曼时序滤波,联合估计位姿与关节角。方法还扩展到无关节角输入和双器械场景;在合成与真实数据上相较既有视觉或渲染方法同时提升精度与运行速度。

High-Precision 6DOF Pose Estimation via Global Phase Retrieval in Fringe Projection Profilometry for 3D Mapping Figure 1
arXiv preprint2026-03-12

High-Precision 6DOF Pose Estimation via Global Phase Retrieval in Fringe Projection Profilometry for 3D Mapping

Sehoon Tak ^{ }, Keunhee Cho ^{ }, Sangpil Kim ^{ }, Jae-Sang Hyun ^{ }

6D位姿估计

针对DFP在大范围3D建图中点云虽密但6D位姿受ICP降采样、弱纹理和低重叠影响而难以匹配测量精度的问题,论文引入固定标定的全局投影仪,将相位恢复得到的像素约束用于PnP式重投影优化,并配合批采样与一致性剔除。实验显示其在强降采样下仍具重复性,可达亚毫米位姿精度,并能在均质表面、低重叠视角及ICP轨迹校正中减少误差累积,但代价是额外的时分投影采集。

Distributed Kalman--Consensus Filtering with Adaptive Uncertainty Weighting for Multi-Object Tracking in Mobile Robot Networks Figure 1
arXiv preprint2026-03-11

Distributed Kalman--Consensus Filtering with Adaptive Uncertainty Weighting for Multi-Object Tracking in Mobile Robot Networks

1st Niusha Khosravi, 2nd Rodrigo Ventura, 3 Meysam Basiri

6D位姿估计物体位姿机器人操作

面向多移动机器人在遮挡、部分可观测和定位质量不一致时的多目标跟踪问题,论文在 MOTLEE 的动态物体临时地标对齐基础上,引入按协方差调节邻居影响的自适应 Kalman-Consensus 融合,以抑制低可信机器人带来的重影和重复轨迹。仿真显示,对存在定位漂移的机器人 MOTA 提升约 0.09,但整体仍受通信延迟限制。

Learning Bimanual Cloth Manipulation with Vision-based Tactile Sensing via Single Robotic Arm Figure 1
arXiv preprint2026-03-11

Learning Bimanual Cloth Manipulation with Vision-based Tactile Sensing via Single Robotic Arm

Dongmyoung Lee, Wei Chen, Xiaoshuai Chen, Rui Zong, Petar Kormushev

6D位姿估计机器人操作

针对布料操作中遮挡频繁、状态高维且双臂系统成本与控制复杂度较高的问题,论文提出 Touch G.O.G.:用单机械臂的视触觉夹爪实现类双手的夹内滑移,并结合基于 SAM/ViT 的触觉部位分类、边缘位姿估计与合成触觉数据生成。实验中部位识别准确率达 96%,边缘定位为亚毫米级、方向误差约 4.5°,真实场景可在无外部视觉下展开多种褶皱布料。

TacLoc: Global Tactile Localization on Objects from a Registration Perspective Figure 1
arXiv preprint2026-03-11

TacLoc: Global Tactile Localization on Objects from a Registration Perspective

Zirui Zhang, Boyang Zhang, Fumin Zhang, Huan Yin

6D位姿估计

TacLoc针对抓取接触时视觉易被遮挡、现有触觉定位依赖仿真渲染或预训练模型而泛化受限的问题,将首触6D位姿估计改写为局部触觉点云到完整CAD的全局配准。其核心是利用触觉恢复的稠密点云与法向,进行法向引导的图剪枝、多假设生成与验证,无需渲染数据。仿真YCB上边数约减52%、耗时约降93%,并在DIGIT、GelSight、Daimon及5个真实物体上验证,滑动触摸成功33/50。

Multi-Person Pose Estimation Evaluation Using Optimal Transportation and Improved Pose Matching Figure 1
arXiv preprint2026-03-11

Multi-Person Pose Estimation Evaluation Using Optimal Transportation and Improved Pose Matching

Takato Moriki, Hiromu Taketsugu, Norimichi Ukita

Toyota Technological Institute

6D位姿估计

针对多人姿态评估中过度依赖置信度排序、低置信假阳性被 mAP 等指标弱化的问题,论文提出 OCpose,将检测姿态与标注的匹配建模为最优传输,并用关键点置信度改进与姿态、mask、crowd mask 的匹配代价。实验与用户评价显示,OCpose 能更直接惩罚大量误检,给出不同于 AP 且更贴近人工偏好的评估结果。

VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM Figure 1
arXiv preprint2026-03-10

VarSplat: Uncertainty-aware 3D Gaussian Splatting for Robust RGB-D SLAM

Anh Thuan Tran

Department of Computer Science, George Mason University

6D位姿估计相机位姿点云彩色深度三维重建

VarSplat针对现有3DGS-SLAM默认等权使用光度观测、在低纹理、反光或深度边界处易漂移的问题,将每个高斯的外观方差作为可学习地图属性,并用全方差公式在alpha合成中单次光栅化得到可微像素不确定性,用于跟踪、子图配准和回环检测的可靠区域加权。Replica、TUM-RGBD、ScanNet和ScanNet++实验显示,其在位姿鲁棒性、重建和新视角渲染上达到有竞争力或更优表现。

CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation Figure 1
arXiv preprint2026-03-10

CIGPose: Causal Intervention Graph Neural Network for Whole-Body Pose Estimation

Bohao Li, Zhicheng Cao, Huixian Li : 1, Yangming Guo : 1 School of Computer Science, zccao@xidian.edu.cn, @nwpu.edu.cn

School of Computer Science, Northwestern Polytechnical University, Xidian University, School of Cybersecurity, Northwestern Polytechnical University

6D位姿估计人体姿态

针对全身姿态估计在遮挡、杂乱背景下易受视觉上下文伪相关影响而产生不合人体结构预测的问题,CIGPose用结构因果模型将上下文视为混杂因素,并通过预测不确定性定位受混杂的关键点表示,替换为上下文不变的规范嵌入,再由层次图神经网络进行局部与全局骨架推理。实验中CIGPose-x在COCO-WholeBody达67.0% AP,加入UBody后达67.5% AP,显示出较好的鲁棒性和数据效率。

SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation Figure 1
arXiv preprint2026-03-10

SpaceSense-Bench: A Large-Scale Multi-Modal Benchmark for Spacecraft Perception and Pose Estimation

Aodi Wu, Jianhong Zuo, Zeyuan Zhao, Xubo Luo, Ruisuo Wang, Xue Wan

University of Chinese Academy of Sciences, Beijing, China, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing, China, Nanjing University of Aeronautics and Astronautics, Nanjing, China

6D位姿估计数据集/基准航天器

面向在轨服务和碎片清除中难以获取真实多模态数据、现有航天器数据集目标少且标注不全的问题,SpaceSense-Bench 用 UE5/AirSim 构建含 136 个卫星、RGB/深度/256线 LiDAR 同步数据、7类部件语义和6D位姿真值的基准。五项任务评测显示,小部件识别与未见航天器零样本泛化仍是瓶颈,而增加训练卫星数量能显著提升新目标性能,增益可能主要来自数据规模与多样性。

TRIP-Bag: A Portable Teleoperation System for Plug-and-Play Robotic Arms and Leaders Figure 1
arXiv preprint2026-03-10

TRIP-Bag: A Portable Teleoperation System for Plug-and-Play Robotic Arms and Leaders

Noboru Myers, Sankalp Yamsani, Obin Kwon, Joohyung Kim

6D位姿估计机器人操作

针对机器人学习中高质量、多环境操作示范难以规模化采集的问题,TRIP-Bag将双机械臂、缩放木偶式主端、RGB-D相机和计算单元集成进商用行李箱,以关节到关节直映射降低手持/视觉采集的形态差距,并在数分钟内完成部署。作者在22个环境采集1238条示范,非专家实验显示易上手,训练基准操作策略验证了数据可用于下游学习。

Fly, Track, Land: Infrastructure-less Magnetic Localization for Heterogeneous UAV-UGV Teaming Figure 1
arXiv preprint2026-03-09

Fly, Track, Land: Infrastructure-less Magnetic Localization for Heterogeneous UAV-UGV Teaming

Valerio Brunacci, Davide Plozza, Alessio De Angelis, Michele Magno, Tommaso Polonelli

6D位姿估计航天器

面向GNSS、视觉或外部锚点不可靠时的无人机—地面机器人近距对接,论文提出无基础设施的磁感应相对定位系统:UGV发射局部磁场,轻量UAV仅用单个接收线圈和嵌入式暖启动求解器估计相对位置,并与惯性、光流在EKF中融合。实验中系统以20Hz输出UGV坐标系下估计,3D位置RMSE约5厘米;动态跟踪移动四足平台时RMSE为7.2厘米,并完成自主降落。

ER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation Figure 1
arXiv preprint2026-03-09

ER-Pose: Rethinking Keypoint-Driven Representation Learning for Real-Time Human Pose Estimation

Nanjun Li, Pinqi Cheng, Zean Liu, Minghe Tian, Xuanyin Wang

6D位姿估计人体姿态

本文针对YOLO式单阶段多人姿态估计受检测框驱动约束的问题,指出框监督会造成样本分配与特征语义偏向检测任务,限制关键点回归精度。ER-Pose改为关键点驱动:移除框预测、重设计预测头,引入OKS-置信度动态分配和Smooth-OKS损失,实现密集监督与免NMS推理。在COCO和CrowdPose上,ER-Pose-n相对YOLO-Pose在无预训练/预训练设置下分别提升3.2/6.7和7.4/4.9 AP,同时参数更少、推理更快。

mmGAT: Pose Estimation by Graph Attention with Mutual Features from mmWave Radar Point Cloud Figure 1
arXiv preprint2026-03-09

mmGAT: Pose Estimation by Graph Attention with Mutual Features from mmWave Radar Point Cloud

Masud Abdullah Al 1 ^{ }, Xintong Shi 2 ^{ }, Bouazizi Mondher 3 ^{ }, Tomoaki Ohtsuki 4 ^{ }, Email: 1 ^{ } masud@ohtsuki.ics.keio.ac.jp, 2 ^{ } shixintong@ohtsuki.ics.keio.ac.jp, 3 ^{ } bouazizi@ohtsuki.ics.keio.ac.jp, 4 ^{ } ohtsuki@keio.jp

Keio University

6D位姿估计点云

针对视觉姿态估计存在隐私风险且在弱光下性能下降的问题,mmGAT将单帧毫米波雷达点云建模为有向图,不再把点排序成伪图像,而是用GAT同时编码点的坐标、多普勒、反射强度及点对间距离、方向、相对速度和强度等互特征。在两个公开毫米波基准上,多数场景达到新SOTA,MPJPE较既有方法降低35.6%,PA-MPJPE降低14.1%。

PCFEx: Point Cloud Feature Extraction for Graph Neural Networks Figure 1
IEEE Internet of Things Journal, vol. 13, no. 4, pp. 5909-5917, 15 Feb.15, 20262026-03-09

PCFEx: Point Cloud Feature Extraction for Graph Neural Networks

Abdullah Al Masud, Shi Xintong, Mondher Bouazizi, Ohtsuki Tomoaki

Manuscript submitted on June

6D位姿估计点云

论文针对毫米波雷达点云在人姿估计与活动识别中常被栅格化或逐点处理、破坏空间关系且易受噪声影响的问题,将原始点云建模为图,设计PCFEx在点、边和整帧层面提取特征,并用GAT融合节点与边信息。在MMFi、mRI、MARS和MMActivity上验证,三个人姿估计基准误差均明显降低,活动识别准确率达到98.8%。

Event-based Motion & Appearance Fusion for 6D Object Pose Tracking Figure 1
arXiv preprint2026-03-09

Event-based Motion & Appearance Fusion for 6D Object Pose Tracking

Zhichao Li, Chiara Bartolozzi, Lorenzo Natale, Arren Glover

Event-driven Perception for Robotics, Istituto Italiano di Tecnologia, Italy, University of Genoa, Genoa, Italy

6D位姿估计物体位姿事件相机

针对RGB/RGB-D位姿跟踪在高速运动中易受运动模糊和帧率限制的问题,论文提出仅用事件相机的6D位姿跟踪框架:由事件光流估计6D速度并用卡尔曼传播,再通过基于物体网格渲染模板的局部姿态校正抑制积分漂移,且不依赖学习和深度测量。在合成与真实数据上,其性能接近现有方法,并在部分快速运动场景优于RGB-D深度网络方法。

Why Learn What Physics Already Knows? Realizing Agile mmWave-based Human Pose Estimation via Physics-Guided Preprocessing Figure 1
arXiv preprint2026-03-09

Why Learn What Physics Already Knows? Realizing Agile mmWave-based Human Pose Estimation via Physics-Guided Preprocessing

Shuntian Zheng, Jiaqi Li, Minzhe Ni, Xiaoman Lu, Yu Guan

6D位姿估计人体姿态

论文针对毫米波人体姿态估计中“前端预处理参数多、收益小”的效率错配,主张不再用大模型学习已由雷达物理定义的距离、角度和多普勒关系,而是以物理先验重组信号:耦合距离-角度保留人体空间结构,利用多普勒维持运动连续性,并按身体层级做多尺度融合,最后用轻量 MLP 回归姿态。实验显示其相对既有毫米波基线减少 55.7–88.9% 参数且精度保持竞争力,并可在 Raspberry Pi 上实时运行。

Re-evaluating Position and Velocity Decoding for Hand Pose Estimation with Surface Electromyography Figure 1
arXiv preprint2026-03-09

Re-evaluating Position and Velocity Decoding for Hand Pose Estimation with Surface Electromyography

Nima Hadidi, Johannes Lee, Ebrahim Feghhi, Michael Yuan, Jonathan C. Kao

6D位姿估计手部姿态

本文针对 emg2pose 原基线“速度解码优于位置解码”的结论重新评估实时 sEMG 手部姿态估计。核心洞察是位置解码此前受未调参的输出缩放因子影响,易退化为低运动预测;调好 scaling 后,其在 Tracking 三种泛化设置均优于速度解码,Regression 中差距较小且多任务训练收益更大,配合因果自适应滤波还能缓解抖动并保持精度优势。

Speed3R: Sparse Feed-forward 3D Reconstruction Models Figure 1
arXiv preprint2026-03-09

Speed3R: Sparse Feed-forward 3D Reconstruction Models

Weining Ren, Xiao Tan

The University of Hong Kong

6D位姿估计三维重建

Speed3R针对前馈式多视角三维重建中全局密集注意力随图像 token 二次增长、长序列推理过慢的问题,借鉴SfM“少量关键点即可约束位姿”的思想,将全局注意力替换为可端到端训练的双分支稀疏注意力:压缩分支提供场景先验,选择分支只细算高信息 token。在VGGT和π³骨干上验证后,1000/1024视图序列可达约12.4倍加速,几何精度仅小幅下降;但短序列精度仍弱于密集模型,且带来约15%显存开销。

RoboPCA: Pose-centered Affordance Learning from Human Demonstrations for Robot Manipulation Figure 1
arXiv preprint2026-03-08

RoboPCA: Pose-centered Affordance Learning from Human Demonstrations for Robot Manipulation

Zhanqi Xiao, Ruiping Wang, Xilin Chen

6D位姿估计机器人操作

RoboPCA针对传统可供性方法只找接触区域、再依赖独立位姿估计而易产生不一致的问题,将接触点与末端接触姿态作为统一的“位姿中心”可供性来学习。其关键在于Human2Afford从人类演示中自动恢复深度、物体掩码,并由手-物交互推断机器人姿态,再用RGB-D与掩码增强的扩散模型预测。实验在AGD20K、RLBench和真实机器人上分别带来18.6%、38.5%和24.9%的提升。

Learning When to Look: On-Demand Keypoint-Video Fusion for Animal Behavior Analysis Figure 1
arXiv preprint2026-03-07

Learning When to Look: On-Demand Keypoint-Video Fusion for Animal Behavior Analysis

Weihan Li, Jingyang Ke, Yule Wang, Chengrui Li, Anqi Wu

6D位姿估计

针对动物行为分析中关键点高效但易受几何歧义、遮挡和环境缺失影响,而逐帧视频计算过重的问题,LookAgain将训练与推理解耦:训练时用密集视觉特征指导运动编码器并学习门控,推理时仅在关键点信号不确定时调用视觉编码。单动物与多动物实验显示,仅激活约25%帧即可接近全帧融合性能,并显著降低长时程录像分析成本。

Vision-Guided MPPI for Agile Drone Racing: Navigating Arbitrary Gate Poses via Neural Signed Distance Fields Figure 1
arXiv preprint2026-03-07

Vision-Guided MPPI for Agile Drone Racing: Navigating Arbitrary Gate Poses via Neural Signed Distance Fields

Fangguo Zhao, Hanbing Zhang, Zhouheng Li, Xin Guan, Shuo Li

the College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China

6D位姿估计

面向无人机竞速中预规划轨迹和显式6D门框位姿对扰动、遮挡与噪声敏感的问题,本文将由深度图预测的 Gate-SDF 神经符号距离场嵌入采样式 MPPI,使控制器无需参考轨迹即可同时获得避障排斥和穿门几何引导。仿真与实机实验显示,该方法能在未知赛道及门位姿大幅偏移下保持高速穿越,但具体相对增益来源仍需更多消融支撑。

RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulation Figure 1
arXiv preprint2026-03-07

RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulation

Zixuan Chen, Nga Teng Chan, Yiwen Hou, Chenrui Tie, Zixuan Liu, Haonan Chen, Junting Chen, Jieqi Shi, Yang Gao, Jing Huo, Lin Shao

6D位姿估计机器人操作

针对双臂模仿学习常忽略两臂与物体之间动态几何关系、易导致碰撞和抓取不稳的问题,RoTri-Diff 将两末端执行器与物体的相对 6D 位姿编码为 RoTri 三元交互约束,并在分层扩散框架中联合关键位姿、物体运动与连续动作生成。实验显示其在 11 个 RLBench2 双臂任务上较 SOTA 成功率提升 10.2%,并在 4 个真实双臂任务中保持稳定执行。

MipSLAM: Alias-Free Gaussian Splatting SLAM Figure 1
arXiv preprint2026-03-07

MipSLAM: Alias-Free Gaussian Splatting SLAM

Yingzhao Li, Yan Li, Shixiong Tian, Yanjie Liu, Lijun Zhao, Gim Hee Lee

Harbin Institute of Technology

6D位姿估计相机位姿三维重建高斯泼溅

MipSLAM针对现有3DGS-SLAM在相机内参、分辨率或变焦变化时易出现混叠伪影与轨迹漂移的问题,将渲染与位姿优化引入频率视角:用椭圆自适应抗混叠以几何引导数值积分近似高斯贡献,并用频谱感知PGO通过图拉普拉斯抑制高频噪声。Replica和TUM实验显示其在多分辨率下同时提升新视角渲染质量和定位精度。

SurgCUT3R: Surgical Scene-Aware Continuous Understanding of Temporal 3D Representation Figure 1
arXiv preprint2026-03-07

SurgCUT3R: Surgical Scene-Aware Continuous Understanding of Temporal 3D Representation

Kaiyuan Xu, Fangzhou Hong, Daniel Elson, Baoru Huang

The Hamlyn Centre for Robotic Surgery, Imperial College London, SW7 AZ, UK, S-Lab, College of Computing and Data Science, Nanyang Technological University, Singapore, Department of Computer Science, University of Liverpool, L69 ZX, UK

6D位姿估计医学/手术

SurgCUT3R面向单目内窥镜长视频重建中缺少真实监督、且通用CUT3R类模型易累积位姿漂移的问题,将公开双目手术数据转化为米制伪深度监督,并结合几何自校正训练;推理阶段用兼顾全局稳定与局部精度的层级双模型框架。文中在SCARED和StereoMIS上显示其位姿估计接近最优精度但速度更快,适合手术场景的连续3D重建。

CFEAR-Teach-and-Repeat: Fast and Accurate Radar-only Localization Figure 1
arXiv preprint2026-03-06

CFEAR-Teach-and-Repeat: Fast and Accurate Radar-only Localization

Maximilian Hilger, Daniel Adolfsson, Ralf Becker, Henrik Andreasson, Achim J. Lilienthal

6D位姿估计

针对恶劣天气或 GNSS/视觉传感器失效时的鲁棒定位需求,CFEAR-TR 仅用单个旋转雷达实现 teach-and-repeat 定位;关键在于用多普勒补偿后的稀疏有向表面点表示扫描,并将当前帧同时对齐到教学地图帧和近期在线关键帧,以降低噪声和季节变化影响。在 Boreas 测试集上达到 0.117 m、0.096°,航向误差较既有雷达方法最高降 63%,并以 29 Hz 运行。

DreamToNav: Generalizable Navigation for Robots via Generative Video Planning Figure 1
arXiv preprint2026-03-06

DreamToNav: Generalizable Navigation for Robots via Generative Video Planning

Valerii Serpiva, Jeffrin Sam, Chidera Simon, Hajira Amjad, Iana Zhura, Artem Lykov, Dzmitry Tsetserukou

Valerii Serpiva, Jeffrin Sam, Chidera Simon, Hajira Amjad, Iana Zhura, Artem Lykov, and Dzmitry Tsetserukou

6D位姿估计机器人操作

针对传统导航难以表达“礼貌跟随”等语义意图的问题,DreamToNav将生成视频当作规划器:先用Qwen 2.5-VL把自然语言和场景图细化为视觉描述,再由Cosmos 2.5生成未来执行视频,并通过检测、位姿估计和轨迹恢复转成可执行路径。实验在轮式与四足机器人上取得23/30成功率,目标误差约0.05–0.10 m、跟踪误差低于0.15 m,但失败仍受视频场景失真和位姿累计误差影响。

Beyond Static Frames: Temporal Aggregate-and-Restore Vision Transformer for Human Pose Estimation Figure 1
arXiv preprint2026-03-06

Beyond Static Frames: Temporal Aggregate-and-Restore Vision Transformer for Human Pose Estimation

Hongwei Fang, Jiahang Cai, Xun Wang, China

Zhejiang Gongshang University, China

6D位姿估计人体姿态

针对 ViTPose 等单帧 ViT 在视频中忽略时序一致性、遇到遮挡和运动模糊易抖动的问题,本文提出 TAR-ViTPose,在保持 plain ViT 与轻量解码器的同时,以关节查询进行时序聚合 JTA,并用 GRA 将关节级时序信息恢复到当前帧 token。其在 PoseTrack2017 较 ViTPose 提升 2.3 mAP,并在多套视频人体姿态基准达到 SOTA,ViT-S 实测约 413 FPS。

From Decoupled to Coupled: Robustness Verification for Learning-based Keypoint Detection with Joint Specifications Figure 1
arXiv preprint2026-03-05

From Decoupled to Coupled: Robustness Verification for Learning-based Keypoint Detection with Joint Specifications

Xusheng Luo, Changliu Liu

Proceedings of Machine Learning Research vol vvv:1–21, Carnegie Mellon University, Pittsburgh, PA, USA

6D位姿估计

针对关键点检测在6D位姿等下游任务中易受微小扰动影响、而逐点验证忽略关键点间耦合且过于保守的问题,本文将热图式检测器的鲁棒性验证表述为联合规格下的MILP反例搜索,结合可达热图集合与联合误差多面体;不可行即可给出有声性保证。实验显示该耦合验证在严格误差阈值下仍保持较高验证率,明显优于解耦基线,但仍受可达集过近似保守性限制。

Dark3R: Learning Structure from Motion in the Dark Figure 1
arXiv preprint2026-03-05

Dark3R: Learning Structure from Motion in the Dark

Andrew Y. Guo, Anagh Malik, SaiKiran Tedla, Yutong Dai Yiqian Qin, Zach Salehe, Benjamin Attal Sotiris Nousias, Kiriakos N. Kutulakos

University of Toronto Vector Institute York University, Sony Corporation of America Harvard University Purdue University

6D位姿估计

Dark3R针对极低照度下噪声使传统/学习式SfM特征匹配和相机位姿估计崩溃的问题,直接在低SNR raw图像上重建。其核心是用教师-学生蒸馏将MASt3R等3D基础模型的高信噪特征迁移到低光场景,仅需噪声-干净raw图像对、无需3D监督。论文还构建约4.2万张曝光包围多视图raw数据集,实验显示在低于−4 dB的SNR下实现领先的位姿、稀疏深度估计,并支撑暗光新视角合成。

AIM-SLAM: Dense Monocular SLAM via Adaptive and Informative Multi-View Keyframe Prioritization with Foundation Model Figure 1
arXiv preprint2026-03-06

AIM-SLAM: Dense Monocular SLAM via Adaptive and Informative Multi-View Keyframe Prioritization with Foundation Model

Jinwoo Jeon, Dong-Uk Seo, Eungchang Mason Lee, Hyun Myung

KAIST InnoCORE LLM, KAIST, Daejeon, 34141, Republic of Korea

6D位姿估计相机位姿多视角

AIM-SLAM针对基础几何模型用于单目稠密SLAM时常按相邻帧或固定窗口选视角、冗余高且几何信息不足的问题,提出SIGMA按体素重叠与信息增益自适应挑选多视角关键帧,并结合联合多视角Sim(3)优化提升无标定相机位姿一致性。TUM RGB-D和EuRoC实验显示其在未标定设置下取得最佳或领先的位姿精度,并改善稠密重建细节与全局一致性。

MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer Figure 1
arXiv preprint2026-03-06

MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer

Junton Fang, Zequn Chen, Weiqi Zhang, Donglin Di, Xuancheng Zhang, Chengmin Yang, Yu-Shen Liu School of Software, Beijing, China, Li Auto fangjt21@mails.tsinghua.edu.cn, chenzequn@lixiang.com, zwq23@mails.tsinghua.edu.cn @lixiang.com, liuyushen@tsinghua.edu.cn

School of Software, Tsinghua University, Beijing, China Li Auto

6D位姿估计三维重建

MoRe瞄准动态场景中运动物体会破坏相机位姿、而优化式4D重建难以实时的问题,提出单目视频前馈式4D重建Transformer。其关键在于通过attention-forcing在训练中分离动态运动与静态结构,并用分组因果注意力和类BA流式细化保持长序列时序一致性。实验称其在多个动态重建基准上取得高质量结果和较高效率,但部分增益可能来自大规模动静态数据微调。

EgoPoseFormer v2: Accurate Egocentric Human Motion Estimation for AR/VR Figure 1
CVPR 20262026-03-04

EgoPoseFormer v2: Accurate Egocentric Human Motion Estimation for AR/VR

Zhenyu Li, Sai Kumar Dwivedi, Filip Maric, Carlos Chacon, Nadine Bertsch, Filippo Arcadu, Tomas Hodan, Michael Ramamonjisoa, Peter Wonka, Amy Zhao, Robin Kips, Cem Keskin, Anastasia Tkach, Chenhongyi Yang

Meta, KAUST, Max Planck Institute for Intelligent Systems

6D位姿估计

面向 AR/VR 头戴视角下身体可见性低、遮挡多且标注稀缺的问题,EgoPoseFormer v2 将单一身份/头显条件化查询、投影引导的多视角空间细化与因果时间注意力做成端到端 Transformer,并用不确定性感知的教师—学生自动标注扩展到海量未标注帧。EgoBody3M 上其 0.8ms GPU 延迟下较两类 SOTA 提升 12.2%/19.4% 精度、显著降低抖动,自动标注进一步改善手腕 MPJPE。

Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancements Figure 1
arXiv preprint2026-03-04

Yolo-Key-6D: Single Stage Monocular 6D Pose Estimation with Keypoint Enhancements

Kemal Alperen Çetiner, Hazım Kemal Ekenel ASELSAN, Aerospace Technologies, Division of Engineering, UAE @itu.edu.tr

Istanbul Technical University, Department of Computer Engineering, Türkiye, New York University Abu Dhabi, Division of Engineering, UAE

6D位姿估计

针对机器人和 XR 中单目 6D 位姿估计对低延迟的需求,Yolo-Key-6D 用单阶段 YOLO 框架直接预测深度、旋转和位姿,并加入 3D 包围盒角点 2D 投影回归作为辅助几何监督,旋转采用 9D 表示经 SVD 投影到 SO(3) 以稳定训练。在 LINEMOD / Occluded 上 ADD(-S) 0.1d 达 96.24% / 69.41%,约 63 FPS,显示出速度与精度的折中。

TreeLoc++: Robust 6-DoF LiDAR Localization in Forests with a Compact Digital Forest Inventory Figure 1
arXiv preprint2026-03-04

TreeLoc++: Robust 6-DoF LiDAR Localization in Forests with a Compact Digital Forest Inventory

Minwoo Jung 1 ^{ }, Dongjae Lee 1 ^{ }, Nived Chebrolu 2 ^{ }, Haedam Oh 2 ^{ }, Maurice Fallon 2 ^{ }, Ayoung Kim 1 ^{ }

Department of Mechanical Engineering, Seoul National University, Seoul, South Korea, Oxford Robotics Institute, Department of Engineering Science, University of Oxford, Oxford, UK

6D位姿估计点云

面向林下 GNSS 不可靠、稠密点云地图存储维护成本高且易受树木重复结构干扰的问题,TreeLoc++直接以数字森林清查中的树干轴和胸径等紧凑属性做全局定位;通过加入成对距离直方图、DBH 过滤、航向一致内点选择和受约束 6DoF 优化,减少结构混淆并稳定姿态估计。在跨三数据集、四国的 27 条序列上达到厘米级精度,且用约 250KB 地图覆盖 7.98km 轨迹,并验证了两年间隔的长期鲁棒性。

Touch2Insert: Zero-Shot Peg Insertion by Touching Intersections of Peg and Hole Figure 1
arXiv preprint2026-03-04

Touch2Insert: Zero-Shot Peg Insertion by Touching Intersections of Peg and Hole

Masaru Yajima, Yuma Shin, Rei Kawakami, Asako Kanezaki, Kei Ota

Kei Ota is with Mitsubishi Electric, Kanagawa, Japan

6D位姿估计

面向工业连接器插入中遮挡、未知几何和亚毫米对准难题,Touch2Insert 将触觉图像视为局部截面几何观测,从一次接触重建 peg 与孔的截面并通过点云配准估计 SE(2) 相对位姿,无需任务训练或 CAD 先验。实验显示其在仿真中达到亚毫米位姿精度,真实机器人三类连接器平均插入成功率为 86.7%。

Geometry-Guided Reinforcement Learning for Multi-view Consistent 3D Scene Editing Figure 1
arXiv preprint2026-03-03

Geometry-Guided Reinforcement Learning for Multi-view Consistent 3D Scene Editing

Jiyuan Wang, Chunyu Lin, Lei Sun, Zhi Cao, Yuyang Yin, Lang Nie, Zhenlong Yuan, Xiangxiang Chu, Yunchao Wei, Kang Liao, Guosheng Lin

6D位姿估计多视角

针对2D扩散编辑迁移到3D场景时多视角不一致、且缺少3D一致编辑配对数据的问题,论文提出RL3DEdit:不再直接监督生成一致视图,而是用VGGT作为几何验证器,将置信图和相机位姿误差转为强化学习奖励,并用锚定策略保持单视角编辑质量。实验显示其在无需逐场景优化的单次推理下提升编辑质量与多视角一致性,速度较既有方法超过2倍。

Self-supervised Domain Adaptation for Visual 3D Pose Estimation of Nano-drone Racing Gates by Enforcing Geometric Consistency Figure 1
arXiv preprint2026-03-03

Self-supervised Domain Adaptation for Visual 3D Pose Estimation of Nano-drone Racing Gates by Enforcing Geometric Consistency

Nicholas Carlotti, Michele Antonazzi, Elia Cereda, Mirko Nava, Nicola Basilico, Daniele Palossi, Alessandro Giusti

6D位姿估计仿真到现实

针对纳米无人机竞速门6D位姿从仿真迁移到真实时因低质灰度相机、运动模糊等造成的 sim-to-real 退化,论文用无人机真实飞行序列和机载里程计自监督微调:约束不同时刻图像预测的门相对位姿与无人机运动在几何上一致。该方法无需动捕或人工标注,10分钟真实数据即可见效,位置误差约为x/y/z 26/28/10 cm、航向13°,较基线位置和姿态分别提升40%与37%,并可在Crazyflie上33 FPS运行。

Tracing Back Error Sources to Explain and Mitigate Pose Estimation Failures Figure 1
arXiv preprint2026-03-03

Tracing Back Error Sources to Explain and Mitigate Pose Estimation Failures

Loris Schneider, Yitian Shi, Rosa Wolf, Carolin Brenner, Rudolph Triebel, Rania Rayyes

Karlsruhe Institute of Technology (KIT), Karlsruhe, German Aerospace Center (DLR)

6D位姿估计

面向机器人抓取中ICP易受遮挡、初始化偏差和真实深度噪声影响而失败的问题,论文不再追求单一大模型兜底,而是把6D位姿估计拆成失败预测、误差源归因与按需恢复:用MLP预测抓取风险,PointBERT区分噪声/遮挡/坏初始化,并加入面向真实噪声的点云重建等策略。实机结果显示,失败检测准确率80.5%,真实误差归因83.83%,整体抓取成功率接近FoundationPose,噪声场景更高且计算更轻。

Tensegrity Robot Endcap-Ground Contact Estimation with Symmetry-aware Heterogeneous Graph Neural Network Figure 1
arXiv preprint2026-03-03

Tensegrity Robot Endcap-Ground Contact Estimation with Symmetry-aware Heterogeneous Graph Neural Network

Wenzhe Tong, Yicheng Jiang, Chi Zhang, Maani Ghaffari, Xiaonan Huang

University of Michigan

6D位姿估计机器人操作

针对张拉整体机器人接触分布柔顺、难以加装接触传感器而影响位姿估计的问题,论文将端盖、缆绳和杆件建模为异构图,并把三杆结构的 D3 对称性嵌入消息传递,直接由 IMU 与缆长历史预测接触,再接入接触辅助 InEKF。仿真中在仅用 20% 训练数据时较 CNN/MI-HGNN 最高提升约 15% 准确率和 5% F1,位姿漂移接近真值接触;但推理较慢、假阳性偏高,实机效果仍待验证。

Biomechanically Accurate Gait Analysis: A 3d Human Reconstruction Framework for Markerless Estimation of Gait Parameters Figure 1
arXiv preprint2026-03-03

Biomechanically Accurate Gait Analysis: A 3d Human Reconstruction Framework for Markerless Estimation of Gait Parameters

Akila Pemasiri, Ethan Goan, Glen Lichtwark, Robert W. Schuster, Luke Kelly, Clinton Fookes

6D位姿估计人体姿态三维重建医学/手术

针对传统标记式步态分析成本高、场景受限,而通用姿态关键点又缺乏生物力学对应关系的问题,论文提出从多视角视频重建 SMPL/3D人体形状,提取类似动捕标记的解剖学 marker,并接入 OpenSim 估计时空与关节运动学参数。BioCV 上与真实 marker 对比显示一致性较强,且优于仅用姿态估计关键点的方案,但具体增益在多大程度来自 scaling / 数据条件仍需更多说明。

Preoperative-to-intraoperative Liver Registration for Laparoscopic Surgery via Latent-Grounded Correspondence Constraints Figure 1
arXiv preprint2026-03-02

Preoperative-to-intraoperative Liver Registration for Laparoscopic Surgery via Latent-Grounded Correspondence Constraints

Ruize Cui, Jialun Pei, Haiqiao Wang, Jun Zhou, Jeremy Yuen-Chun Teoh, Pheng-Ann Heng, Jing Qin

6D位姿估计医学/手术

面向腹腔镜肝脏 AR 导航中部分可见、遮挡和非刚性形变导致的术前 3D 与术中 2D 配准不稳问题,Land-Reg 将可解释的潜在空间支撑 2D-3D 地标对应作为核心约束:先用跨模态潜在对齐和不确定性重叠地标检测估计刚体位姿,再用重投影、局部等距和渲染掩膜约束形变。P2ILF 实验显示其在刚体位姿和非刚性重建上优于对比方法。

MLRecon: Robust Markerless Freehand 3D Ultrasound Reconstruction via Coarse-to-Fine Pose Estimation Figure 1
arXiv preprint2026-03-01

MLRecon: Robust Markerless Freehand 3D Ultrasound Reconstruction via Coarse-to-Fine Pose Estimation

Yi Zhang, Puxun Tu, Kun Wang, Yulin Yan, Tao Ying, Xiaojun Chen

6D位姿估计手部姿态三维重建

针对徒手三维超声中标记式成本高、探头外挂传感器侵入、纯图像方法易漂移的问题,MLRecon用单个商用RGB-D相机结合FoundationPose/SAM类基础模型实现无标记6D探头跟踪,并加入视觉散度检测与自动重初始化,以及分离高频抖动和低频偏差的两阶段位姿精炼网络;实验在复杂轨迹上最低平均位置误差0.88 mm,重建表面精度达到亚毫米级。

TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstruction Figure 1
arXiv preprint2026-02-28

TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstruction

Yihui Li, Chengxin Lv, Zichen Tang, Hongyu Yang, Critical Software Environment, Beijing, China School of Computer Science, Engineering, China School of Artificial Intelligence, China @buaa.edu.cn

State Key Laboratory of Complex and Critical Software Environment, Beijing, China, School of Computer Science and Engineering, Beihang University, China, School of Artificial Intelligence, Beihang University, China

6D位姿估计三维重建高斯泼溅

TokenSplat针对现有前馈3DGS依赖已知相机位姿、无位姿方法中姿态与场景特征纠缠以及像素级高斯冗余的问题,提出在token空间做跨视角语义对齐与多尺度聚合,并用可学习相机token和非对称双流解码器约束位姿/图像信息交互。实验显示其在无位姿多视图输入下提升重建质量、新视角合成效果和相机位姿估计精度。

COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation Figure 1
arXiv preprint2026-02-28

COG: Confidence-aware Optimal Geometric Correspondence for Unsupervised Single-reference Novel Object Pose Estimation

Yuchen Che, Jingtu Wu, Hao Zheng, RIKEN, hao.zheng@riken.jp

Institute of Science Tokyo, Tohoku University

6D位姿估计物体位姿未知物体

面向单参考图像的未知物体6D位姿估计,论文针对遮挡、视角变化下离散一对一匹配易塌缩且不可微的问题,提出COG将跨视图对应建模为置信度感知最优传输,把点级置信度作为边缘分布并结合DINO等语义先验,再用加权SVD求位姿。实验显示无监督版本已接近监督方法,加入监督后进一步超过现有方法。

UFO-4D: Unposed Feedforward 4D Reconstruction from Two Images Figure 1
arXiv preprint2026-02-27

UFO-4D: Unposed Feedforward 4D Reconstruction from Two Images

Junhwa Hur, Charles Herrmann, Songyou Peng, Philipp Henzler, Zeyu Ma Todd Zickler, Deqing Sun Google

Google Princeton University Harvard University

6D位姿估计三维重建

面向机器人和自动驾驶中从随手拍摄图像恢复动态场景的问题,UFO-4D针对现有方法依赖慢速测试时优化、或只处理单一任务的局限,提出从两张未标定位姿图像一次前向预测动态3D Gaussian和相机相对位姿。其关键在于用同一显式4D表示可微渲染外观、深度与运动,使自监督合成损失与几何/运动监督相互正则化。实验称在Stereo4D和KITTI等基准上几何、运动与位姿联合估计优于先前方法,EPE最多降低约3倍,并支持新视角与时间插值。

AHAP: Reconstructing Arbitrary Humans from Arbitrary Perspectives with Geometric Priors Figure 1
arXiv preprint2026-02-27

AHAP: Reconstructing Arbitrary Humans from Arbitrary Perspectives with Geometric Priors

Xiaozhen Qiao, Wenjia Wang, Zhiyuan Zhao, Jiacheng Sun, Ping Luo, Hongyuan Zhang, Xuelong Li

6D位姿估计

针对多视角人体重建常依赖相机标定或测试时优化、难以扩展到未标定多人的问题,AHAP将跨视角身份关联、SMPL回归与场景几何放入一次前向推理:用可学习人物查询和软分配做身份匹配,结合重投影约束与多视角三角化缓解遮挡和深度歧义。在 EgoHumans、EgoExo4D 上,其世界坐标人体重建和相机位姿估计具备竞争力,并比优化式方法快约180倍。

Egocentric Visibility-Aware Human Pose Estimation Figure 1
arXiv preprint2026-02-27

Egocentric Visibility-Aware Human Pose Estimation

Peng Dai, Yu Zhang, Yiqiang Feng, Zhen Fan, Yang Zhang PICO @bytedance.com

6D位姿估计人体姿态

本文针对头戴式第一视角人体姿态估计中关键点因自遮挡和视场受限而不可见、却被现有方法同等监督的问题,构建含300万帧且43.5万帧带可见性标注的Eva-3M,并为EMHI补充标注;方法EvaPose将可见性预测、基于可见性的损失加权、VQ-VAE姿态先验与时空注意力结合,在Eva-3M和EMHI上取得SOTA,说明增益主要来自显式建模不可见关键点及新增标注数据。

Velocity and stroke rate reconstruction of canoe sprint team boats based on panned and zoomed video recordings Figure 1
arXiv preprint2026-02-26

Velocity and stroke rate reconstruction of canoe sprint team boats based on panned and zoomed video recordings

Julian Ziegler, Daniel Matthes, Finn Gerdts, Patrick Frenzel, Torsten Warnke, Matthias Englert, Tina Kövari, Mirco Fuchs

6D位姿估计三维重建

针对皮划艇竞速中 GPS 难以覆盖所有参赛者、人工视频量测又受平移变焦和斜视角影响的问题,论文将基于浮标网格的单应性定位扩展到 K1–K4/C1–C2:用 YOLOv8 检测浮标与运动员,结合 U-Net 船尖校准学习艇型/座位偏移,并用光流维持多人艇跟踪,同时从姿态或检测框提取桨频。与精英比赛 GPS 对比,速度 MAPE 为 0.011、桨频 MAPE 为 0.009,相关性约 0.97。

CRAG: Can 3D Generative Models Help 3D Assembly? Figure 1
arXiv preprint2026-02-26

CRAG: Can 3D Generative Models Help 3D Assembly?

Zeyu Jiang, Sihang Li, Siqi Tan, Chenyang Xu, Juexiao Zhang, Julia Galway-Witham, Xue Wang, Scott A. Williams, Radu Iovita, Chen Feng, Jing Zhang

6D位姿估计

针对现有3D装配多被当作6D位姿估计、难以处理缺失几何的问题,CRAG将碎片重组与完整形状生成联合建模:借用TripoSG的VAE共享潜空间,在流匹配框架中同时去噪SE(3)位姿和整体形状latent,并用双向注意力Joint Adapter让碎片证据与全局形状假设互相修正。实验显示其在PartNeXt、Breaking Bad及新骨骼碎片数据上达到SOTA,尤其提升缺件和歧义场景下的装配鲁棒性。

WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos Figure 1
arXiv preprint2026-02-25

WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos

Yufei Ye, Jiaman Li, Ryan Rong, Amazon FAR (Frontier AI

Stanford University Amazon FAR (Frontier AI & Robotics)

6D位姿估计手部姿态

WHOLE针对第一视角操作视频中强遮挡、相机大运动以及物体出入视野导致的手和物体轨迹不一致问题,在已知物体模板和metric-SLAM结果下,将手部姿态与物体6D位姿作为耦合运动来重建。其核心是学习扩散式手-物交互运动先验,并用分割掩码与VLM接触线索在测试时引导生成世界坐标系轨迹。在HOT3D上,该方法相较分别估计手/物再后处理的基线,在手运动、物体6D位姿和相对交互重建上均取得更好结果。

Dream-SLAM: Dreaming the Unseen for Active SLAM in Dynamic Environments Figure 1
arXiv preprint2026-02-25

Dream-SLAM: Dreaming the Unseen for Active SLAM in Dynamic Environments

Xiangqi Meng, Pengxu Hou, Zhenjun Zhao, Javier Civera, Daniel Cremers, Hesheng Wang, Haoang Li

School of Computation, Information and Technology, Technical University of Munich, Munich, Germany

6D位姿估计相机位姿

Dream-SLAM针对主动SLAM依赖现有估计模块、规划短视且难适应动态场景的问题,提出用扩散模型“想象”跨时空图像和未观测但语义合理的结构:前者与真实观测融合以利用动态前景约束相机位姿并改进高斯场景表示,后者辅助长时域探索规划。论文在公开和自采数据上报告其在定位精度、建图质量和探索效率上均优于现有方法。

Protein Graph Neural Networks for Heterogeneous Cryo-EM Reconstruction Figure 1
arXiv preprint2026-02-25

Protein Graph Neural Networks for Heterogeneous Cryo-EM Reconstruction

Jonathan Krook, Axel Janson, Joakim Andén, Melanie Weber, Ozan Öktem

6D位姿估计三维重建

针对连续异质性 cryo-EM 中低信噪声、未知姿态和体密度后建模会放大误差的问题,论文直接重建蛋白 Cα 骨架构象,将主链建成图,用 GNN 自解码器从每张图像的潜变量预测模板位移,并结合可微成像模型、几何正则与 ESL 姿态估计。在两个分子动力学合成数据集上,已知和未知姿态设置下均较同规模 MLP 提升重建精度,表明几何归纳偏置对蛋白链建模有效。

Event-Aided Sharp Radiance Field Reconstruction for Fast-Flying Drones Figure 1
arXiv preprint2026-02-26

Event-Aided Sharp Radiance Field Reconstruction for Fast-Flying Drones

Rong Zou, Marco Cannici, Davide Scaramuzza Robotics, Perception Group, Switzerland

Robotics and Perception Group, University of Zurich, Switzerland

6D位姿估计事件相机三维重建

面向高速无人机巡检中图像严重运动模糊、VIO 位姿漂移导致 NeRF 重建失效的问题,论文将事件流与模糊 RGB 帧共同纳入 NeRF 优化,用连续时间共享轨迹同时建模曝光模糊、融合事件约束并细化事件 VIO 先验。其在合成与真实高速飞行数据上无需真值监督恢复更清晰辐射场和相机轨迹,真实数据相对现有方法提升超过 50%,并发布同步 RGB-事件数据集与代码。

From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection Figure 1
arXiv preprint2026-02-25

From Pairs to Sequences: Track-Aware Policy Gradients for Keypoint Detection

Yepeng Liu, Hao Li, Liwen Yang, Fangzhen Li, Xudi Ge, Yuliang Gu, Kuang Gao, Bing Wang, Guang Chen, Hangjun Ye, Yongchao Xu School of Computer Science, Xiaomi EV whu.edu, xiaomi.com

School of Computer Science, Wuhan University

6D位姿估计

这篇论文针对现有关键点方法以图像对匹配为训练目标、难以保证 SLAM/SfM 中长序列可跟踪性的问题,提出 TraqPoint,将关键点检测建模为序列决策,并用策略梯度直接优化整条轨迹质量。其奖励同时约束多视角局部显著性排序与全局可区分性,使检测点更偏向长期稳定结构。实验显示其在相对位姿、视觉定位/里程计和三维重建等稀疏匹配任务上优于多种 SOTA 方法。

Large-scale Photorealistic Outdoor 3D Scene Reconstruction from UAV Imagery Using Gaussian Splatting Techniques Figure 1
arXiv preprint2026-02-23

Large-scale Photorealistic Outdoor 3D Scene Reconstruction from UAV Imagery Using Gaussian Splatting Techniques

Christos Maikos1, Georgios Angelidis1, Georgios Th. Papadopoulos12

6D位姿估计三维重建高斯泼溅航天器

面向无人机实时感知中视频到可交互三维场景延迟高、NeRF渲染慢的问题,论文将RTMP直播采集、传感器同步融合、相机位姿估计与3D Gaussian Splatting增量优化串成端到端管线,并通过WebSocket/可视化引擎支持AR/VR连续更新。实验称其相较NeRF显著提高渲染性能并降低端到端延迟,重建质量距离线高保真参考约4–7%。

Sample-Efficient Learning with Online Expert Correction for Autonomous Catheter Steering in Endovascular Bifurcation Navigation Figure 1
arXiv preprint2026-02-23

Sample-Efficient Learning with Online Expert Correction for Autonomous Catheter Steering in Endovascular Bifurcation Navigation

Hao Wang, Tianliang Yao, Bo Lu, Zhiqiang Pei, Liu Dong, Lei Ma, Peng Qi

Department of Electronic Engineering, Faculty of Engineering, The Chinese University of Hong Kong, Hong Kong SAR 999077, China, Robotics and Microsystems Center, School of Mechanical and Electric Engineering, Soochow University, Suzhou, Jiangsu 215131, China, State Key Laboratory of Cardiovascular Diseases and Medical Innovation Center, Shanghai East Hospital, School of Medicine, Tongji University 200092, Shanghai, China

6D位姿估计

针对血管分叉处自主导管转向中稀疏奖励、静态模型和样本效率低的问题,论文将SAC与GAIL及在线专家纠偏结合,并用图像分割/骨架中心线提供实时位姿反馈、模糊控制补偿分叉姿态误差。透明血管模型实验中,该方法123轮收敛,比SAC少25.9%,平均位置误差降至基线的83.8%,文中另报告较TD3成功率提升17.33%。

SEAL-pose: Enhancing 3D Human Pose Estimation via a Learned Loss for Structural Consistency Figure 1
arXiv preprint2026-02-23

SEAL-pose: Enhancing 3D Human Pose Estimation via a Learned Loss for Structural Consistency

Yeonsung Kim, Junggeun Do, Seunguk Do, Sangmin Kim, Jaesik Park, Jay-Yoon Lee

6D位姿估计人体姿态

针对3D人体姿态估计中MSE/MPJPE等逐关节损失难以约束骨架结构、易产生不合理姿态的问题,SEAL-pose将可学习的结构能量损失引入训练:用骨架感知的图式loss-net基于2D-3D关节耦合表示评估姿态可信度,并反向指导任意pose-net,测试时无额外开销。在Human3.6M、MPI-INF-3DHP等三个基准和八种骨干上,该方法普遍降低关节误差,并在LSE/BSLE结构指标上提升姿态合理性,甚至优于显式手工结构约束方法。

Learning Positive-Incentive Point Sampling in Neural Implicit Fields for Object Pose Estimation Figure 1
arXiv preprint2026-02-23

Learning Positive-Incentive Point Sampling in Neural Implicit Fields for Object Pose Estimation

Yifei Shi, Boyan Wan, Xin Xu, Kai Xu

6D位姿估计物体位姿

这篇论文针对神经隐式场做6D位姿时“全空间密集采样”会引入大量不可观测、低置信点从而拖累训练的问题,提出SO(3)等变卷积隐式网络与PIPS正激励采样:由教师模型生成伪标签,学习选择高置信且几何稳定的稀疏点。方法在NOCS-REAL275、ShapeNet-C和LineMOD-O上超过已有方法,并在遮挡、未见姿态、噪声和新几何场景中更稳健。

Generative 6D Pose Estimation via Conditional Flow Matching Figure 1
arXiv preprint2026-02-23

Generative 6D Pose Estimation via Conditional Flow Matching

Md. Amir Hamza, Davide Boscaini, Weihang Li, Busam Benjamin, Fabio Poiesi

6D位姿估计

面向机器人操作中的实例级 RGBD 6D 位姿估计,论文针对直接 SE(3) 回归易受对称性影响、局部匹配依赖显著纹理的问题,将任务改写为 R³ 中的条件流匹配。Flose 通过去噪学习模型点到观测的位移场,并融合 DINOv2 语义外观特征与 RANSAC 配准以处理对称歧义和离群点。在 BOP 五个数据集上,相比同为单数据集训练的 PFA 平均 AR 提升 4.5,并以更少模型略优于逐物体训练的 GDRNPP。

Accurate Planar Tracking With Robust Re-Detection Figure 1
arXiv preprint2026-02-23

Accurate Planar Tracking With Robust Re-Detection

Jonas Serych, Jiri Matas Visual Recognition Group, Faculty of Electrical Engineering

Visual Recognition Group, Faculty of Electrical Engineering, Czech Technical University in Prague

6D位姿估计

针对平面目标跟踪在遮挡、出视野、运动模糊或外观变化后难以重新找回的问题,论文将 SAM 2 的长期分割能力与 8 自由度单应位姿估计结合:SAM-H 从分割轮廓拟合四边形并用 DINOv2 消解角点循环歧义,WOFTSAM 再把该重检测结果作为 WOFT 光流精配准的预对齐。实验在 POT-210 和 PlanarTrack 上刷新 SOTA,PlanarTrack 的 p@15 较次优提升 12.4/15.2 个百分点,并补充了更精确的初始位姿标注。

DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces Figure 1
arXiv preprint2026-02-23

DICArt: Advancing Category-level Articulated Object Pose Estimation in Discrete State-Spaces

Li Zhang : 1, Mingyu Mei, Ailing Wang, Xianhui Meng, Yan Zhong, Xinyuan Song, Liu Liu, Rujing Wang, Zaixing He, Technology of China, mingyumei@zju.edu.cn

University of Science and Technology of China Shanghai Jiao Tong University, Zhejiang University East China Normal University Peking University Emory University, Hefei University of Technology Jianghuai Advance Technology Center, Anhui Provincial Key Laboratory of Humanoid Robots

6D位姿估计物体位姿类别级位姿

面向关节物体类别级6D位姿估计,论文指出连续回归搜索空间大且难编码运动学约束,易受遮挡影响。DICArt将姿态离散化为条件离散扩散过程,并用可变flow decider在去噪与重置间动态选择,结合层级运动学耦合按父子部件估计姿态。实验覆盖合成、半合成和真实数据,报告在APE任务上优于现有方法且鲁棒性更好。

MultiDiffSense: Diffusion-Based Multi-Modal Visuo-Tactile Image Generation Conditioned on Object Shape and Contact Pose Figure 1
arXiv preprint2026-02-22

MultiDiffSense: Diffusion-Based Multi-Modal Visuo-Tactile Image Generation Conditioned on Object Shape and Contact Pose

Sirine Bhouri, Lan Wei, Jian-Qing Zheng, Dandan Zhang

6D位姿估计

针对多种视觉触觉传感器的对齐数据采集昂贵且以往生成方法多限于单模态的问题,MultiDiffSense用一个扩散框架统一生成ViTac、TacTip、ViTacTip图像,并以CAD深度图和含传感器类型、4DoF接触位姿的结构化提示进行几何约束。实验在已见/新物体和未见姿态上较Pix2Pix显著提升SSIM;50%合成数据混合真实数据还能在下游3DoF位姿估计中基本维持性能,显示其可减少真实采集需求。

WiCompass: Oracle-driven Data Scaling for mmWave Human Pose Estimation Figure 1
arXiv preprint2026-02-21

WiCompass: Oracle-driven Data Scaling for mmWave Human Pose Estimation

Bo Liang ℙ ^{ {$ $}}, Chen Gong ℙ ^{ {$ $}}, Haobo Wang ℙ ^{ {$ $}}, Qirui Liu ℙ ^{ {$ $}}, Rungui Zhou ℙ ^{ {$ $}}, Fengzhi Shao 𝕌 ^{ {$ $}}, Yubo Wang 𝕌 ^{ {$ $}}, Wei Gao ℙ ​ 𝕀 ^{ {$ $}}, Kaichen Zhou 𝕄 ^{ {$ $}}, Guolong Cui 𝕌 ^{ {$ $}}, Chenren Xu ℙ ^{ {$ $}} 𝕂 ^{ {$ $}} 🖂 ^{ }

6D位姿估计人体姿态

本文针对毫米波人体姿态估计在分布变化下泛化差、盲目扩数据低效的问题,指出瓶颈主要在动作覆盖而非模型容量。WiCompass利用大规模MoCap构建姿态空间“oracle”,用kNN诊断冗余与缺口,并闭环优先采集缺失动作。实验显示在相同预算下提升OOD精度,且相比常规采集具备更好的数据扩展效率。

Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervision Figure 1
arXiv preprint2026-02-19

Multi-Modal Monocular Endoscopic Depth and Pose Estimation with Edge-Guided Self-Supervision

Xinwei Ju, Rema Daher, Danail Stoyanov, Sophia Bano, London, UK @ucl.ac.uk

UCL Hawkes Institute, Department of Computer Science, University College London, London, UK

6D位姿估计彩色深度

针对结肠镜单目深度与位姿估计中真实标注稀缺、组织纹理弱和光照复杂的问题,论文提出PRISM自监督框架,将肠褶边缘图与亮度/阴影分解作为结构和光照先验,并用边缘相似损失分阶段细化位姿。实验显示其深度估计达到或超过现有方法,位姿表现相当;同时指出真实数据自监督优于幻体监督,视频采样帧率对效果影响很大。

NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting Figure 1
arXiv preprint2026-02-19

NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting

Jiwei Shan, Zeyu Cai, Yirui Li, Yongbo Chen, Lijun Han, Yun-hui Liu, Hesheng Wang, Shing Shin Cheng

6D位姿估计相机位姿三维重建高斯泼溅

针对内窥镜软组织持续形变使相机自运动与场景形变强耦合、导致单目 SLAM 漂移和重建粗糙的问题,NRGS-SLAM 在 3D Gaussian 地图中为每个高斯学习形变概率,并用贝叶斯自监督、低形变区域优先跟踪、可变形建图和鲁棒几何先验来解耦。多组公开内窥镜数据上,相机位姿 RMSE 最高降低约 50%,重建也更具照片真实感。

Benchmarking the Effects of Object Pose Estimation and Reconstruction on Robotic Grasping Success Figure 1
arXiv preprint2026-02-19

Benchmarking the Effects of Object Pose Estimation and Reconstruction on Robotic Grasping Success

Varun Burde, Pavel Burget, Torsten Sattler Faculty of Electrical Engineering, Robotics, Cybernetics, Czechia

Faculty of Electrical Engineering, Czech Technical University in Prague, Czechia, Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, Czechia

6D位姿估计物体位姿机器人操作数据集/基准三维重建

论文针对6D位姿估计和三维重建常用几何指标难以反映抓取成败的问题,构建大规模物理仿真基准,将重建网格上生成的抓取在真实模型上执行,联合评估位姿误差、几何伪影与夹爪影响。结果显示,重建缺陷会显著减少可用抓取候选,但在位姿准确时对最终成功率影响较小;抓取成败主要受三维空间/平移误差支配,2D投影和纯旋转误差预测力较弱。

Markerless 6D Pose Estimation and Position-Based Visual Servoing for Endoscopic Continuum Manipulators Figure 1
arXiv preprint2026-02-18

Markerless 6D Pose Estimation and Position-Based Visual Servoing for Endoscopic Continuum Manipulators

Junhyun Park, Chunggil An, Myeongbo Park, Ihsan Ullah, Sihyeong Park, Minho Hwang

6D位姿估计

面向内镜连续体机械臂因迟滞、柔顺和远端传感受限导致的位姿反馈与闭环控制难题,论文提出无标记双目6D位姿估计到PBVS的一体化框架:用物理约束照片级仿真生成标注,融合分割、关键点、热图和框,并以单次前向渲染细化替代迭代优化,结合无标签自监督域适配。实机1000样本达0.83 mm、2.76°位姿误差,闭环轨迹误差2.07 mm、7.41°,较开环显著降低。

Markerless Robot Detection and 6D Pose Estimation for Multi-Agent SLAM Figure 1
arXiv preprint2026-02-18

Markerless Robot Detection and 6D Pose Estimation for Multi-Agent SLAM

Markus Rüggeberg, Maximilian Ulmer, Maximilian Durner, Wout Boerdijk, Marcus Müller, Rudolph Triebel, Riccardo Giubilato

Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Weßling, Germany

6D位姿估计相机位姿机器人操作

多机器人 SLAM 在弱纹理、视角差异和强光户外场景中难以建立跨机器人数据关联,传统 AprilTag/ArUco 又受距离、朝向和反光限制。本文将已知机器人 CAD/外形先验与深度 6D 位姿估计结合,进行无标记相互检测,并把相对变换直接接入去中心化 SLAM。实验在类行星野外数据上验证,相比标记方案扩大了可用观测并提升队伍相对定位精度。

YOLO26: A Comprehensive Architecture Overview and Key Improvements Figure 1
arXiv preprint2026-02-16

YOLO26: A Comprehensive Architecture Overview and Key Improvements

Priyanto Hidayatullah, Refdinal Tubagus

a Computer Engineering and Informatics Department, Politeknik Negeri Bandung, Kab. Bandung Barat, Indonesia

6D位姿估计

本文动机是弥补 YOLO26 官方文档缺少完整架构图和代码级解释的问题,帮助研究者理解其在检测、姿态等任务中的实现。作者从源码梳理出其并非颠覆式重构,而是在 YOLO 主干上加入 SPPF shortcut、末端 C3k2 的 PSABlock,并通过移除 DFL、端到端 NMS-free 头、ProgLoss+STAL 与 MuSGD 简化训练/推理。文中称 CPU 推理提速 43%、小目标更准且更适合边缘设备,但定量验证多依赖声称对比,增益来源未充分拆解。

Learning Proposes, Geometry Disposes: A Modular Framework for Efficient Spatial Reasoning Figure 1
arXiv preprint2026-02-16

Learning Proposes, Geometry Disposes: A Modular Framework for Efficient Spatial Reasoning

Haichao Zhu, Zhaorui Yang, Qian Zhang

Department of Computer Science and Engineering, University of California, Riverside

6D位姿估计

针对学习模型应否取代几何估计这一问题,论文以RGB-D相对位姿为例提出“学习提议、几何裁决”的模块化范式:VGGT生成深度/位姿假设,点到平面ICP负责验证与估计。TUM实验显示,学习位姿单独不可靠,内参不对齐的学习几何会伤害性能;只有对齐后的学习深度经几何后端处理,才在中等难度刚性场景带来稳定改进。

Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flow Figure 1
arXiv preprint2026-02-15

Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flow

Shenhan Qian, Ganlin Zhang, Shangzhe Wu, Daniel Cremers

Technical University of Munich, University of Cambridge

6D位姿估计三维重建

Flow4R针对动态场景中几何重建、相机运动与物体跟踪常被拆成脆弱流水线的问题,提出以相机坐标系下的场景流作为统一表示。模型从双视图一次前向预测3D点、场景流、位姿权重和置信度,用权重图隐式分解相机运动,避免显式位姿头和BA,并可在序列中做4D重建与跟踪。论文报告其在相关任务上达到SOTA,但具体增益中数据混训与表示设计的贡献仍需消融确认。

RPGD: RANSAC-P3P Gradient Descent for Extrinsic Calibration in 3D Human Pose Estimation Figure 1
arXiv preprint2026-02-14

RPGD: RANSAC-P3P Gradient Descent for Extrinsic Calibration in 3D Human Pose Estimation

Zhanyu Tuo

Sorbonne university

6D位姿估计人体姿态

针对3D人体姿态数据采集中MoCap坐标系与RGB相机外参难以在无标定物、噪声和遮挡条件下可靠对齐的问题,RPGD将自然人体运动作为动态标定目标,先用RANSAC-P3P获得鲁棒初值,再以解析梯度下降细化重投影误差。在MPI-INF-3DHP、Human3.6M、AIST++及野外数据上,其外参精度接近原始标定,并达到亚像素级2D MPJPE。

MDE-VIO: Enhancing Visual-Inertial Odometry Using Learned Depth Priors Figure 1
arXiv preprint2026-02-11

MDE-VIO: Enhancing Visual-Inertial Odometry Using Learned Depth Priors

Arda Alniak, Sinan Kalkan, Mustafa Mert Ankarali, Afsar Saranli, Abdullah Aydin Alatan

6D位姿估计相机位姿彩色深度

针对单目 VIO 在低纹理、快速运动场景中特征稀疏且易发散的问题,MDE-VIO 将学习式单目深度先验嵌入 VINS-Mono:前端尝试深度注入跟踪,后端加入仿射不变深度一致性与序关系约束,并用方差门控抑制深度闪烁。实验显示视频式、时序稳定的深度先验更可靠,在 TartanGround 和 M3ED 上 ATE 最高降低 28.3%,并能避免部分困难序列发散。

Resource-Efficient RGB-Only Action Recognition for Edge Deployment Figure 1
arXiv preprint2026-02-11

Resource-Efficient RGB-Only Action Recognition for Edge Deployment

Dongsik Yoon, Jongeun Kim, Dayeon Lee

Korea Development Institute

6D位姿估计

面向机器人/边缘场景中动作识别对低时延、低内存和低功耗的需求,本文主张将RGB-only推理作为实际部署目标,避免骨架/深度传感或姿态估计带来的额外开销。方法以X3D式骨干结合Temporal Shift,并加入移动端倒残差块、选择性时序适配和无参数注意力。NTU RGB+D 60/120实验显示其在精度与效率间较均衡,Jetson Orin Nano部署分析也表明模型占用和资源使用低于若干RGB基线。

Perception with Guarantees: Certified Pose Estimation via Reachability Analysis Figure 1
arXiv preprint2026-02-10

Perception with Guarantees: Certified Pose Estimation via Reachability Analysis

Tobias Ladner12, Yasser Shoukry2, Matthias Althoff1

6D位姿估计

面向自动驾驶等安全关键场景,论文指出普通视觉/激光/GPS定位只给点估计且可能受噪声、攻击或干扰影响,难以支撑形式化安全验证。其核心是用已知目标几何与单目事件相机图像,通过可达性分析和神经网络形式化验证对6D位姿集合给出保守包围,并显式纳入位姿、相机参数和几何不确定性。合成与真实噪声图像实验显示,该方法可在约一秒量级给出较紧的认证位姿估计,但仍依赖目标清晰可见且主要验证单目标场景。

Finite-time Stable Pose Estimation on TSE(3) using Point Cloud and Velocity Sensors Figure 1
arXiv preprint2026-02-10

Finite-time Stable Pose Estimation on TSE(3) using Point Cloud and Velocity Sensors

Nazanin Safaei Hashkavaei, Abhijit Dongare, Neon Srinivasu, Amit K. Sanyal

Syracuse University

6D位姿估计点云

面向 GNSS 受限自主载具中点云与惯性传感器驱动的实时 6D 位姿估计,本文提出直接定义在 TSE(3)/SE(3) 上的有限时间稳定观测器,用 Morse-Lyapunov 分析避免局部坐标、四元数奇异与 unwinding,并支持仅点云加陀螺的版本。仿真对比 DQMEKF、VPE 及 Zed 2i 实验显示其误差有限时间收敛,含噪时收敛到有界邻域,稳定性和抗噪性优于 DQMEKF。

WiFlow: A Lightweight WiFi-based Continuous Human Pose Estimation Network with Spatio-Temporal Feature Decoupling Figure 1
arXiv preprint2026-02-09

WiFlow: A Lightweight WiFi-based Continuous Human Pose Estimation Network with Spatio-Temporal Feature Decoupling

Yi Dao1, Lankai Zhang1, Hao Liu1, Haiwei Zhang2, Wenbo Wang1

6D位姿估计人体姿态

针对视觉姿态估计的隐私/光照限制,以及现有 WiFi HPE 将 CSI 当图像处理、难以建模连续动作且计算开销较高的问题,WiFlow 用 TCN 与非对称卷积解耦 CSI 时空特征,并以轴向注意力建模关键点内部筛选和骨架依赖。在自采 36 万组连续 CSI-姿态数据上,模型以 2.23M 参数达到 PCK@20 97.25%、MPJPE 0.007 m,显示轻量化与精度兼顾。

Gesture Matters: Pedestrian Gesture Recognition for AVs Through Skeleton Pose Evaluation Figure 1
arXiv preprint2026-02-09

Gesture Matters: Pedestrian Gesture Recognition for AVs Through Skeleton Pose Evaluation

Mahdi, Alif Rizqullah, Rezaei, Merat, Natasha

Institute for Transport Studies, University of Leeds

6D位姿估计

面向自动驾驶在无信号路口或僵持场景中难以理解行人非语言意图的问题,论文基于真实 WIVW 视频构建行人手势识别流程,将手势归并为 Stop、Go、Thank & Greet、No Gesture 四类,并从归一化2D骨架关键点提取76个静态与动态特征。核心洞察是手部位置、手部速度和双手距离对区分类别最关键,最终分类准确率达到87%。

Reliability-aware Execution Gating for Near-field and Off-axis Vision-guided Robotic Alignment Figure 1
arXiv preprint2026-02-09

Reliability-aware Execution Gating for Near-field and Off-axis Vision-guided Robotic Alignment

Ning Hu, Senhao Cao, Maochen Li

6D位姿估计机器人操作

这篇论文针对近距离、离轴视觉引导对准中“位姿估计误差不大但执行仍失败”的问题,指出失败来自几何退化与运动链路对小误差的确定性放大,而非单纯感知噪声。作者提出不改动6D位姿估计器的执行级可靠性门控,在执行前评估几何一致性与风险,并拒绝或缩放高风险更新。UR5实机实验显示,该机制在平均位姿精度基本不变的情况下提升成功率、降低执行方差并抑制尾部失败风险。

RealSynCol: a high-fidelity synthetic colon dataset for 3D reconstruction applications Figure 1
arXiv preprint2026-02-09

RealSynCol: a high-fidelity synthetic colon dataset for 3D reconstruction applications

Chiara Lena, Davide Milesi, Alessandro Casella, Luca Carlini, Joseph C. Norton, James Martin, Bruno Scaglioni, Keith L. Obstein, Roberto De Sire, Marco Spadaccini, Cesare Hassan, Pietro Valdastri, Elena De Momi

6D位姿估计仿真到现实数据集/基准三维重建

针对结肠镜三维重建缺少大规模真实深度与位姿标注、合成到真实域差距大的问题,RealSynCol从10例CT提取结肠几何,在仿真内镜环境中加入更真实的血管纹理与运动设置,提供28130帧及深度、光流、网格和相机轨迹标注;深度与位姿基准显示,其真实性和形状/纹理多样性可提升在临床图像上的泛化表现。

Research on a Camera Position Measurement Method based on a Parallel Perspective Error Transfer Model Figure 1
arXiv preprint2026-02-08

Research on a Camera Position Measurement Method based on a Parallel Perspective Error Transfer Model

Ning Hu, Shuai Li, Jindong Tan

Associate Professor, Department of Environmental Engineering Sciences, University of Florida, Gainesville, FL 32611, USA, Professor, Department of Mechanical, Aerospace and Biomedical Engineering, University of Tennessee, Knoxville, TN

6D位姿估计

本文针对近距离机器人/航天/水下等场景中 PnP 位姿估计易受强透视和非均匀图像噪声放大的问题,提出基于平行透视近似的几何误差传递模型,分析特征布局、深度与位姿不确定性的关系,并将其用于初始化、误差加权 Gauss–Newton 优化及标志点布局设计。仿真和强光、手术灯、水下低照等实拍实验表明,该方法精度与鲁棒性接近主流解析和迭代 PnP,同时保持较高计算效率。

DroneKey++: A Size Prior-free Method and New Benchmark for Drone 3D Pose Estimation from Sequential Images Figure 1
arXiv preprint2026-02-05

DroneKey++: A Size Prior-free Method and New Benchmark for Drone 3D Pose Estimation from Sequential Images

Seo-Bin Hwang, Yeong-Jun Cho

Department of AI Convergence, Chonnam National University, Korea

6D位姿估计数据集/基准

面向反无人机监控中单目估计无人机朝向与位置的需求,论文指出现有方法依赖机体尺寸或3D网格且数据集模型少、泛化验证不足。DroneKey++将关键点检测、机型分类和位姿回归统一起来,用类别嵌入与基于射线的几何推理替代显式尺寸先验,并构建含7类无人机、5万余张合成图的6DroneSyn基准。实验报告旋转MAE 17.34°、平移MAE 0.135 m,GPU 414 FPS,显示实时性较强,但真实场景增益仍可能主要来自数据规模与合成质量。

Shared LoRA Subspaces for almost Strict Continual Learning Figure 1
arXiv preprint2026-02-05

Shared LoRA Subspaces for almost Strict Continual Learning

Prakhar Kaushik, Ankit Vaidya, Shravan Chaudhari, Rama Chellappa, Alan Yuille

Department of Computer Science, Johns Hopkins University

6D位姿估计

面向大模型在连续适配中易遗忘、每任务保存 LoRA 适配器成本高的问题,论文提出 Share:动态维护单一共享低秩子空间,把新数据或已有 LoRA 投影并合并到共同基底中,以近似严格连续学习减少干扰并促进迁移。实验覆盖图像分类、自然语言、3D/6D 位姿估计和文生图,报告相对传统 LoRA 最高约 100× 参数减少、281× 显存节省,性能接近联合训练模型。

NVS-HO: A Benchmark for Novel View Synthesis of Handheld Objects Figure 1
arXiv preprint2026-02-05

NVS-HO: A Benchmark for Novel View Synthesis of Handheld Objects

Musawar Ali, Manuel Carranza-García, Nicola Fioraio, Samuele Salti, Luigi Di Stefano

6D位姿估计手部姿态数据集/基准

针对手持物体在真实交互中仅凭 RGB 难以获得可靠位姿与新视角评测的问题,NVS-HO设计了手持训练序列与ChArUco板评测序列的成对采集,覆盖67个物体,并提供与方法无关的遮罩图像评测协议。基于COLMAP/VGGT位姿和NeRF、Gaussian Splatting的基线显示,现有方法在非受控手持条件下仍有明显性能缺口。

FMPose3D: monocular 3D pose estimation via flow matching Figure 1
arXiv preprint2026-02-05

FMPose3D: monocular 3D pose estimation via flow matching

Ti Wang, Xiaohang Yu

6D位姿估计

针对单目2D到3D位姿提升中的深度歧义、遮挡以及扩散模型采样步数多的问题,FMPose3D将任务建模为条件分布传输,用Flow Matching学习ODE速度场,从高斯噪声快速生成多种3D假设,并以重投影误差近似后验期望的RPEA融合输出。实验在Human3.6M、MPI-INF-3DHP及Animal3D、CtrlAni3D上超过既有方法或达到SOTA。

EgoPoseVR: Spatiotemporal Multi-Modal Reasoning for Egocentric Full-Body Pose in Virtual Reality Figure 1
arXiv preprint2026-02-05

EgoPoseVR: Spatiotemporal Multi-Modal Reasoning for Egocentric Full-Body Pose in Virtual Reality

Haojie Cheng0000-0002-9885-763X, Shaun Jing Heng Ong0009-0005-7430-8467, Shaoyu Cai0000-0001-8808-3442, Aiden Tat Yang Koh0009-0007-5677-7045, Fuxi Ouyang0009-0008-8618-8070, and Eng Tat Khoo 0000-0003-1295-3506

6D位姿估计人体姿态

EgoPoseVR面向消费级VR全身跟踪中仅靠头手信号下肢歧义大、第一视角视觉又易抖动且延迟高的问题,将HMD/手柄运动与头显下视RGB-D通过双流时空编码、跨注意力融合和运动学约束联合推理。论文还构建180万帧同步合成数据,实验显示其精度与稳定性优于现有自我中心姿态方法,并可达97 FPS,真实用户研究也给出更高主观评分。

Geometric Observability Index: An Operator-Theoretic Framework for Per-Feature Sensitivity, Weak Observability, and Dynamic Effects in SE(3) Pose Estimation Figure 1
arXiv preprint2026-02-05

Geometric Observability Index: An Operator-Theoretic Framework for Per-Feature Sensitivity, Weak Observability, and Dynamic Effects in SE(3) Pose Estimation

Joe-Mei Feng, Sheng-Wei Yu : 1

Department of Computer Science and Information Engineering, Tamkang University, New Taipei City, Taiwan

6D位姿估计

本文针对SE(3)位姿估计中单个特征如何影响最终位姿、以及动态点为何在弱可观测场景下被放大的问题,提出几何可观测性指数GOI。其核心是把Lie群影响函数、Gauss-Newton/Fisher曲率和可观测子空间谱分解统一起来,说明小曲率方向会放大特征扰动,并解释纯旋转、低视差等退化。结果给出训练-free的动态特征与弱可观测诊断信号,但主要是算子理论框架,实证增益文中未充分说明。

ShapeGaussian: High-Fidelity 4D Human Reconstruction in Monocular Videos via Vision Priors Figure 1
arXiv preprint2026-02-05

ShapeGaussian: High-Fidelity 4D Human Reconstruction in Monocular Videos via Vision Priors

Zhenxiao Liang, Ning Zhang, Youbao Tang, Ruei-Sung Lin, Qixing Huang, Peng Chang

The University of Texas at Austin

6D位姿估计三维重建高斯泼溅

针对单目视频中人体大幅形变缺少多视角约束、SMPL模板又易受姿态估计误差影响的问题,ShapeGaussian改用模板无关的2D视觉先验:先由分割、相对深度和DensePose等预训练模型建立粗可变形几何,再用神经形变细化动态高斯,并以多参考帧缓解关键点不可见。实验显示其在复杂人体运动下较模板法重建更准确、视觉伪影更少。

IndustryShapes: An RGB-D Benchmark dataset for 6D object pose estimation of industrial assembly components and tools Figure 1
arXiv preprint2026-02-05

IndustryShapes: An RGB-D Benchmark dataset for 6D object pose estimation of industrial assembly components and tools

Panagiotis Sapoutzoglou, Orestis Vaggelis, Athina Zacharia, Evangelos Sartinas, Maria Pateraki

6D位姿估计物体位姿点云彩色深度数据集/基准

面向工业装配中反光、弱纹理、对称和遮挡物体导致现有6D位姿数据集与真实部署脱节的问题,IndustryShapes构建了含5类工业工具/部件的RGB-D基准,分为经典集与扩展集,并首次提供RGB-D静态onboarding序列以支持无模型和序列式新物体位姿估计。作者用EPOS、DOPE、ZebraPose、FoundPose、FoundationPose及检测/分割方法评测,结果显示现有方法在该工业域仍有明显提升空间。

RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation Figure 1
arXiv preprint2026-02-05

RFM-Pose:Reinforcement-Guided Flow Matching for Fast Category-Level 6D Pose Estimation

Diya He, Qingchen Liu, Cong Zhang, Jiahu Qin

6D位姿估计类别级位姿

针对类别级 6D 位姿中对称性带来的多解问题以及扩散式生成采样慢、候选评分与生成割裂的瓶颈,RFM-Pose 用 Flow Matching 替代扩散以减少积分步数,并将采样轨迹建模为 MDP,通过 PPO 和旋转/平移多 critic 价值网络联合优化流场与候选评分。实验显示其在 REAL275、Omni6DPose 上取得较好的精度—效率折中,采样成本显著下降,并可扩展到位姿跟踪。

Differentiable Inverse Graphics for Zero-shot Scene Reconstruction and Robot Grasping Figure 1
arXiv preprint2026-02-04

Differentiable Inverse Graphics for Zero-shot Scene Reconstruction and Robot Grasping

Octavio Arriaga, Proneet Sharma, Jichen Guo, Marc Otto, Siddhant Kadwe, Rebecca Adam Robotics Innovation Center, DFKI GmbH

Robotics Innovation Center, DFKI GmbH

6D位姿估计机器人操作三维重建

面向机器人在未知环境中无需大量训练数据或测试时采样即可感知并抓取新物体,本文提出 DNG:将基础分割模型与物理可微渲染结合,通过单张 RGBD 图和框约束顺序优化网格、光照、材质与 6D 位姿,并用概率椭球初始化和 JAX 可微光追提升可优化性。实验显示其在无模型少样本位姿基准上优于已有方法,并在零样本抓取中验证了重建精度,但推理约需 1 分钟且依赖输入框。

TrajVG: 3D Trajectory-Coupled Visual Geometry Learning Figure 1
arXiv preprint2026-02-04

TrajVG: 3D Trajectory-Coupled Visual Geometry Learning

Xingyu Miao, Weiguang Zhao, Tao Lu, Linning Xu, Mulin Yu, Yang Long, Jiangmiao Pang, Junting Dong

Durham University, University of Liverpool, Shanghai AI Lab

6D位姿估计

TrajVG针对动态视频中前馈多帧重建易因全局参考歧义或局部点图对位姿依赖而漂移的问题,将跨帧对应显式建模为相机坐标系3D轨迹,并用轨迹—点图双向一致性、静态轨迹锚点驱动的位姿一致性及2D伪轨迹自监督训练来耦合几何与相机运动。实验显示其在3D跟踪、位姿估计、点图重建和视频深度上均优于现有前馈基线。

Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models Figure 1
arXiv preprint2026-02-03

Flexible Geometric Guidance for Probabilistic Human Pose Estimation with Diffusion Models

Francis Snelgar, Ming Xu, Stephen Gould, Liang Zheng, Akshay Asthana School of Computing, Canberra, Australia Seeing Machines, Australia

School of Computing, Australian National University, Canberra, Australia

6D位姿估计人体姿态

针对单目2D到3D人体姿态存在深度歧义、遮挡且依赖成对2D-3D训练数据的问题,论文用仅由3D姿态训练的无条件扩散模型作为先验,再以2D关键点热图梯度进行几何引导,解耦检测器与生成器,并可调控多假设多样性、支持姿态补全。在Human3.6M的best-of-m评测中达到无需成对数据方法的SOTA,在MPI-INF-3DHP和3DPW上表现有竞争力。

JRDB-Pose3D: A Multi-person 3D Human Pose and Shape Estimation Dataset for Robotics Figure 1
arXiv preprint2026-02-03

JRDB-Pose3D: A Multi-person 3D Human Pose and Shape Estimation Dataset for Robotics

Sandika Biswas

Monash University, Sharif University

6D位姿估计人体姿态机器人操作数据集/基准

面向机器人在人群环境中的感知与交互,本文指出现有3D人体姿态数据多偏单人、实验室或缺少时序形状标注。JRDB-Pose3D基于移动机器人采集的JRDB,提供多人的SMPL姿态/体型、连续ID、遮挡标签,并继承活动、社交关系、语义分割等标注。数据平均每帧5–10人、最多35人,可用于拥挤遮挡场景下的姿态估计、跟踪和预测评测;具体算法增益文中未充分说明。

Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room Figure 1
arXiv preprint2026-02-02

Self-Supervised Uncalibrated Multi-View Video Anonymization in the Operating Room

Keqi Chen, Vinkle Srivastav, Armine Vardazaryan, Cindy Rolland, Didier Mutter, Nicolas Padoy

University of Strasbourg, CNRS, INSERM, ICube, UMR7357, France, University Hospital of Strasbourg, Strasbourg, France

6D位姿估计多视角

手术室视频匿名化要求几乎不漏检,但现有方法依赖场地标注或相机标定,难以规模部署。本文将全身检测与姿态估计结合,用低阈值候选、时序跟踪和未标定多视角关联找回疑似漏检,并以伪标签迭代自监督适配检测器和姿态模型。在4D-OR及真实手术数据上召回率超过97%,并可训练实时检测器,显著减少人工复核时间。

Superman: Unifying Skeleton and Vision for Human Motion Perception and Generation Figure 1
arXiv preprint2026-02-02

Superman: Unifying Skeleton and Vision for Human Motion Perception and Generation

Xinshun Wang, Peiming Li, Ziyi Wang, Zhongbin Fang, Zhichao Deng, Songtao Wu, Jason Li, Sony R&D Center

Peking University, Sun Yat-sen University, Sony R&D Center, Nanyang Technological University

6D位姿估计

针对人体运动任务中视频感知模型“只读”、运动生成模型难以利用原始视觉输入的割裂问题,Superman将3D骨架运动离散为跨模态语言,核心是引入视觉引导的VQ-VAE运动Tokenizer,用成对的视觉与几何原型构建统一词表,并用单一MLLM处理视频到3D姿态、运动预测和补全。实验在Human3.6M、3DPW等上达到SOTA或竞争结果,文中还报告姿态估计相对强基线有约11%提升。

Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory Figure 1
arXiv preprint2026-02-03

Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory

Ruiqi Wu, Xuanhua He, Meng Cheng, Tianyu Yang, Yong Zhang, Zhuoliang Kang, Xunliang Cai, Xiaoming Wei, Chunle Guo, Chongyi Li, Ming-Ming Cheng

6D位姿估计

该文针对真实视频训练交互式世界模型时位姿噪声、视角回访稀缺和长程注意力成本高的问题,提出无需显式相机位姿的分层记忆压缩 HPMC,并用不确定性感知动作标注与少量高回访数据微调来激活闭环记忆。实验显示其在 1000+ 帧生成中提升空间一致性、动作响应和主观偏好,但部分收益可能来自专门采集的回访数据。

HandMCM: Multi-modal Point Cloud-based Correspondence State Space Model for 3D Hand Pose Estimation Figure 1
arXiv preprint2026-02-02

HandMCM: Multi-modal Point Cloud-based Correspondence State Space Model for 3D Hand Pose Estimation

Wencan Cheng, Gim Hee Lee

National University of Singapore

6D位姿估计手部姿态点云

针对手部自遮挡和手物交互遮挡下关键点拓扑关系难以用静态图建模的问题,HandMCM将RGBD与点云超点特征结合,引入对应关系Mamba和局部几何注入/过滤机制,把关键点间动态运动学关联作为序列关系学习。实验在NYU、DexYCB、HO3D等基准上达到SOTA,误差分别约7.06mm、6.67mm和1.71cm,遮挡场景收益尤为明显。

Visible Light Positioning With Lamé Curve LEDs: A Generic Approach for Camera Pose Estimation Figure 1
arXiv preprint2026-02-02

Visible Light Positioning With Lamé Curve LEDs: A Generic Approach for Camera Pose Estimation

Wenxuan Pan, Yang Yang, Dong Wei, Zhiyu Zhu, Jintao Wang, Huan Wu, Yao Nie

6D位姿估计相机位姿

针对相机可见光室内定位中现有方法依赖单一 LED 形状、难以适配混合灯具的问题,论文用 Lamé 曲线统一表示圆形、矩形、菱形、椭圆等平面 LED,并将位姿估计写成带离线参数库的非线性最小二乘,同时用无对应点 FreePnP 初始化。仿真中位置误差降超 40%、旋转误差降超 25%,实测平均定位精度优于 4 cm。

TreeLoc: 6-DoF LiDAR Global Localization in Forests via Inter-Tree Geometric Matching Figure 1
ICRA 20262026-02-02

TreeLoc: 6-DoF LiDAR Global Localization in Forests via Inter-Tree Geometric Matching

Minwoo Jung, Nived Chebrolu, Lucas Carvalho de Lima, Haedam Oh, Maurice Fallon, Ayoung Kim

6D位姿估计点云

TreeLoc面向GPS退化、遮挡和季节变化严重的森林场景,解决城市式LiDAR定位特征不稳定、地图存储大的问题。其核心洞察是树干位置长期稳定,因而用树轴、基部位置和胸径构成紧凑对象表示,先以TDH做粗检索,再用树中心2D三角描述子和两步几何验证估计6DoF位姿。多森林数据集上其地点识别和定位优于传统与部分学习基线,约50 ms完成定位,地图表示小3–4个数量级。

PandaPose: 3D Human Pose Lifting from a Single Image via Propagating 2D Pose Prior to 3D Anchor Space Figure 1
arXiv preprint2026-02-01

PandaPose: 3D Human Pose Lifting from a Single Image via Propagating 2D Pose Prior to 3D Anchor Space

Jinghong Zheng, Changlong Jiang, Yang Xiao, Jiaqi Li, Haohong Kuang, Hang Xu, Ran Wang, Zhiguo Cao, Min Du, Joey Tianyi Zhou, School of Artificial Intelligence, Automation, Technology School of Journalism, Information Communication, Technology School of Future Technology, Agency for Science, Technology, Research

School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, School of Future Technology, ByteDance Inc, Centre for Frontier AI Research, Technology and Research, Institute of High Performance Computing, Agency for Science, Technology and Research, Singapore

6D位姿估计人体姿态

PandaPose针对单目RGB由2D关键点提升到3D人体姿态时的2D误差传播和自遮挡深度歧义问题,不再做直接关节到关节回归,而是把2D姿态先传播到关节级3D anchor空间,并结合深度感知特征提升与anchor-feature交互解码,进行anchor-to-joint集成预测。在Human3.6M、MPI-INF-3DHP和3DPW上优于图像式SOTA,尤其Human3.6M困难场景PA-MPJPE误差降低14.7%。

Deep Learning Pose Estimation for Multi-Label Recognition of Combined Hyperkinetic Movement Disorders Figure 1
arXiv preprint2026-01-29

Deep Learning Pose Estimation for Multi-Label Recognition of Combined Hyperkinetic Movement Disorders

Laura Cif, Diane Demailly, Gabriella A. Horvàth, Juan Dario Ortigoza Escobar, Nathalie Dorison, Mayté Castro Jiménez, Cécile A. Hubsch, Thomas Wirth, Gun-Marie Hariz, Sophie Huby, Morgan Dornadic, Zohra Souei, Muhammad Mushhood Ur Rehman, Simone Hemm, Mehdi Boulayme, Eduardo M. Moraud, Jocelyne Bloch, Xavier Vasques

6D位姿估计

针对多种亢进性运动障碍常并发、临床视频评估主观且一致性差的问题,论文用YOLOv8提取2D人体关键点,将门诊视频转为运动学时间序列,并结合统计、时域、频域和复杂度特征做患者级多标签识别;通过10秒窗口概率的p90聚合与按标签阈值控制,取得macro-AUPRC 0.821、macro-AUC 0.830、最佳Hamming准确率0.764,提示位姿特征可支持可解释的临床表型筛查,但样本规模较小。

Efficient UAV trajectory prediction: A multi-modal deep diffusion framework Figure 1
arXiv preprint2026-01-26

Efficient UAV trajectory prediction: A multi-modal deep diffusion framework

Yuan Gao, Xinyu Guo, Wenjing Xie, Zifan Wang, Hongwen Yu, Gongyang Li, Shugong Xu

6D位姿估计航天器

面向低空经济中未授权无人机的持续监管,论文针对单一视觉、LiDAR或毫米波雷达在遮挡、远距和恶劣天气下观测不完备的问题,提出LiDAR与毫米波雷达点云融合框架:先用聚类/LSTM抑制背景点,再以PointNet式双编码器和双向交叉注意力对齐几何与运动特征。在MMAUD数据集上,相比基线轨迹预测精度提升约40%,但标题中的“diffusion”在已抽取方法中未充分说明。

PEAR: Pixel-aligned Expressive humAn mesh Recovery Figure 1
arXiv preprint2026-01-30

PEAR: Pixel-aligned Expressive humAn mesh Recovery

Jiahao Wu, Yunfei Liu ( ✉ ) ^{( { })}, Lijian Lin, Ye Zhu, Lei Zhu, Jingyi Li, Yu Li

International Digital Economy Academy

6D位姿估计

PEAR针对单图SMPLX人体网格恢复在速度、手脸对齐和表情表达上的不足,采用单一轻量ViT直接回归EHM-s参数,并以SMPLX身体结合可缩放FLAME头部提升表达能力;训练中通过可微渲染引入像素级监督、配合部件级标注增强不同裁剪场景鲁棒性。实验显示其在多基准上较既有SMPLX方法提升姿态精度,并实现无需预处理的100 FPS以上推理。

Lost in Space? Vision-Language Models Struggle with Relative Camera Pose Estimation Figure 1
arXiv preprint2026-01-29

Lost in Space? Vision-Language Models Struggle with Relative Camera Pose Estimation

Ken Deng, Yifu Qiu, Yoni Kasten, Shay B. Cohen, NVIDIA Research, @ed.ac.uk, @nvidia.com, y.ziser@rug.nl

University of Edinburgh University of Oxford, NVIDIA Research University of Groningen

6D位姿估计相机位姿

面向机器人等具身系统需要跨视角稳定理解相机运动的问题,本文把相对相机位姿估计转成离散语言分类,并构建真实 RGB-D 图像对基准 VRRPI-Bench 与单自由度诊断集 VRRPI-Diag。结果显示,几何方法 LoFTR 达 0.99、人类 0.91,而最佳 VLM 仅 0.66,且换序一致性最高 59.7%,在 roll 与深度平移等光轴运动上明显失效,指向跨视角对应、视角一致性和投影几何理解的缺口。

QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture Figure 1
arXiv preprint2026-01-27

QuaMo: Quaternion Motions for Vision-based 3D Human Kinematics Capture

Cuong Le, Pavlo Melnyk, Urs Waldmann, Mårten Wadenbäck, Sweden Independent researcher cuong.le@liu.se

Linköping University, Sweden, Independent researcher

6D位姿估计人体姿态

针对视频人体动捕中逐帧3D姿态易抖动、欧拉角在在线运动积分中存在不连续的问题,QuaMo将关节旋转建模为四元数状态,使用受单位球约束的四元数微分方程,并在meta-PD控制器中加入基于二阶四元数差分的加速度增强,以适应快速姿态变化。在Human3.6M、Fit3D、SportsPose和AIST上优于同类运动学方法,运动更连续且不合理伪影更少。

On the Role of Depth in Surgical Vision Foundation Models: An Empirical Study of RGB-D Pre-training Figure 1
arXiv preprint2026-01-26

On the Role of Depth in Surgical Vision Foundation Models: An Empirical Study of RGB-D Pre-training

John J. Han, john.j.han@vanderbilt.edu

Vanderbilt University

6D位姿估计点云彩色深度医学/手术

针对手术视觉基础模型多依赖 RGB、缺少三维几何先验的问题,本文用 140 万达芬奇手术图像及伪深度进行 RGB-D 自监督预训练,系统比较 8 个 ViT 模型。核心洞察是深度只在预训练中引入即可改善表征,尤其是 MultiMAE 的几何 token 化在检测、分割、深度和位姿任务上均优于 RGB 基线,且用 25% 标注数据微调常超过 RGB 全量训练。

ME-WARD: A multimodal ergonomic analysis tool for musculoskeletal risk assessment from inertial and video data in working plac Figure 1
arXiv preprint2026-01-24

ME-WARD: A multimodal ergonomic analysis tool for musculoskeletal risk assessment from inertial and video data in working plac

Javier González-Alonso, Paula Martín-Tapia, David González-Ortega, Míriam Antón-Rodríguez, Francisco Javier Díaz-Pernas, Mario Martínez-Zarzuela

Department of Signal Theory, Communications and Telematics Engineering, Telecommunications Engineering School, University of Valladolid Valladolid, Spain

6D位姿估计

针对工业现场肌骨损伤评估依赖人工观察、主观且难以实时量化的问题,ME-WARD 将 RULA 方法封装为可接入多源关节角数据的评估工具,兼容 IMU 与单目 3D 人体姿态估计。在传送带装配任务验证中,其 RULA 得分与 IMU 基准在屈伸主导动作上较一致,单目方案也具备可比表现,但侧向与旋转动作跟踪仍受限。

Correct-by-Construction Vision-based Pose Estimation using Geometric Generative Models Figure 1
arXiv preprint2026-01-24

Correct-by-Construction Vision-based Pose Estimation using Geometric Generative Models

Ulices Santa Cruz, Mahmoud Elfar, Yasser Shoukry

6D位姿估计

面向自动驾驶、无人机降落等安全关键场景,论文针对视觉 6D 位姿估计中深度网络缺乏可证明正确性的问题,利用已知平面目标几何与相机成像过程构造几何生成模型(GGM),并将其与可达性分析结合,训练带确定性误差界的姿态估计器和目标检测流水线。实验在合成图像与事件相机真实数据上验证了估计结果落在认证边界内,并可扩展到含干扰物的场景。

TOSHFA: A Mobile VR-Based System for Pose-Guided Exercise Rehabilitation for Low Back Pain Figure 1
arXiv preprint2026-01-24

TOSHFA: A Mobile VR-Based System for Pose-Guided Exercise Rehabilitation for Low Back Pain

Amin Mohamed CSAI School, Zewail City of Science, Technology s-amin.mohamed@zewailcity.edu.eg, Hamza Abdelmoreed CSAI School, Technology s-hamza.fekry@zewailcity.edu.eg, Mohamed Ehab CSAI School, Technology s-mohamed.ehab@zewailcity.edu.eg, Youssef Shawky CSAI School, Technology s-s-yousef.shawky@zewailcity.edu.eg, Mayada Hadhoud CSAI School, Technology Faculty of Engineering, Cairo Univeristy mhadhoud@zewailcity.edu.eg, Ahmad Al-Kabbany VRapeutic Inc. Multimedia Interaction, Communication Lab Wearables, Biosensing, Technology alkabbany@ieee.org, alkabbany@aast.edu

CSAI School, Zewail City of Science and Technology, Multimedia Interaction and Communication Lab, Wearables, Biosensing, and Biosignal Processing Research lab, Arab Academy for Science and Technology

6D位姿估计

针对居家腰痛康复缺少监督、依从性低且专用VR设备昂贵的问题,TOSHFA用笔记本摄像头+MediaPipe实时跟踪33个人体关键点,并通过UDP驱动手机纸盒VR中的游戏化反馈,强调低成本、姿态引导的远程训练。20人试验显示可行性和娱乐动机较好,但SUS均值仅47.4,界面与交互仍需优化,临床疗效尚未充分验证。

GPA-VGGT:Adapting VGGT to Large Scale Localization by Self-Supervised Learning with Geometry and Physics Aware Loss Figure 1
arXiv preprint2026-01-26

GPA-VGGT:Adapting VGGT to Large Scale Localization by Self-Supervised Learning with Geometry and Physics Aware Loss

IEEE Publication Technology, Yangfan Xu, Lilian Zhang, Xiaofeng He, Yugui Shen, Pengdong Wu, Wenqi Wu, Jun Mao

IEEE Publication Technology

6D位姿估计

该文针对VGGT依赖带标签位姿/深度数据、难以直接迁移到未标注大规模驾驶场景的问题,提出GPA-VGGT自监督后训练框架,用长序列多源到多目标投影、光度与几何联合损失,以及物理感知的时序加权和源帧选择来抑制动态物体与遮挡噪声。实验称在多个室外大规模基准上提升长距离定位精度和轨迹稳定性,但具体增益幅度文中未充分说明。

Flow Matching for Probabilistic Monocular 3D Human Pose Estimation Figure 1
arXiv preprint2026-01-23

Flow Matching for Probabilistic Monocular 3D Human Pose Estimation

Cuong Le, Pavló Melnyk, Bastian Wandt, Mårten Wadenbäck Computer Vision, Sweden Independent researcher cuong.le@liu.se

Computer Vision and Learning Systems Laboratory, Linköping University, Sweden, Independent researcher

6D位姿估计人体姿态

针对单目 2D 到 3D 人体姿态提升中的深度歧义和单一预测过度自信问题,FMPose 将 3D 姿态建模为条件分布,用带最优传输路径的 flow matching/连续归一化流生成多假设,并用 GCN 从 2D 热图 top-k 关键点学习关节关系作为条件。实验在 Human3.6M、MPI-INF-3DHP 和 3DPW 上超过现有单帧概率方法,且相较扩散模型生成更快、更准确。

Keyframe-Based Feed-Forward Visual Odometry Figure 1
arXiv preprint2026-01-22

Keyframe-Based Feed-Forward Visual Odometry

Weichen Dai Wenhan Su, Da Kong, Yuhang Ming, Wanzeng Kong

Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, School of Computer Science, Hangzhou Dianzi University, Hangzhou, China, Technion Autonomous Systems Program, Technion - Israel Institute of Technology, Haifa, Israel

6D位姿估计相机位姿

该文针对 VGGT-Long 等前馈视觉里程计对原始序列无差别处理,导致低视差冗余帧增加计算并削弱位姿估计的问题,提出以 VGGT 为骨干的关键帧式前馈 VO。核心做法不是移植几何阈值规则,而是用强化学习学习与基础模型潜表示相匹配的自适应关键帧策略来管理滑窗输入。方法在 TartanAir 训练,并在 EuRoC、TUM-RGBD、KITTI 等真实数据集上相较现有前馈 VO 获得稳定定位精度提升。

A Multi-View Pipeline and Benchmark Dataset for 3D Hand Pose Estimation in Surgery Figure 1
arXiv preprint2026-01-22

A Multi-View Pipeline and Benchmark Dataset for 3D Hand Pose Estimation in Surgery

Alan Magdaleno, Anna-Katharina Calek, Nicola Cavalcanti, Nathan Hoffman, Christoph Germann, Joschua Wüthrich, Max Krähenmann, Mazda Farshad, Philipp Fürnstahl, Lilian Calvet

6D位姿估计手部姿态数据集/基准多视角医学/手术

针对手术场景中强光、遮挡、手套外观一致及标注数据稀缺导致手部3D姿态估计难以泛化的问题,论文提出无需领域微调的多视角流程:用现成检测、全身姿态、手部关键点与跟踪模块获得稳定2D观测,再经受约束的3D优化重建,并发布含6.8万帧、3000个标注手姿态的手术基准数据集。实验显示相较基线2D平均关节误差降低31%,3D MPJPE降低76%。

TinySense: Effective CSI Compression for Scalable and Accurate Wi-Fi Sensing Figure 1
arXiv preprint2026-01-22

TinySense: Effective CSI Compression for Scalable and Accurate Wi-Fi Sensing

Toan Gian, Dung T. Tran, Viet Quoc Pham, Francesco Restuccia, Van-Dinh Nguyen

Smart Green Transformation Center (GREEN-X), VinUniversity, Hanoi, Vietnam, Department of Electrical & Computer Engineering, Northeastern University, MA, USA, School of Computer Science and Statistics, Trinity College Dublin, Ireland

6D位姿估计

面向 Wi-Fi 人体姿态估计中 CSI 维度高、边缘设备难以本地处理且云端传输开销巨大的问题,TinySense 将模型拆分为端侧轻量编码与服务器解码/感知,利用 VQGAN 码本把 CSI 压成离散潜表示,并用 K-means 生成可变码率小码本、Transformer 预测丢失索引以增强不可靠网络下的鲁棒性。在 Raspberry Pi/Jetson Nano 原型上,相同压缩率下 PCK20 最高较基线提升 1.5 倍,延迟和网络开销最高分别降低 5 倍与 2.5 倍。

DeltaDorsal: Enhancing Hand Pose Estimation with Dorsal Features in Egocentric Views Figure 1
arXiv preprint2026-01-21

DeltaDorsal: Enhancing Hand Pose Estimation with Dorsal Features in Egocentric Views

William Huang, Siyou Pei, Leyi Zou, Eric J. Gonzalez, Ishan Chatterjee, Yang Zhang

University of California, Los Angeles, Google

6D位姿估计手部姿态

针对第一视角手部估计中手指频繁自遮挡、传统轮廓/几何特征失效的问题,DeltaDorsal转而利用遮挡时仍可见的手背皮肤、肌腱和皱纹形变,通过动态图像与放松参考姿态的双流特征差分预测MANO关节角。作者采集12人17万余帧数据,显示在重遮挡场景MPJAE较SOTA降低18%,并提升捏合、敲击及无可见位移的等长“点击”检测。

BBoxMaskPose v2: Expanding Mutual Conditioning to 3D Figure 1
arXiv preprint2026-01-21

BBoxMaskPose v2: Expanding Mutual Conditioning to 3D

Constantin Kolomiiets, Jiri Matas

Czech Technical University in Prague

6D位姿估计

本文针对拥挤多人场景中2D姿态仍不稳、进而限制3D人体重建的问题,提出BMPv2:用PMPose把关键点概率建模与mask条件结合,并以SAM-pose2seg改进姿态引导分割,形成检测、姿态、分割互相细化的闭环。实验在COCO提升1.5 AP、OCHuman提升6 AP并首次超过50 AP,同时表明3D性能更受2D姿态质量影响而非检测本身。

On-the-fly hand-eye calibration for the da Vinci surgical robot Figure 1
arXiv preprint2026-01-21

On-the-fly hand-eye calibration for the da Vinci surgical robot

Zejian Cui, Ferdinando Rodriguez y Baena

6D位姿估计手部姿态机器人操作医学/手术

针对达芬奇等线驱手术机器人中编码器误差和初始手眼标定偏差导致的器械定位不准,本文提出在线手眼标定框架:用基于解析雅可比和可见性检查的免训练关键点关联,结合多种滤波式标定器适配不同噪声场景。公开视频数据上的体外与离体实验显示,该方法显著降低工具定位误差,精度接近现有方法且计算更高效。

On the Role of Rotation Equivariance in Monocular 3D Human Pose Estimation Figure 1
arXiv preprint2026-01-20

On the Role of Rotation Equivariance in Monocular 3D Human Pose Estimation

Pavlo Melnyk, Cuong Le, Urs Waldmann, Per-Erik Forssén, Bastian Wandt

6D位姿估计人体姿态

本文针对单目3D人体姿态中2D到3D lifting在输入发生平面旋转时几何不一致的问题,系统比较普通、严格旋转等变和混合模型。核心洞察是无需在结构上强制等变,简单旋转数据增强即可让模型学到所需归纳偏置。Human3.6M、MPII-INF-3DHP及SportsCap实验显示,vanilla+aug在旋转样本上优于等变设计方法,并具备更好的训练/推理效率。

DroneVLA: VLA based Aerial Manipulation Figure 1
arXiv preprint2026-01-21

DroneVLA: VLA based Aerial Manipulation

Fawad Mehboob, Monijesu James, Amir Habel, Jeffrin Sam, Miguel Altamirano Cabrera, Dzmitry Tsetserukou

Dzmitry Tsetserukou

6D位姿估计机器人操作航天器

面向无人机从观察走向取放操作后,非专家难以安全下达任务的问题,DroneVLA将语言意图解析、Grounding DINO开放词汇定位、动态A*导航与MediaPipe人体姿态伺服解耦结合,让VLA只负责语义与夹爪开合决策以降低幻觉风险。真实飞行10次定位/导航均成功,均值误差0.070m、RMSE 0.084m,并保持约1m交接距离;但VLA尚未接入真实闭环飞控,仅在Unity和视觉数据上验证二值开合策略。

Learning Fine-Grained Correspondence with Cross-Perspective Perception for Open-Vocabulary 6D Object Pose Estimation Figure 1
arXiv preprint2026-01-20

Learning Fine-Grained Correspondence with Cross-Perspective Perception for Open-Vocabulary 6D Object Pose Estimation

Yu Qin, Shimeng Fan, Fan Yang, Zixuan Xue, Zijie Mai, Wenrui Chen, Kailun Yang, Zhiyong Li

6D位姿估计物体位姿未知物体

本文针对开放词汇 6D 位姿估计中全局匹配易受背景干扰、跨视角外观变化导致对应关系混乱的问题,提出 FiCoP:先以开放词汇检测和 SAM 做目标中心解耦,再用跨视角全局感知融合双视图结构信息,并通过 patch-to-patch 相关矩阵限制局部匹配范围。实验在 REAL275 和 Toyota-Light 上较 SOTA 平均召回分别提升 8.0% 和 6.1%。

Autonomous Navigation at the Nano-Scale: Algorithms, Architectures, and Constraints Figure 1
arXiv preprint2026-01-19

Autonomous Navigation at the Nano-Scale: Algorithms, Architectures, and Constraints

UK m.zango.1@research.gla.ac.uk, UK Jianglin.Lan@glasgow.ac.uk

James Watt School of Engineering, University of Glasgow

6D位姿估计

面向小于50g、机载计算低于100mW的纳米无人机,论文梳理为何常规VSLAM、深度感知与RL控制难以直接下放到机上。核心洞察是必须做硬件—软件协同:以光流、轻量SLAM、量化DNN、事件相机/神经形态控制和经典控制混合替代重型自治栈。综述认为视觉导航与相对位姿估计已有进展,但续航、动态避障和Sim-to-Real仍是主要瓶颈。

Diffusion-based Inverse Model of a Distributed Tactile Sensor for Object Pose Estimation Figure 1
arXiv preprint2026-01-19

Diffusion-based Inverse Model of a Distributed Tactile Sensor for Object Pose Estimation

Ante Marić affiliationmark, Giammarco Caroleo affiliationmark, Alessandro Albini affiliationmark, Julius Jankowski affiliationmark, Perla Maiolino affiliationmark, Sylvain Calinon affiliationmark

Idiap Research Institute, Martigny, Switzerland, Oxford Robotics Institute (ORI), University of Oxford, UK

6D位姿估计物体位姿

针对遮挡或环境影响下视觉不可用、触觉观测又局部且多解的问题,本文用去噪扩散学习分布式触觉传感器的逆模型,并借助SDF距离/梯度投影保证接触一致性,再将生成假设以粒子注入方式并入粒子滤波。仿真与真实平面位姿估计、箱体推动跟踪实验显示,在无视觉和无紧初值先验下,相比局部采样基线提升采样效率与估计精度,并能保持多模态信念。

Breaking Coordinate Overfitting: Geometry-Aware WiFi Sensing for Cross-Layout 3D Pose Estimation Figure 1
arXiv preprint2026-01-18

Breaking Coordinate Overfitting: Geometry-Aware WiFi Sensing for Cross-Layout 3D Pose Estimation

Songming Jia, Yan Lu, Bin Liu, Xiang Zhang, Peng Zhao, Xinmeng Tang, Yelin Wei, Jinyang Huang, Huan Yan, Zhi Liu

University of Science and Technology of China, Shanghai Artificial Intelligence Lab, Tianjin University, Hefei University of Technology, Guizhou Normal University, The University of Electro-Communications

6D位姿估计

本文针对 WiFi 3D 人体位姿估计在收发器布局变化时失效的问题,指出根因是模型把 CSI 到相机坐标标签的映射与设备几何“坐标过拟合”在一起。PerceptAlign 通过双棋盘快速统一 WiFi/视觉坐标,并将校准后的收发器位置编码为条件嵌入与 CSI 融合,从而显式解耦人体运动和部署布局。在包含 21 人、5 场景、18 动作、7 布局的数据集上,文中报告域内误差降 12.3%,跨域误差较基线降低超过 60%。

Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Data Figure 1
arXiv preprint2026-01-17

Detecting 3D Line Segments for 6DoF Pose Estimation with Limited Data

Matej Mok, Lukáš Gajdošech, Michal Mesároš, Martin Madaras, Viktor Kocur Faculty of Mathematics, Physics, Informatics, Slovakia Skeletex Research, Bratislava, Slovakia @fmph.uniba.sk, @skeletex.xyz

Faculty of Mathematics, Physics and Informatics, Comenius University Bratislava, Slovakia, Skeletex Research, Bratislava, Slovakia

6D位姿估计

面向工业料箱抓取/搬运中真实数据少、实例 CAD 难获取的问题,本文将位姿估计转化为结构化点云中的顶边 3D 线段检测:改造 LeTR 预测料箱上边缘,再用几何规则恢复 6DoF 位姿。作者扩展并公开带标注数据集,实验显示合成数据有助于真实扫描泛化,最终达到约 3 cm 平移误差、8.2° 旋转误差,优于对比方法,但适用性依赖近似长方体且朝上的料箱假设。

WildRayZer: Self-supervised Large View Synthesis in Dynamic Environments Figure 1
arXiv preprint2026-01-15

WildRayZer: Self-supervised Large View Synthesis in Dynamic Environments

Xuweiyi Chen, Wentao Zhou

University of Virginia

6D位姿估计

该文针对真实视频中相机与物体同时运动导致静态新视角合成出现重影、几何幻觉和位姿不稳的问题,提出 WildRayZer:用静态渲染器的合成残差自监督生成伪运动掩码,并蒸馏运动估计器来屏蔽动态 token、门控损失,使训练聚焦背景补全。作者还构建 D-RE10K 与 iPhone 配对评测集;实验显示其单次前向在动态物体去除和整帧 NVS 质量上优于优化式与前馈基线。

COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation Figure 1
arXiv preprint2026-01-14

COMPOSE: Hypergraph Cover Optimization for Multi-view 3D Human Pose Estimation

Information, Technology, Germany, Imperial College London, United Kingdom

School of Computation, Information, and Technology, Technical University of Munich, Germany, Department of Computing, Imperial College London, United Kingdom, Munich Center for Machine Learning, Germany

6D位姿估计人体姿态多视角

面向稀疏多视角下遮挡、2D关键点噪声和跨视角误匹配会放大误差的问题,COMPOSE不再把对应关系拆成成对匹配,而是将多相机2D检测集合建模为超边,并用超图划分与ILP一次性 enforcing 全局几何一致性;同时通过几何剪枝压缩指数级搜索空间。实验显示其在多个基准上较既有优化方法AP最高提升23%,较自监督端到端方法最高提升11%,说明无需3D监督也能增强泛化与鲁棒性。

Spiking Neural-Invariant Kalman Fusion for Accurate Localization Using Low-Cost IMUs Figure 1
arXiv preprint2026-01-13

Spiking Neural-Invariant Kalman Fusion for Accurate Localization Using Low-Cost IMUs

Yaohua Liu, Qiao Xu, Binkai Ou

6D位姿估计

针对低成本 MEMS IMU 噪声非线性、时变且易导致纯惯性航位推算漂移的问题,论文将脉冲神经网络与不变扩展卡尔曼滤波结合,用 SNN 从长时序 IMU 中提取运动特征并在线调节 InEKF 噪声协方差。KITTI 与真实机器人实验显示其定位精度和抗噪性优于对比方法,但具体增益在多大程度来自 SNN 结构仍需更多消融支撑。

Fiducial Exoskeletons: Image-Centric Robot State Estimation Figure 1
arXiv preprint2026-01-12

Fiducial Exoskeletons: Image-Centric Robot State Estimation

Cameron Smith, Basile Van Hoorick, Vitor Guizilini

Cameron Smith, USC Physical Superintelligence (PSI) Lab, Toyota Research Institute

6D位姿估计机器人操作

针对低成本机械臂编码器不准、手眼标定繁琐导致3D状态估计和控制脆弱的问题,论文把机器人状态估计改写为单张RGB图像中的逐连杆6D位姿估计,并用带已知几何关系的3D打印 fiducial exoskeleton 简化观测,再通过运动学一致性优化恢复关节角和相机外参。在100美元6DoF机械臂上,相比基于前向运动学的传统方案,末端状态估计误差约降75%,控制误差约降45%。

FMAC: a Fair Fiducial Marker Accuracy Comparison Software Figure 1
arXiv preprint2026-01-12

FMAC: a Fair Fiducial Marker Accuracy Comparison Software

Guillaume J. Laurent, Patrick Sandoz

6D位姿估计

针对实体实验难以以高精度、可复现实测大量位姿来公平比较标志物6D位姿精度的问题,FMAC用基于物理的光线追踪生成高保真合成图像,直接接入OpenCV相机标定参数,并建模畸变、离焦、衍射及边缘亚像素采样;结合低差异采样分析六自由度与误差相关性,在常见标志物上揭示了不同图案的位姿估计强弱项,并提供开源工具用于相机-标志物组合的例行精度评估。

OSCAR: Open-Set CAD Retrieval from a Language Prompt and a Single Image Figure 1
arXiv preprint2026-01-12

OSCAR: Open-Set CAD Retrieval from a Language Prompt and a Single Image

Tessa Pulli, Jean-Baptiste Weibel, Peter Hönig, Matthias Hirschmanner, Markus Vincze, Andreas Holzinger

Automation and Control Institute, TU Wien, Wien, Austria, BOKU University, Human-Centered AI Lab, FTEC, Department for Ecosystem Management, Climate and Biodiversity, Wien, Austria, Institute for Human Centered Computing, Faculty of Informatics and Biomedical Engineering, TU Graz, Graz, Austria

6D位姿估计

针对零样本6D位姿估计依赖CAD模型、而部署后模型获取和标注维护困难的问题,OSCAR把单张RGB图和语言提示转化为开集CAD检索:先为未标注3D库生成多视角渲染与 caption,再用GroundedSAM定位目标、CLIP文本筛选候选、DINOv2视觉特征精排。实验显示其在MI3DOR上优于已有方法,在YCB-V检索平均精度达90.48%,并可接入MegaPose,用相似CAD模型获得优于在线重建基线的位姿结果。

Motion Focus Recognition in Fast-Moving Egocentric Video Figure 1
arXiv preprint2026-01-12

Motion Focus Recognition in Fast-Moving Egocentric Video

Si-En Hong, James Tribble, Alexander Lake, Hao Wang, Chaoyi Zhou, Ashish Bastola, Siyu Huang, Eisa Chaudhary, Brian Canada, Ismahan Arslan-Ari, USA @clemson.edu eisa@email.uscb.edu, bcanada@uscb.edu, arslanai@mailbox.sc.edu

Clemson University, SC, USA, University of South Carolina Beaufort, SC, USA, University of South Carolina, SC, USA

6D位姿估计

针对运动/体育等高速第一视角视频中头部晃动、视角不稳导致传统静态显著性难以反映真实运动意图的问题,论文利用 Depth Anything 3 等基础模型估计相机位姿,并以加速度投影定义“运动焦点”,结合滑动批推理和批间位姿锚定降低显存。自采数据上可突出拍摄者运动趋势,DA3 base 约31–34 FPS,small 版显存低于5GB且保持30 FPS以上。

MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation Figure 1
arXiv preprint2026-01-11

MixRI: Mixing Features of Reference Images for Novel Object Pose Estimation

Xinhang Liu, Jiawei Shi, Zheng Dang, Yuchao Dai School of Electronics, Information, Processing CVLab, EPFL, Switzerland @mail.nwpu.edu.cn, zheng.dang@epfl.ch, daiyuchao@nwpu.edu.cn

School of Electronics and Information, Northwestern Polytechnical University, Shaanxi Key Laboratory of Information Acquisition and Processing, CVLab, EPFL, Switzerland

6D位姿估计物体位姿未知物体

MixRI面向新物体CAD驱动的RGB 6D位姿估计,针对现有方法依赖大量渲染参考图、特征缓存和大模型而难以上边缘设备的问题,提出将少量多视角参考图中同一3D点的特征聚合混合,并进行视图聚合点匹配与遮挡预测,再用2D-3D对应和PnP/RANSAC求位姿。文中称仅用12张参考图、无需离线特征预提取,在BOP七个核心数据集上达到接近更重方法的效果,并比最快基线约快2倍。

Towards Egocentric 3D Hand Pose Estimation in Unseen Domains Figure 1
arXiv preprint2026-01-10

Towards Egocentric 3D Hand Pose Estimation in Unseen Domains

Wiktor Mucha, Michael Wray, Martin Kampel Computer Vision Lab, TU Wien, SoftServe Inc, Kraków, Poland, michael.wray@bristol.ac.uk

Computer Vision Lab, TU Wien, SoftServe Inc., Kraków, Poland, University of Bristol

6D位姿估计手部姿态

该文针对第一视角3D手部姿态在未见相机和场景中易因内参、深度感知过拟合而失效的问题,提出单阶段V-HPOT:在按焦距和图像尺寸归一化的虚拟相机空间预测关键点深度,并用伪深度辅助监督与测试时自监督3D一致性优化来适配目标域。跨域实验中,H2O与AssemblyHands平均姿态误差分别降低71%和41%,且在更少训练数据下优于其他单阶段方法。

FlyPose: Towards Robust Human Pose Estimation From Aerial Views Figure 1
arXiv preprint2026-01-09

FlyPose: Towards Robust Human Pose Estimation From Aerial Views

Hassaan Farooq, Marvin Brenner, Peter Stütz, Universität der Bundeswehr Munich @unibw.de

6D位姿估计人体姿态航天器

面向无人机在人群环境中安全飞行,论文针对俯视视角下低分辨率、强遮挡和边缘算力受限导致的人体姿态估计失效问题,提出轻量级 top-down FlyPose,通过多航拍数据集联合训练检测器与姿态模型,并发布 FlyPose-104 挑战集。结果显示人物检测平均提升 6.8 mAP,UAV-Human 上 2D 姿态提升 16.3 mAP,在 Jetson Orin AGX 上约 20 ms 推理并完成四旋翼实飞部署。

Orient Anything V2: Unifying Orientation and Rotation Understanding Figure 1
arXiv preprint2026-01-09

Orient Anything V2: Unifying Orientation and Rotation Understanding

​Zehan Wang, Ziang Zhang, Jiayang Xu, Jialei Wang, Tianyu Pang, Chao Du, Hengshuang Zhao, Shanghai AI Lab, Sea AI Lab

Zhejiang University; Shanghai AI Lab; Sea AI Lab; The University of Hong Kong

6D位姿估计

针对 V1 只能处理单一“正面”、难以表达旋转对称与参考帧间相对旋转的问题,Orient Anything V2 通过生成式 3D 资产扩充到 60 万规模,并用 model-in-the-loop 标注 0 到 N 个有效正面;模型上引入对称感知的周期分布拟合和多帧输入,统一绝对朝向、相对旋转与对称性预测。在 11 个基准上实现零样本朝向估计、6DoF 位姿估计和对称识别的 SOTA。

ObjectForesight: Predicting Future 3D Object Trajectories from Human Videos Figure 1
arXiv preprint2026-01-08

ObjectForesight: Predicting Future 3D Object Trajectories from Human Videos

Rustin Soraki, Homanga Bharadhwaj, Ali Farhadi, Roozbeh Mottaghi

6D位姿估计

这篇论文面向机器人从被动人类第一视角视频中预判物体将如何运动的问题,将未来交互效果表述为刚体物体的 SE(3) 轨迹预测。核心做法是构建含 200 万级短片段的伪 3D 物体轨迹数据,并用结合单目几何、场景点云编码与扩散 Transformer 的 ObjectForesight 输出多模态 6D 位姿序列。实验显示其在精度、几何一致性和未见物体/场景泛化上优于自回归与视频生成基线,但增益可能主要来自 scaling / data。

BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusion Figure 1
arXiv preprint2026-01-07

BREATH-VL: Vision-Language-Guided 6-DoF Bronchoscopy Localization via Semantic-Geometric Fusion

Qingyao Tian, Bingyu Yang, Huai Liao, Xinyan Huang, Junyong Li, Dong Yi, Hongbin Liu

6D位姿估计

面向真实支气管镜中遮挡、模糊、弱纹理和解剖重复导致的6DoF定位不稳,BREATH-VL先构建含姿态、深度、解剖与VQA标注的在体气道数据集,再用VLM做分支/深度等语义初始化,并以运动历史文本提示引入时序信息,最后结合深度与解剖标志几何配准精修位姿;实验显示其较最佳视觉基线平移误差降低25.5%,且保持可竞争延迟。

TRec: Learning Hand-Object Interactions through 2D Point Track Motion Figure 1
arXiv preprint2026-01-07

TRec: Learning Hand-Object Interactions through 2D Point Track Motion

Dennis Holzmann, Sven Wachsmuth

Bielefeld University, Faculty of technology, Germany

6D位姿估计手部姿态

面向手-物交互中遮挡、强相机运动使手/物检测和RGB外观建模不稳的问题,TRec用CoTracker随机跟踪稀疏2D点,将轨迹与图像特征送入Transformer,强调无需语义筛选且背景运动也有用。实验显示点轨迹稳定提升RGB基线,甚至仅首帧加轨迹可超过全视频RGB;但具体基准规模与增益来源仍需结合完整实验判断。

HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps Figure 1
arXiv preprint2026-01-07

HOLO: Homography-Guided Pose Estimator Network for Fine-Grained Visual Localization on SD Maps

Xuchang Zhong, Xu Cao, Jinke Feng, Technology of China @bit.edu.cn, fengjinke@mail.ustc.edu.cn

6D位姿估计相机位姿

针对自动驾驶中依赖低成本 SD/OSM 地图的视觉定位,HOLO认为现有直接回归方法忽视 BEV 与地图块之间的单应几何,导致训练慢且精度受限。方法将多视角图像编码到 BEV,并与语义地图对齐形成单应约束,用估计的角点位移/单应关系指导跨模态融合并约束 3-DoF 位姿解码。nuScenes 实验显示其优于现有图像到地图定位方法,Recall@1m/2m 提升约16%,推理约20 FPS。

360DVO: Deep Visual Odometry for Monocular 360-Degree Camera Figure 1
arXiv preprint2026-01-09

360DVO: Deep Visual Odometry for Monocular 360-Degree Camera

Xiaopeng Guo, Yinzhe Xu, Huajian Huang, Member, IEEE, Sai-Kit Yeung, Senior Member

6D位姿估计相机位姿

针对单目360°视觉里程计在剧烈运动、光照变化和投影畸变下特征不稳定的问题,360DVO将特征学习与球面几何约束结合:用DAS-Feat/SphereResNet提取抗畸变稀疏特征,并在ODBA中联合优化相机位姿与点深度。作者还构建真实OVO基准;在真实与合成数据上相较360VO、OpenVSLAM等基线,鲁棒性提升50%、精度提升37.5%。

VisuoTactile 6D Pose Estimation of an In-Hand Object using Vision and Tactile Sensor Data Figure 1
IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 2228-2235, April 20222026-01-04

VisuoTactile 6D Pose Estimation of an In-Hand Object using Vision and Tactile Sensor Data

Snehal s. Dikhale, Karankumar Patel, Daksh Dhingra, Itoshi Naramura, Akinobu Hayashi, Soshi Iba, Nawid Jamali

Honda Research Institute USA, Inc

6D位姿估计手部姿态

针对手内物体被夹爪严重遮挡时仅靠视觉难以稳定估计6D位姿的问题,论文将触觉接触面统一表示为点云,并设计视觉—触觉双通道的像素/点级DenseFusion,同时用NDDS生成含YCB物体的合成视触数据。仿真结果显示加入触觉显著优于RGB-D基线,少量触点仍有优势;真实机器人定性实验表明合成训练可迁移,但极重遮挡下姿态仍依赖颜色特征。

RePose: A Real-Time 3D Human Pose Estimation and Biomechanical Analysis Framework for Rehabilitation Figure 1
arXiv preprint2026-01-02

RePose: A Real-Time 3D Human Pose Estimation and Biomechanical Analysis Framework for Rehabilitation

Junxiao Xue, Pavel Smirnov, Ziao Li, Yunyun Shi, Shi Chen, Xinyi Yin Xiaohan Yue, Lei Wang, Yiduo Wang, Feng Lin, Yijia Chen, Xiao Ma Xiaoran Yan, Qing Zhang, Fengjian Xue, Xuecheng Wu

Zhejiang Lab, Northeastern University, Xi’an Jiaotong University, Zhengzhou University, Dalian Minzu University, Nanjing University of Aeronautics and Astronautics, Fuyao University of Science and Technology, Xianghu Lab

6D位姿估计人体姿态医学/手术

面向居家/临床康复中缺少治疗师全程监督、且传统动捕或 RGB-D 成本较高的问题,RePose 用多视角 RGB 构建实时 3D 人体姿态与生物力学分析流程,并加入面向多人干扰的快速患者跟踪和改造 SmoothNet 抑制康复小幅动作下的抖动。系统据称在 Linux 多人场景约 30 FPS,单帧跟踪低于 1ms,并通过 Unity 可视化动作评估与肌肉受力。

Vision-based Goal-Reaching Control for Mobile Robots Using a Hierarchical Learning Framework Figure 1
arXiv preprint2026-01-02

Vision-based Goal-Reaching Control for Mobile Robots Using a Hierarchical Learning Framework

Mehdi Heydari Shahna, Pauli Mustalahti, Jouni Mattila

6D位姿估计机器人操作

面向重型移动机器人在软土、打滑等高风险场景中难以安全探索和精确到达目标的问题,论文将视觉SLAM位姿估计、Q-learning/SARSA平滑规划、DNN执行器建模、鲁棒自适应控制与安全监督器分层耦合,避免把底层执行理想化。实验在6000 kg机器人上验证了不同场景下的目标到达与轮速跟踪效果,并声称实现厘米级精度和执行系统指数稳定性。

NMPC-Augmented Visual Navigation and Safe Learning Control for Large-Scale Mobile Robots Figure 1
IEEE Robotics and Automation Letters2026-01-02

NMPC-Augmented Visual Navigation and Safe Learning Control for Large-Scale Mobile Robots

Mehdi Heydari Shahna, Pauli Mustalahti, Jouni Mattila

Tampere University

6D位姿估计机器人操作

针对重型移动机器人在松散地面易打滑、精确建模困难且安全风险高的问题,论文将立体视觉 ORB-SLAM3 位姿估计、高层 NMPC 纠偏、低层鲁棒自适应深度控制和对数安全监督整合为闭环框架,在不依赖完整执行机构模型的情况下补偿轮滑并约束风险。实车实验在 6000 kg 电液驱动平台上验证了多频模块协同运行、车轮命令跟踪与越野自主导航的稳定安全性。

SV-GS: Sparse View 4D Reconstruction with Skeleton-Driven Gaussian Splatting Figure 1
arXiv preprint2026-01-01

SV-GS: Sparse View 4D Reconstruction with Skeleton-Driven Gaussian Splatting

Jun-Jee Chao

University of Minnesota, The University of Texas at Austin

6D位姿估计三维重建高斯泼溅

面向真实场景中动态目标只有少量、跨视角观测而难以建立时序对应的问题,SV-GS用粗骨架和初始静态重建约束4D高斯泼溅,学习由时变关节位姿和非时变细粒度形变组成的骨架驱动变形场,并可用扩散先验替代多视图初始化。实验显示其在稀疏观测合成数据上PSNR最高提升34%,真实数据中用约少10倍帧数达到接近密集单目视频方法的效果。

Edit3r: Instant 3D Scene Editing from Sparse Unposed Images Figure 1
arXiv preprint2025-12-31

Edit3r: Instant 3D Scene Editing from Sparse Unposed Images

Jiageng Liu, Weijie Lyu, Xueting Li, Yejie Guo, Ming-Hsuan Yang

University of Massachusetts Amherst, University of California, Merced, NVIDIA, Shanghai Jiao Tong University

6D位姿估计

针对现有文本驱动3D场景编辑依赖逐场景优化、需要位姿且易产生多视角不一致的问题,Edit3r将稀疏无位姿图像的重建与编辑合并为一次前馈预测,直接生成与指令对齐的3D Gaussian,并用SAM2重着色构造跨视角监督、非对称输入提升鲁棒性。在DL3DV-Edit-Bench上,其语义对齐和3D一致性优于近期基线,推理约0.5秒,但大几何增删的监督仍受重着色策略限制。

FineTec: Fine-Grained Action Recognition Under Temporal Corruption via Skeleton Decomposition and Sequence Completion Figure 1
AAAI 20262025-12-31

FineTec: Fine-Grained Action Recognition Under Temporal Corruption via Skeleton Decomposition and Sequence Completion

Dian Shao, Mingfei Shi, Like Liu

6D位姿估计

FineTec针对在线姿态估计中严重丢帧导致骨架序列时间断裂、细粒度动作线索丢失的问题,提出先做上下文序列补全,再按人体语义区域和动静关节分解增强,并用拉格朗日动力学估计加速度,与位置特征共同输入GCN识别。作者还构建Gym288-skeleton;在NTU与Gym细粒度基准的多种帧缺失设置下均优于既有方法,Gym99/Gym288 severe上Top-1达89.1%/78.1%。

CREPES-X: Hierarchical Bearing-Distance-Inertial Direct Cooperative Relative Pose Estimation System Figure 1
arXiv preprint2025-12-31

CREPES-X: Hierarchical Bearing-Distance-Inertial Direct Cooperative Relative Pose Estimation System

Zhehan Li, Zheng Wang, Jiadong Lu, Qi Liu, Zhiren Xun, Yue Wang, Fei Gao, Chao Xu, Yanjun Cao

State Key Laboratory of Industrial Control Technology, Institute of Cyber-Systems and Control, Zhejiang University, Huzhou Institute of Zhejiang University, University of Michigan, The Hong Kong Polytechnic University, Hong Kong, China

6D位姿估计相机位姿

面向多机器人协作中无全局信息、遮挡、非惯性运动和大量观测外点下的相对定位难题,CREPES-X将红外LED/相机、UWB与IMU集成到小型硬件,并用分层估计器融合方位、距离和惯性:单帧闭式解快速给出位姿并剔除外点,多帧基于机器人中心相对运动学和IMU预积分做松/紧耦合优化。仿真与实测显示其可承受最高90%方位外点,真实数据RMSE达0.073 m和1.817°。

LLHA-Net: A Hierarchical Attention Network for Two-View Correspondence Learning Figure 1
arXiv preprint2025-12-31

LLHA-Net: A Hierarchical Attention Network for Two-View Correspondence Learning

Shuyuan Lin, Yu Guo, Xiao Chen, Yanjie Liang, Guobao Xiao, Feiran Huang

College of Cyber Security, Jinan University, Guangzhou 510632, China, Department of Strategic and Advanced Interdisciplinary Research, Peng Cheng Laboratory, Shenzhen 518000, China, School of Electronics and Information Engineering, Tongji University, Shanghai, 201804, China

6D位姿估计

该文针对两视图特征匹配中外点比例高、噪声导致相机位姿估计不稳的问题,提出 LLHA-Net,通过逐层通道融合保留各阶段语义信息,并用具备置换不变性的层级注意力从粗到细筛选内点、抑制外点干扰。实验在 YFCC100M 和 SUN3D 上显示,其在外点剔除与相机位姿估计指标上优于多种已有方法,但多阶段迭代也带来参数量和运行时间增加。

SliceLens: Fine-Grained and Grounded Error Slice Discovery for Multi-Instance Vision Tasks Figure 1
arXiv preprint2025-12-31

SliceLens: Fine-Grained and Grounded Error Slice Discovery for Multi-Instance Vision Tasks

Wei Zhang, Chaoqun Wang : 1, Zixuan Guan, Sam Kao, Pengfei Zhao, Peng Wu, Sifeng He Apple @apple.com

6D位姿估计

面向检测、分割与位姿估计等多实例视觉任务,论文关注模型在细粒度场景关系上的系统性失误难以被现有图像级切片方法发现的问题。SliceLens以“生成—验证”失败假设为核心,结合LLM/VLM和视觉 grounding 直接描述并定位错误模式,并提出专家标注的FeSD基准。实验中其在FeSD上Precision@10达0.73,相比0.31提升0.42,且模型修复实验显示这些切片可转化为性能改进。

Geometric Multi-Session Map Merging with Learned Local Descriptors Figure 1
arXiv preprint2025-12-30

Geometric Multi-Session Map Merging with Learned Local Descriptors

Yanlong Ma, Nakul S. Joshi, Christa S. Robison, Philip R. Osteen, Brett T. Lopez

6D位姿估计

面向长期自主运行中多次建图/多机器人地图难以在无全局参考下可靠合并的问题,本文提出GMLD,用关键点感知编码器学习局部几何描述子,并引入基于平面的几何Transformer增强关键点关系,再在因子图中加入跨会话扫描匹配代价以约束全局一致性。在SemanticKITTI、Newer College及自采UCLA/ARL数据上的实验显示,其回环检测、相对位姿估计和大规模点云地图合并误差较低且鲁棒,但文中命名出现GMLD/MERRLIN不一致。

Improved 3D Gaussian Splatting of Unknown Spacecraft Structure Using Space Environment Illumination Knowledge Figure 1
arXiv preprint2025-12-30

Improved 3D Gaussian Splatting of Unknown Spacecraft Structure Using Space Environment Illumination Knowledge

Tae Ha Park Simone D’Amico

Dept. of Aeronautics & Astronautics, Stanford University, Stanford, CA 94305, USA

6D位姿估计三维重建高斯泼溅航天器

面向非合作航天器交会/近距操作中未知目标的建图与后续6D位姿估计,论文指出普通3DGS难以处理太空中快速变化的太阳照明。其核心做法是把服务星已知/可维护的太阳矢量引入训练,并通过shadow splatting估计各高斯在给定光照下的可见性,从而提升渲染光度一致性。高保真合成RPO实验显示模型能重建目标结构并表达全局阴影与自遮挡,但当前仍依赖已知位姿和由真值网格初始化高斯,实用闭环SLAM能力尚未充分验证。

Lifelong Domain Adaptive 3D Human Pose Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20262025-12-29

Lifelong Domain Adaptive 3D Human Pose Estimation

Qucheng Peng, Hongfei Xue, Pu Wang, Chen Chen

University of Central Florida, University of North Carolina at Charlotte

6D位姿估计人体姿态

针对3D人体姿态估计在真实场景中目标域持续变化、且适配新域时无法访问源域和旧目标域数据的问题,论文首次定义lifelong domain adaptive 3D HPE,并用包含3D姿态生成器、2D判别器和2D-to-3D估计器的GAN框架,结合姿态、时序和域感知先验来同时适配当前域并缓解灾难性遗忘。多数据集连续适配实验显示其较Source-only、CoTTA-Pose、PoseDA-LL等基线在MPJPE/PA-MPJPE上取得稳定优势。

Simultaneous Extrinsic Contact and In-Hand Pose Estimation via Distributed Tactile Sensing Figure 1
arXiv preprint2025-12-29

Simultaneous Extrinsic Contact and In-Hand Pose Estimation via Distributed Tactile Sensing

Mark Van der Merwe, Kei Ota, Dmitry Berenson, Nima Fazeli, Devesh K. Jha

Kei Ota 2 , Dmitry Berenson, Kei Ota and Devesh K. Jha are with Mitsubishi Electric Research Laboratories, USA

6D位姿估计手部姿态

面向插孔、装配等抓取操作中视觉易遮挡、纯触觉又存在位姿/接触歧义的问题,论文提出 TacGraph,将分布式 GelSight 的局部几何与受力信号放入因子图,并显式约束非穿透、接触运动学和准静态力平衡,从而联合估计手内 6D 位姿与外部接触点。真实系统实验显示其优于几何或接触感知基线,尤其在仅用触觉时优势更明显。

SC-Net: Robust Correspondence Learning via Spatial and Cross-Channel Context Figure 1
arXiv preprint2025-12-29

SC-Net: Robust Correspondence Learning via Spatial and Cross-Channel Context

Shuyuan Lin, Hailiang Liao, Qiang Qi, Junjie Huang, Taotao Lai, Jian Weng

6D位姿估计

针对两视图匹配中外点多、CNN局部感受野难以建模全局关系且GAT易过平滑的问题,SC-Net将匹配运动映射到显式空间网格,并通过AFR抑制伪运动、BFA联合建模空间长程依赖与跨通道交互,最后用PAR恢复位置一致的运动向量。实验显示其在YFCC100M和SUN3D的相对位姿估计与外点剔除任务上优于现有方法。

MCI-Net: A Robust Multi-Domain Context Integration Network for Point Cloud Registration Figure 1
the AAAI Conference on Artificial Intelligence 20262025-12-29

MCI-Net: A Robust Multi-Domain Context Integration Network for Point Cloud Registration

Shuyuan Lin, Wenwu Peng, Junjie Huang, Qiang Qi, Miaohui Wang, Jian Weng

Qingdao University of Science and Technology, Shenzhen University

6D位姿估计点云

针对点云配准中特征提取过度依赖欧氏局部邻域、难以表达隐式语义与全局结构一致性的问题,MCI-Net引入多域上下文融合:用全局图聚合结构关系,通过渐进式域内解耦与域间交互增强特征判别性,并利用多轮位姿残差动态筛选内点。实验覆盖室内RGB-D与室外LiDAR,在3DMatch上取得96.4%的注册召回率,优于已有方法。

MGCA-Net: Multi-Graph Contextual Attention Network for Two-View Correspondence Learning Figure 1
arXiv preprint2025-12-29

MGCA-Net: Multi-Graph Contextual Attention Network for Two-View Correspondence Learning

Shuyuan Lin, Mengtin Lo, Haosheng Chen, Yanjie Liang, Qiangqiang Wu

College of Cyber Security, Jinan University, Guangzhou, China, Peng Cheng Laboratory, Shenzhen, China, Department of Computer Science, City University of Hong Kong, Hong Kong, China

6D位姿估计

本文针对两视图匹配中遮挡、光照和视角变化导致的高外点率问题,认为现有方法对局部几何约束和跨阶段特征一致性建模不足。MGCA-Net通过上下文几何注意力融合位置与特征信息,并用跨阶段多稀疏图建立几何共识,以逐步优化匹配可靠性。在YFCC100M和SUN3D上,其外点剔除与相机位姿估计优于已有SOTA,但具体增益中各模块贡献仍需结合消融进一步判断。

PoseStreamer: A Multi-modal Framework for 6DoF Pose Estimation of Unseen Moving Objects Figure 1
arXiv preprint2025-12-28

PoseStreamer: A Multi-modal Framework for 6DoF Pose Estimation of Unseen Moving Objects

Huiming Yang, Linglin Liao, Fei Ding, Sibo Wang, Zijian Zeng School of Mathematics, Beijing, China @gmail.com, dingfei@email.ncu.edu.cn, ai_sibo@sina.com

School of Mathematics, Renmin University of China, Beijing, China

6D位姿估计

本文针对高速、低光下 RGB 相机运动模糊导致未见物体 6DoF 位姿跟踪失效的问题,提出融合 RGB-Event 的 PoseStreamer:用自适应位姿记忆队列稳定朝向,多模态 3D 跟踪器提升中心召回,并沿相机射线做几何筛选;同时构建 MoCapCube6D 基准。实验显示其在高速运动场景精度优于现有方法,并可作为免模板框架泛化到未见物体。

A Minimal Solver for Relative Pose Estimation with Unknown Focal Length from Two Affine Correspondences Figure 1
IEEE Robotics and Automation Letters2025-12-28

A Minimal Solver for Relative Pose Estimation with Unknown Focal Length from Two Affine Correspondences

Zhenbao Yu, Shirong Ye, Ronghe Jin, Shunkun Liang, Zibin Liu, Huiyun Zhang, Banglei Guan

National University of Defense Technology, Beijing Satellite Navigation Center, Wuhan University, Henan University

6D位姿估计相机位姿

面向SLAM/VO中半标定相机与IMU组合的两视图位姿估计,论文利用IMU给出的竖直方向将相对位姿降为3自由度,并提出仅需两个仿射对应的最小求解器;其关键是把约束化为只含焦距和相对旋转角的四个多项式方程,再用多项式特征值法求解。合成与真实数据表明,该方法在精度和数值稳定性上优于现有求解器。

Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformer Figure 1
arXiv preprint2025-12-26

Reloc-VGGT: Visual Re-localization with Geometry Grounded Transformer

Tianchen Deng, Wenhua Wu, Kunzhen Wu, Guangming Wang, Siting Zhu, Shenghai Yuan, Xun Chen, Guole Shen, Zhe Liu

Shanghai Jiao Tong University, Nanyang Technological University, Cambridge University

6D位姿估计

针对传统视觉重定位多以成对相对位姿回归并在后期做运动平均、难以充分融合多视角几何的问题,Reloc-VGGT基于VGGT引入早期多视图融合,通过位姿tokenizer与投影模块把参考帧空间关系注入注意力,并用稀疏mask attention将复杂度由二次降为近线性。约800万带位姿图像对训练后,文中报告其在多类公开数据集上提升6D相机位姿精度、泛化性与实时推理能力。

DexAvatar: 3D Sign Language Reconstruction with Hand and Body Pose Priors Figure 1
arXiv preprint2025-12-24

DexAvatar: 3D Sign Language Reconstruction with Hand and Body Pose Priors

Kaustubh Kundu, Hrishav Bakul Barua, Lucy Robertson-Bell, Zhixi Cai

Monash University, TCS Research

6D位姿估计手部姿态人体姿态三维重建

针对手语视频中仅有2D关键点、缺乏准确3D信息,且快速手势、自遮挡和运动模糊导致现有人体/手部重建不稳定的问题,DexAvatar在SMPL-X优化框架中引入面向手语的手部先验SignHPoser和身体先验SignBPoser,并结合时序一致性与接触约束,从单目野外视频重建细粒度3D手语 avatar;在SGNify动捕基准上,身体与手部姿态估计相对现有方法提升35.11%。

A General Purpose Method for Robotic Interception of Non-Cooperative Dynamic Targets Figure 1
arXiv preprint2025-12-23

A General Purpose Method for Robotic Interception of Non-Cooperative Dynamic Targets

Tanmay P. Patel, Erica L. Tevere, Erik H. Kramer, Rudranarayan M. Mukherjee

Jet Propulsion Laboratory, California Institute of Technology, © California Institute of Technology. Government sponsorship acknowledged

6D位姿估计机器人操作

面向无全局定位、视野受限和遮挡掉帧下的非合作动态目标拦截,论文提出仅依赖单目标记观测、在局部坐标系运行的通用框架,将EKF相对位姿估计、历史条件运动预测与滚动时域凸优化规划解耦组合。其价值在于跨平台适配而非特定机器人调参;在无人机降落、地面车会合/跟随和航天器近距操作的仿真与实机中,报告了较低拦截误差、高成功率,并可在Jetson、VOXL2、树莓派等嵌入式设备实时运行。

AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment Figure 1
arXiv preprint2025-12-23

AlignPose: Generalizable 6D Pose Estimation via Multi-view Feature-metric Alignment

Anna Šárová Mikeštíková, Médéric Fourmy, Martin Cífka, Josef Sivic, Robotics, Cybernetics

Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, Faculty of Electrical Engineering, Czech Technical University in Prague

6D位姿估计多视角

针对单视角 RGB 6D 位姿易受深度歧义、遮挡和杂乱影响,而现有多视角方法又依赖精确单视角结果或对象专训的问题,AlignPose 将多视角候选统一到世界坐标系,并用冻结视觉基础模型特征进行在线渲染—观测的多视角特征度量对齐,直接优化一致物体位姿。其无需对象特定训练和对称标注,在六个 BOP 数据集上优于已发表 RGB 多视角方法,工业场景增益尤为明显。

SirenPose: Dynamic Scene Reconstruction via Geometric Supervision Figure 1
arXiv preprint2025-12-23

SirenPose: Dynamic Scene Reconstruction via Geometric Supervision

Kaitong Cai, Jesen Zhang, Jing Yang, Keze Wang

Sun Yat-sen University

6D位姿估计三维重建

SirenPose针对单目动态三维重建在快速运动、遮挡和多目标交互中易出现轨迹抖动与几何不一致的问题,提出将SIREN高频表示与关键点几何/物理约束结合的监督损失,并扩展UniKPT到60万标注、用GNN建模关键点关系。在DAVIS等数据集上,相比MoSCA降低FVD/FID并提升时序一致性;位姿指标上也优于Monst3R,但部分增益可能来自数据规模扩大。

Differentially Private Feature Release for Wireless Sensing: Adaptive Privacy Budget Allocation on CSI Spectrograms Figure 1
arXiv preprint2025-12-26

Differentially Private Feature Release for Wireless Sensing: Adaptive Privacy Budget Allocation on CSI Spectrograms

41380 Kocaeli, Turkey ipek.yilmaz@kocaeli.edu.tr Ayazaga Campus, Maslak, 34469 Istanbul, Turkey, 54050 Sakarya, Turkey onur.tuncer@sakarya.edu.tr Ayazaga Campus, 34220 Istanbul, Turkey zeynep.aksoy@yildiz.edu.tr Ayazaga Campus, Turkey baydemir19@itu.edu.tr

Department of Electronics & Communication Engineering, Kocaeli University, Department of Computer Engineering, Sakarya University, Department of Electrical Engineering, Yildiz Technical University, Department of Electrical & Electronics Engineering, Istanbul Technical University (ITU)

6D位姿估计

面向 Wi‑Fi/RF 感知中特征共享会泄露身份、位置和成员关系的问题,论文将差分隐私用于 CSI 时频谱发布。核心做法是先裁剪控制敏感度,再按梯度显著性等任务重要性在谱图块间自适应分配隐私预算,对关键区域少加噪、低价值区域强扰动。作者在活动识别、Person-in-WiFi 3D 姿态和呼吸监测上报告其相较均匀加噪改善隐私—效用权衡,在 ε=0.5–2 下精度/姿态误差更好且攻击泄漏更低。

Enhancing annotations for 5D apple pose estimation through 3D Gaussian Splatting (3DGS) Figure 1
arXiv preprint2025-12-23

Enhancing annotations for 5D apple pose estimation through 3D Gaussian Splatting (3DGS)

Robert van de Ven, Trim Bresilla, Bram Nelissen, Ard Nieuwenhuizen, Eldert J. van Henten, Gert Kootstra

6D位姿估计三维重建高斯泼溅

面向果园采摘中苹果遮挡导致5D位姿标注困难且多视角标签不一致的问题,论文用3D Gaussian Splatting重建果园场景,在3D中少量标注后自动投影到图像并量化遮挡率。该流程以105个人工标注生成28,191个训练标签,人工量减少99.6%;遮挡率≤95%的标签训练效果最好,原图中性F1为0.927、渲染图为0.970,但所测方法仍未能可靠学习苹果朝向。

milliMamba: Specular-Aware Human Pose Estimation via Dual mmWave Radar with Multi-Frame Mamba Fusion Figure 1
arXiv preprint2025-12-23

milliMamba: Specular-Aware Human Pose Estimation via Dual mmWave Radar with Multi-Frame Mamba Fusion

Niraj Prakash Kini, Shiau-Rung Tsai, Guan-Hsun Lin, Wen-Hsiao Peng, Ching-Wen Ma, Taiwan, USA @nycu.edu.tw, wpeng@cs.nycu.edu.tw, machingwen@nycu.edu.tw, hwang@uw.edu

National Yang Ming Chiao Tung University, Taiwan, University of Washington, USA

6D位姿估计人体姿态

针对毫米波雷达人体姿态估计中镜面反射导致关节点稀疏、单帧难以补全的问题,milliMamba用3D FFT热图降低输入开销,并以跨视角Mamba编码器结合时空交叉注意力解码器进行双雷达、多帧建模和多帧监督,辅以速度损失提升平滑性。在TransHuPR和HuPR上分别较基线提升11.0 AP和14.6 AP,显示长时序上下文对缺失关节恢复有效。

Trifocal Tensor and Relative Pose Estimation with Known Vertical Direction Figure 1
IEEE Robotics and Automation Letters2025-12-22

Trifocal Tensor and Relative Pose Estimation with Known Vertical Direction

Tao Li, Zhenbao Yu, Banglei Guan, Jianli Han, Weimin Lv, Friedrich Fraundorfer

Civil Aviation University of China, Naval Aeronautical and Astronautical University, National University of Defense Technology, Graz University of Technology

6D位姿估计相机位姿

面向SLAM、视觉里程计中相机-IMU常见且外点较多的三视图相对位姿估计问题,论文利用已知竖直方向将未知量降为两个旋转角和两个平移向量,提出4点线性闭式解与3点Gröbner基最小解,便于嵌入RANSAC降低采样需求。合成数据和KITTI实验显示其位姿精度优于若干两视图与三视图替代方法,同时4点解可在CPU上实时运行。

6DAttack: Backdoor Attacks in the 6DoF Pose Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20262025-12-22

6DAttack: Backdoor Attacks in the 6DoF Pose Estimation

Jihui Guo, Zongmin Zhang, Zhen Sun, Yuhao Yang, Jinlin Wu, Fu Zhang, Xinlei He : 1

University of Hong Kong, Beihang University, Centre for Artificial Intelligence and Robotics

6D位姿估计

针对6DoF位姿估计在机器人等场景中被广泛使用但后门风险少被研究的问题,论文提出6DAttack,用合成或真实3D物体作为触发器,并结合视角投影与目标位姿标签注入可控错误位姿。其在PVNet、DenseFusion、PoseDiffusion及LINEMOD、YCB-Video、CO3D上验证,干净样本性能最高仍达100% ADD,触发时ASR可达100%、ADD-P达97.70%,简单干净数据微调防御仍难以移除后门。

A two-stream network with global-local feature fusion for bone age assessment Figure 1
arXiv preprint2025-12-20

A two-stream network with global-local feature fusion for bone age assessment

Technology Hangzhou, China lufang@zust.edu.cn

School of Science, Zhejiang University of Science and Technology

6D位姿估计

针对骨龄评估中整手全局成熟度与局部骨骼细节难以兼顾的问题,本文提出 BoNet+ 双流网络:全局分支用 Transformer 建模整手 X 光信息,局部分支用 RFAConv 扩展关键点注意覆盖并提取多尺度局部特征,融合后经 Inception-V3 回归骨龄。在 RSNA 与 RHPE 上 MAE 分别为 3.81、5.65 个月,达到接近 SOTA 的自动评估精度。

SurgiPose: Estimating Surgical Tool Kinematics from Monocular Video for Surgical Robot Learning Figure 1
arXiv preprint2025-12-19

SurgiPose: Estimating Surgical Tool Kinematics from Monocular Video for Surgical Robot Learning

Juo-Tung Chen, XinHao Chen, Ji Woong Kim, Paul Maria Scheikl, Richard Jaepyeong Cha, Axel Krieger

Johns Hopkins University

6D位姿估计人体姿态机器人操作医学/手术

SurgiPose针对临床/公开视频缺少机器人运动学、难以用于手术模仿学习的问题,提出从单目内窥视频中恢复器械6D位姿和关节角的流程:先用分割与粗位姿初始化,再通过可微渲染逐帧优化真实图像与渲染图像差异。在dVRK组织提拉和取针任务中,轨迹误差约9.7/12.0 mm,用估计运动学训练的策略成功率达70%/60%,接近真值运动学训练结果。

G3Splat: Geometrically Consistent Generalizable Gaussian Splatting Figure 1
arXiv preprint2025-12-19

G3Splat: Geometrically Consistent Generalizable Gaussian Splatting

Mehdi Hosseinzadeh : 1 : 2, Shin-Fang Chng : 1, Yi Xu, Simon Lucey, Ian Reid, Goertek Alpha Labs, MBZUAI m80hz.github.io/g3splat

Australian Institute for Machine Learning Goertek Alpha Labs MBZUAI

6D位姿估计三维重建高斯泼溅

本文针对可泛化 Gaussian Splatting 仅靠新视角合成损失会学到外观正确但几何退化的 splats(法向、尺度、透明度无意义)这一问题,提出 G3Splat,在 DUSt3R/VGGT 式点预测框架上加入表面法向一致的方向先验与像素网格对齐约束,缓解结构—位姿歧义。模型在 RE10K 上实现几何重建、相对位姿估计和新视角合成的 SOTA,并在 ScanNet 上零样本泛化优于既有方法。

Adaptive Covariance and Quaternion-Focused Hybrid Error-State EKF/UKF for Visual-Inertial Odometry Figure 1
International Journal of Computational Intelligence Systems2025-12-19

Adaptive Covariance and Quaternion-Focused Hybrid Error-State EKF/UKF for Visual-Inertial Odometry

Ufuk Asıl, Efendi Nasıbov

Dokuz Eylül University

6D位姿估计相机位姿

面向无人机在运动模糊、光照变化和弱纹理下视觉可靠性波动导致的VIO失稳问题,论文采用松耦合框架,将ESKF用于全状态传播、SUKF仅用于四元数姿态细化,并用图像熵、亮度变化、模糊和推理质量经CASEF自适应调整视觉测量协方差。EuRoC MAV实验显示,困难场景位置精度平均提升49%,相对ESKF旋转精度提升57%,同时较完整SUKF计算成本降低约48%。

VAIR: Visual Analytics for Injury Risk Exploration in Sports Figure 1
arXiv preprint2025-12-19

VAIR: Visual Analytics for Injury Risk Exploration in Sports

Scott A Epsley Gotham FC

Harvard University, Dolby Laboratories, Aarhus University, University of Louisville

6D位姿估计

针对真实比赛视频中伤病风险事件难以从原始画面高效定位和解释的问题,VAIR将视频三维人体重建、姿态估计、生物力学仿真与同步可视分析结合,把关节角、角速度、内力等低层信号关联到可解释的风险机制。篮球跟腱与ACL案例及专家反馈显示,该系统能帮助更快识别高风险片段并支持诊断推理和干预规划,但量化精度提升文中未充分说明。

Globally Optimal Solution to the Generalized Relative Pose Estimation Problem using Affine Correspondences Figure 1
IEEE Transactions on Circuits and Systems for Video Technology2025-12-19

Globally Optimal Solution to the Generalized Relative Pose Estimation Problem using Affine Correspondences

Zhenbao Yu, Banglei Guan, Shunkun Liang, Zibin Liu, Yang Shang, Qifeng Yu

National University of Defense Technology

6D位姿估计相机位姿

面向自动驾驶等多相机与 IMU 平台的广义相对位姿估计,论文针对已知竖直方向下仅用点对应或最小仿射对应精度受限的问题,提出利用 N 个仿射对应的全局最优求解器:先解耦旋转与平移,将仿射几何约束写成关于单一旋转角的代价,再转化为多项式特征值问题,并给出小旋转线性近似。合成与真实数据实验显示其相对同类方法位姿精度更高。

PoseMoE: Mixture-of-Experts Network for Monocular 3D Human Pose Estimation Figure 1
IEEE Transactions on Image Processing2025-12-18

PoseMoE: Mixture-of-Experts Network for Monocular 3D Human Pose Estimation

Mengyuan Liu, Jiajie Liu, Jinyan Zhang, Wenhao Li, Junsong Yuan

Peking University, Nanyang Technological University, Nanyang Institute of Technology, University at Buffalo, State University of New York

6D位姿估计人体姿态

本文针对单目3D人体姿态提升方法中2D坐标较可靠、深度却高度不确定却被同一编码器纠缠建模的问题,指出早期融合会让深度歧义侵蚀2D结构。PoseMoE用专家网络分别细化2D姿态与学习深度,再通过跨专家时空知识聚合进行双向补充。在Human3.6M、MPI-INF-3DHP和3DPW上优于传统lifting方法,并报告更好的鲁棒性与较少参数。

Avatar4D: Synthesizing Domain-Specific 4D Humans for Real-World Pose Estimation Figure 1
arXiv preprint2025-12-18

Avatar4D: Synthesizing Domain-Specific 4D Humans for Real-World Pose Estimation

Jerrin Bright, Zhibo Wang, Dmytro Klepachevskyi, Yuhao Chen, Sirisha Rambhatla, David Clausi, John Zelek Vision, Image Processing Lab, Critical ML Lab, Canada @uwaterloo.ca

Vision and Image Processing Lab, Critical ML Lab, University of Waterloo, Canada

6D位姿估计

针对真实人体姿态估计中领域动作稀缺、标注昂贵且通用合成数据难以覆盖运动场景的问题,Avatar4D用互联网视频提取动作、单图生成可动画化3D人体资产,并可控渲染姿态、外观、视角和背景,构建Syn2Sport棒球/冰球4D合成数据。实验显示其可用于监督训练、跨运动泛化和合成到真实零样本迁移,并在特征空间更接近真实数据;具体增益可能主要来自更贴近目标域的数据构造。

LAPX: Lightweight Hourglass Network with Global Context Figure 1
arXiv preprint2025-12-18

LAPX: Lightweight Hourglass Network with Global Context

Zhao, Haopeng, Marsha Mariya Kappan, Mahdi Bamdad, Francisco Cruz

School of Computer Science and Engineering, University of New South Wales, Sydney, Australia

6D位姿估计

面向边缘设备上的实时人体姿态估计,LAPX试图缓解轻量模型“快但不准”或FLOPs低却实际延迟高的问题。其核心是在轻量Hourglass框架中重新权衡三阶段堆叠与单阶段容量,引入ECA-NonLocal获取全局上下文,并用ECA-CBAM和软门控残差改进信息流。模型约2.3M参数,在MPII达88.6 PCKh@0.5,在COCO达70.6/72.1 AP,并在Apple M2 CPU上超过15 FPS。

Robust Multi-view Camera Calibration from Dense Matches Figure 1
arXiv preprint2025-12-17

Robust Multi-view Camera Calibration from Dense Matches

Johannes Hägerlind, Bao-Long Tran, Urs Waldmann, Per-Erik Forssén

Computer Vision Laboratory, Linköping University, Linköping, Sweden

6D位姿估计多视角

面向野外动物行为、取证等无标定多相机且常有畸变的场景,论文将密集匹配与传统 SfM 几何结合,重点研究循环一致性/三角化评分的对应点子采样,以及增量加入视角的选择策略,也可用 VGGT 初始化全局 SfM。实验显示该设计在多种相机配置上更稳健,强径向畸变场景成功率由 vanilla VGGT 的 40.4% 提升到 79.9%。

BLANKET: Anonymizing Faces in Infant Video Recordings Figure 1
arXiv preprint2025-12-17

BLANKET: Anonymizing Faces in Infant Video Recordings

Ditmar Hadera, Jan Cech, Miroslav Purkrabek, Matej Hoffmann

Czech Technical University in Prague

6D位姿估计

面向婴幼儿视频数据共享中的隐私与伦理约束,BLANKET不采用模糊/遮挡,而是先用扩散模型修补生成与原婴儿相容的新身份,再通过时序一致的人脸交换把表情、凝视和头部状态迁移到整段视频。实验在婴儿短视频上对比 DeepPrivacy2,显示两者均能改变身份,但该方法在属性保留、伪影控制以及对人体/面部关键点姿态估计的影响上更优。

Off The Grid: Detection of Primitives for Feed-Forward 3D Gaussian Splatting Figure 1
arXiv preprint2025-12-17

Off The Grid: Detection of Primitives for Feed-Forward 3D Gaussian Splatting

Arthur Moreau, Richard Shaw, Michal Nazarczuk, Jisu Shin, Thomas Tanay Zhensong Zhang, Songcen Xu

Huawei Noah’s Ark Lab

6D位姿估计三维重建高斯泼溅

本文针对前馈式 3DGS 仍按像素或体素规则网格放置高斯、导致原语冗余且细节/伪影受限的问题,提出 Off-The-Grid 解码器:在图像 patch 内以类似关键点检测的方式预测亚像素高斯位置,并按 Shannon 熵自适应分配密度、用置信度剪枝;结合 VGGT 通过光度监督端到端训练。实验显示其在多数据集新视角合成上优于 AnySplat、DepthAnything3,并以约 7 倍更少原语获得更干净的几何与渲染。

RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting Figure 1
arXiv preprint2025-12-17

RUMPL: Ray-Based Transformers for Universal Multi-View 2D to 3D Human Pose Lifting

Seyed Abolfazl Ghasemzadeh, Alexandre Alahi, Christophe De Vleeschouwer

EPFL, Lausanne, Switzerland

6D位姿估计人体姿态多视角

多视角人体3D姿态提升受遮挡、投影歧义和真实多视角3D标注稀缺限制,现有方法常绑定固定相机。RUMPL将2D关键点表示为世界坐标中的3D射线,并用View Fusion Transformer融合任意视角射线,在随机相机合成数据上训练以摆脱标定和视角数依赖;实验显示相较三角化MPJPE最高降53%,较图像表示Transformer基线降逾60%。

See It Before You Grab It: Deep Learning-based Action Anticipation in Basketball Figure 1
arXiv preprint2025-12-17

See It Before You Grab It: Deep Learning-based Action Anticipation in Basketball

Arnau Barrera-Roy, Albert Clapés, Universitat de Barcelona

Computer Vision Center

6D位姿估计

这篇工作关注体育视频中少被研究的“动作发生前预测”,以篮球投篮后的篮板归属为目标;虽被仓库归入6D Pose,论文实质是视频动作预判。核心贡献是自建含10万片段、300小时以上视频和2000余个人工篮板标注的数据集,并定义离线/在线篮板预判及分类、定位任务。实验用现有动作预判方法给出首批基线,结果表明任务可行但受遮挡、多人争抢和球反弹随机性影响仍很困难。

NAP3D: NeRF Assisted 3D-3D Pose Alignment for Autonomous Vehicles Figure 1
arXiv preprint2025-12-17

NAP3D: NeRF Assisted 3D-3D Pose Alignment for Autonomous Vehicles

Gaurav Bansal

6D位姿估计三维重建

针对自动驾驶长时运行中里程计噪声与漂移、且传统 SLAM 回环需重访场景的问题,NAP3D用预训练 NeRF 作为环境锚点,将当前深度图与 NeRF 合成视图中的关键点提升为3D-3D对应,并通过 Procrustes 对齐直接修正位姿。实验显示其在自建数据上可将相机位姿误差控制在5厘米内,在 TUM RGB-D 上相较2D-3D PnP基线降低约6厘米的3D对齐RMSE,但动态场景与真实自主系统验证仍文中未充分说明。

Isolated Sign Language Recognition with Segmentation and Pose Estimation Figure 1
arXiv preprint2025-12-16

Isolated Sign Language Recognition with Segmentation and Pose Estimation

Daniel Perkins, Davis Hunter, Dhrumil Patel, Galen Flanagan

6D位姿估计

该文面向 ASL 孤立词识别中单词样本少、签名者差异大且视频模型计算开销高的问题,提出将 MediaPipe 手/脸关键点、基于关键点的分割掩码与 ResNet–Transformer 时空建模结合,以减少背景干扰并保留姿态信息。受算力限制,完整模型未能在全量数据上训练,实验改用降采样数据且暂时移除分割视频输入;最终验证准确率达 68.5%、Top-5 接近 90%,高于基线并接近下采样设置下的 SOTA,但完整增益来源仍未充分说明。

FastDDHPose: Towards Unified, Efficient, and Disentangled 3D Human Pose Estimation Figure 1
arXiv preprint2025-12-16

FastDDHPose: Towards Unified, Efficient, and Disentangled 3D Human Pose Estimation

Qingyuan Cai, Linxin Zhang, Xuecai Hu, Saihui Hou, Yongzhen Huang

6D位姿估计人体姿态

针对单目3D人体姿态估计中训练评测框架不统一、扩散先验难以显式刻画骨骼结构且层级误差易累积的问题,论文提出Fast3DHPE统一框架,并在其中设计FastDDHPose:在扩散过程中解耦建模骨长与骨方向,配合运动学层级时空去噪器聚焦关节层级关系。Human3.6M与MPI-INF-3DHP实验显示其在统一协议下达到SOTA,同时减少参数、训练时间和计算量。

LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstruction Figure 1
arXiv preprint2025-12-15

LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstruction

Tianye Ding, Yiming Xie, Yiqing Liang, Moitreya Chatterjee, Pedro Miraldo, Independent Researcher, Mitsubishi Electric Research Laboratories

Northeastern University Independent Researcher Mitsubishi Electric Research Laboratories

6D位姿估计三维重建

LASER针对VGGT、π³等前馈离线重建模型难以处理长视频流的问题,提出无需训练的滑窗对齐框架。其关键洞察是全局Sim(3)无法处理不同深度层的尺度漂移,因此按深度层估计并传播尺度因子来统一相邻窗口。实验显示其在相机位姿和点图重建上优于已有流式方法,并以约14 FPS、6GB显存支持公里级视频处理。

Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video Figure 1
arXiv preprint2025-12-16

Audio-Visual Camera Pose Estimation with Passive Scene Sounds and In-the-Wild Video

Daniel Adebi, Sagnik Majumder, Kristen Grauman

6D位姿估计相机位姿

这篇论文针对弱光、遮挡、运动模糊等场景中纯视觉相机相对位姿估计不稳的问题,提出把被动环境声作为几何线索引入。方法在 Reloc3r 类视觉模型上融合 DOA 方向谱与单声道到双耳化嵌入,利用真实野外视频训练而非主动发声或仿真声学。实验在 Ego-Exo4D 与 HM3D-SS 上较强视觉和音视觉基线取得稳定提升,并在视觉退化时更鲁棒,但平移估计在复杂声场中仍有局限。

A Multi-Mode Structured Light 3D Imaging System with Multi-Source Information Fusion for Underwater Pipeline Detection Figure 1
arXiv preprint2025-12-12

A Multi-Mode Structured Light 3D Imaging System with Multi-Source Information Fusion for Underwater Pipeline Detection

Qinghan Hu, Haijiang Zhu, Na Sun, Lei Chen, Zhengqiang Fan, Zhiqing Li

College of Information Science and Technology, Beijing University of Chemical Technology, Beijing 100029, China, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China, College of Intelligent Science and Engineering, Beijing University of Agriculture, Beijing 102206, China

6D位姿估计

面向水下管道腐蚀检测中人工巡检风险高、声学分辨率不足和视觉易退化的问题,论文构建了多模式结构光三维成像系统UW-SLD,将结构光、声学与惯性信息融合,并结合快速畸变校正、因子图外参标定、AEKF位姿融合及边缘检测增强ICP,以适应平移、旋转等扫描模式。实验覆盖不同模式、速度和深度,显示系统在精度、鲁棒性和适应性上优于对比方案,但具体增益的模块归因仍需更多消融支撑。

SceneMaker: Open-set 3D Scene Generation with Decoupled De-occlusion and Pose Estimation Model Figure 1
arXiv preprint2025-12-11

SceneMaker: Open-set 3D Scene Generation with Decoupled De-occlusion and Pose Estimation Model

Yukai Shi, Weiyu Li, Zihao Wang, Hongyang Li, Xingyu Chen, Ping Tan, Lei Zhang

Tsinghua University HKUST IDEA Research LightIllusions

6D位姿估计

SceneMaker针对开放集单图3D场景生成中遮挡严重时几何质量与6D位姿难以兼顾的问题,将去遮挡、物体生成和位姿估计解耦,分别利用图像、3D物体和场景数据学习先验;其去遮挡模型用10K数据增强开放遮挡模式,位姿扩散模型联合预测旋转、平移与尺寸并引入局部/全局注意力,还构建200K合成场景提升泛化。实验显示其在室内与开放集场景的几何质量和位姿精度均优于对比方法。

E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-training Figure 1
arXiv preprint2025-12-11

E-RayZer: Self-supervised 3D Reconstruction as Spatial Visual Pre-training

Code: qitaozhao.github.io/E-RayZer

Carnegie Mellon University, Adobe Research, Harvard University

6D位姿估计三维重建

针对3D视觉预训练仍依赖SfM伪标签、难以从无标注多视图中学习空间表征的问题,E-RayZer将自监督目标从潜空间视图合成改为显式3D Gaussian重建,同时预测相机与几何,并用基于视图重叠的课程学习解决收敛和多源数据对齐。实验显示其在姿态估计上明显优于RayZer,重建可接近或超过匹配设置的监督VGGT,并在多项3D下游任务上优于DINOv3、CroCo v2等预训练表征。

PoseGAM: Robust Unseen Object Pose Estimation via Geometry-Aware Multi-View Reasoning Figure 1
arXiv preprint2025-12-11

PoseGAM: Robust Unseen Object Pose Estimation via Geometry-Aware Multi-View Reasoning

KAUST, @kaust.edu.sa

6D位姿估计物体位姿未知物体多视角

PoseGAM针对未知物体6D位姿中显式匹配易受外观差异和模板/实拍域差影响的问题,借鉴多视角基础模型,将查询图与多模板端到端联合推理,并把显式点几何与几何网络特征投回视图表示以融入物体形状。其还构建19万余物体合成数据集,结果在多基准上平均AR提升5.1%、单数据集最高17.6%,但部分增益可能主要来自scaling / data。

Geo6DPose: Fast Zero-Shot 6D Object Pose Estimation via Geometry-Filtered Feature Matching Figure 1
arXiv preprint2025-12-11

Geo6DPose: Fast Zero-Shot 6D Object Pose Estimation via Geometry-Filtered Feature Matching

Javier Villena Toro

Linköping University

6D位姿估计物体位姿

Geo6DPose针对零样本6D位姿方法依赖大模型/云端、难以在机器人端低延迟部署的问题,主张用几何可靠性替代模型规模:以DINO模板与场景patch特征建立相似匹配,再借助深度投影形成3D–3D互对应,通过RANSAC和加权几何对齐评分筛选位姿。实验在BOP未见物体设置下达到53.7 AR、1.08 FPS,精度接近更重的零样本基线且可单GPU本地亚秒推理。

Mr. Virgil: Learning Multi-robot Visual-range Relative Localization Figure 1
arXiv preprint2025-12-11

Mr. Virgil: Learning Multi-robot Visual-range Relative Localization

Si Wang, Zhehan Li, Jiadong Lu, Rong Xiong, Yanjun Cao, Yue Wang

Institute of Cyber-Systems and Control, Zhejiang University, China, Huzhou Institute of Zhejiang University, Huzhou, China

6D位姿估计机器人操作

针对多机器人相对定位中视觉检测匿名、UWB测距噪声导致的数据关联易错且依赖ID硬件或手工规则的问题,Mr. Virgil用GNN结合Sinkhorn进行全局匹配、初值与不确定性预测,并将其接入可微PGO端到端优化,同时实现去中心化部署。仿真与真实、遮挡与非遮挡及不同机器人数量实验表明,其定位精度和稳定性优于传统方法。

An M-Health Algorithmic Approach to Identify and Assess Physiotherapy Exercises in Real Time Figure 1
arXiv preprint2025-12-11

An M-Health Algorithmic Approach to Identify and Assess Physiotherapy Exercises in Real Time

Stylianos Kandylakis, Christos Orfanopoulos, Georgios Siolas, Panayiotis Tsanakas

School of Electrical and Computer Engineering, National Technical University of Athens

6D位姿估计

面向疫情后远程康复中动态动作难以仅靠静态姿态分类监督的问题,本文将手机端姿态估计、基于关节角的kNN姿态分类与改进Levenshtein动态规划串联,把运动视作姿态序列来识别并定位偏差。系统可在普通智能手机本地实时运行,用于异步物理治疗监测;但文中主要报告参数调优和可行性,定量精度与相对基线增益未充分说明。

Point2Pose: A Generative Framework for 3D Human Pose Estimation with Multi-View Point Cloud Dataset Figure 1
arXiv preprint2025-12-11

Point2Pose: A Generative Framework for 3D Human Pose Estimation with Multi-View Point Cloud Dataset

Hyunsoo Lee, Daeum Jeon, Hyeokjae Oh ECE, KAIST, Soulart Inc. philip21@snu.ac.kr, @kaist.ac.kr

ECE, Seoul National University CS, KAIST Soulart Inc

6D位姿估计人体姿态点云数据集/基准多视角

针对点云人体姿态估计中自遮挡、人体几何复杂以及缺少真实多视角密集数据的问题,Point2Pose直接在原始时序点云上引入条件扩散与最优传输条件流匹配,并用关节级时空点云/姿态编码建模点—关节交互;同时发布含IMU、RGB和多视角点云的MVPose3D。实验显示其在多数据集、稀疏和噪声场景下优于基线。

THE-Pose: Topological Prior with Hybrid Graph Fusion for Estimating Category-Level 6D Object Pose Figure 1
arXiv preprint2025-12-11

THE-Pose: Topological Prior with Hybrid Graph Fusion for Estimating Category-Level 6D Object Pose

Eunho Lee, Chaehyeon Song, Seung-hoon Jeong, Ayoung Kim

Seoul National University

6D位姿估计物体位姿类别级位姿

THE-Pose针对类别级6D位姿中类内形变、遮挡和复杂形状下仅依赖点云3D图卷积缺少全局上下文的问题,引入由RGB表面嵌入提取的拓扑先验,并通过TGC与HGF将其和点云局部几何自适应融合。实验在CAMERA25/REAL275上报告达到新SOTA,其中REAL275较HS-Pose提升35.8%,较此前最佳整体提升7.2%。

FastPose-ViT: A Vision Transformer for Real-Time Spacecraft Pose Estimation Figure 1
arXiv preprint2025-12-10

FastPose-ViT: A Vision Transformer for Real-Time Spacecraft Pose Estimation

Pierre Ancey, Andrew Price, Saqib Javed, Mathieu Salzmann EPFL, Swiss Data Science Center Lausanne, Switzerland @epfl.ch

EPFL, Swiss Data Science Center

6D位姿估计航天器

面向在轨服务和碎片清除中受功耗约束的单目航天器6D位姿估计,FastPose-ViT用裁剪框上的ViT直接回归替代迭代PnP,并通过“表观旋转”和投影几何闭式校正把局部预测还原到全图位姿。其在SPEED/SPEED+上刷新非PnP方法表现、接近强PnP管线,且经TensorRT/FP16部署后在Jetson Orin Nano上可达75 ms延迟或并发33 FPS。

Development and Testing for Perception Based Autonomous Landing of a Long-Range QuadPlane Figure 1
arXiv preprint2025-12-11

Development and Testing for Perception Based Autonomous Landing of a Long-Range QuadPlane

Ashik E Rasul, Humaira Tasnim 1 Graduate Student, 1 William L Jones Dr, Cookeville, TN 38505, Ji Yu Kim, Young Hyun Lim 2 Equal Contribution, Scott Schmitz 3 Undergraduate Student, Bruce W. Jo 4 Associate Professor, Hyung-Jin Yoon 5 Assistant Professor

Graduate Student, Mechanical Engineering Department, William L Jones Dr, Cookeville, TN, Scott Schmitz, Undergraduate Student, Mechanical Engineering Department, William L Jones Dr, Cookeville, TN, Associate Professor, Mechanical Engineering Department, William L Jones Dr, Cookeville, TN, Assistant Professor, Mechanical Engineering Department, William L Jones Dr, Cookeville, TN

6D位姿估计

面向GPS受限、城市杂乱环境中长航时QuadPlane难以依赖预设降落场的问题,论文将YOLO降落点检测、RGB/RGB-D感知与VIO共同压缩部署到Jetson Orin Nano Super,并把CARLA训练流程升级到UE5以缩小仿真到真实差距。系统完成2.4米翼展、约4.56 kg平台的结构加固、传感器与航电集成及初步飞测;但自主降落成功率、定位误差等定量结果文中未充分说明。

ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectors Figure 1
arXiv preprint2025-12-09

ConceptPose: Training-Free Zero-Shot Object Pose Estimation using Concept Vectors

Liming Kuang, Yordanka Velikova, Mahdi Saleh, Jan-Nico Zaech, Danda Pani Paudel, Munich Center for Machine Learning INSAIT

Technical University of Munich Munich Center for Machine Learning, INSAIT, Sofia University “St. Kliment Ohridski”

6D位姿估计物体位姿

针对现有6D位姿方法依赖CAD模型、标注姿态和数据集特定训练、难以泛化到新物体的问题,ConceptPose将VLM的语言概念作为跨视角描述符,通过显著图生成开放词汇3D概念图,并匹配概念向量建立3D-3D对应来估计相对6DoF位姿。该方法无需训练和物体模型,在零样本相对位姿基准上超过强基线,平均ADD(-S)相对提升62%。

Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignment Figure 1
arXiv preprint2025-12-09

Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignment

Youming Deng, Songyou Peng, Junyi Zhang, Kathryn Heal, Tiancheng Sun, John Flynn, Steve Marschner, Lucy Chai, Google, UC Berkeley

Cornell University, Google, UC Berkeley

6D位姿估计三维重建

Selfi 针对 VGGT 等 3D 视觉基础模型虽能从未标定图像前馈预测相机与结构、但特征缺少跨视角几何一致性的问题,冻结 VGGT 并用其深度/位姿输出作伪监督,通过重投影一致性训练轻量特征适配器,得到更符合 3D 空间邻近关系的特征。该特征用于 3D Gaussian 新视角合成和匹配式 BA 位姿细化,在无位姿 NVS 与相机位姿估计基准上取得 SOTA,并在稀疏视角和较长序列中优于原始 VGGT 特征。

SDT-6D: Fully Sparse Depth-Transformer for Staged End-to-End 6D Pose Estimation in Industrial Multi-View Bin Picking Figure 1
arXiv preprint2025-12-09

SDT-6D: Fully Sparse Depth-Transformer for Staged End-to-End 6D Pose Estimation in Industrial Multi-View Bin Picking

Nico Leuze, Maximilian Hoh, Samed Doğan, Nicolas R.-Peña, 80335 Munich, Germany nico.leuze@hm.edu, alfred.schoettl@hm.edu

Institute for Applications of Machine Learning and Intelligent Systems, University of Applied Science Munich, Munich, Germany

6D位姿估计彩色深度机器人操作多视角

面向工业料箱抓取中遮挡、反光和无纹理零件导致的6D位姿难题,SDT-6D以深度多视角融合为输入,采用全稀疏TSDF/点云表示、分阶段热图前景聚焦、密度感知稀疏Transformer和逐体素投票,在不依赖实例裁剪的情况下整场景预测任意数量目标。IPD与MV-YCB实验显示其在拥挤场景具备竞争力,高分辨率与双分支注意力带来稳定收益,但仍受几何退化物体限制。

Zero-Splat TeleAssist: A Zero-Shot Pose Estimation Framework for Semantic Teleoperation Figure 1
arXiv preprint2025-12-09

Zero-Splat TeleAssist: A Zero-Shot Pose Estimation Framework for Semantic Teleoperation

Srijan Dokania, Dharini Raghavan

6D位姿估计

针对远程操作中机载视野受限、遮挡和多机器人全局态势难以维护的问题,Zero-Splat TeleAssist利用现有CCTV,将零样本文本分割、单目深度、加权PCA 6D位姿估计与3DGS地图融合,无需标记物或机器人外观训练。实验在多类机器人上达到接近VIO的精度,10Hz位姿估计可在Jetson Orin运行,并在人因实验中使任务完成时间缩短32%、NASA-TLX降低27%。

UltrasODM: A Dual Stream Optical Flow Mamba Network for 3D Freehand Ultrasound Reconstruction Figure 1
arXiv preprint2025-12-08

UltrasODM: A Dual Stream Optical Flow Mamba Network for 3D Freehand Ultrasound Reconstruction

India anandmayank698@gmail.com, India, Mathematics Universitat Rovira i Virgili Tarragona, Spain

Department of Information Technology, Indian Institute of Information Technology Allahabad, Department of Electronics & Communication, Department of Computer Engineering and Mathematics

6D位姿估计手部姿态三维重建

针对自由手超声中探头快速运动、亮度变化导致无外部跟踪的3D重建位姿漂移,UltrasODM用对比排序建立运动相似先验,并将光流与双流Mamba时序建模结合,同时加入逐帧不确定性、显著性图和HITL提示来指导重扫或放慢扫描。在临床数据上相对UltrasOM将漂移、距离误差和Hausdorff距离分别降低15.2%、12.1%和10.1%,但泛化范围与各模块增益来源仍需更多消融说明。

UnCageNet: Tracking and Pose Estimation of Caged Animal Figure 1
arXiv preprint2025-12-08

UnCageNet: Tracking and Pose Estimation of Caged Animal

Sayak Dutta, Harish Katti, Shashikant Verma, Shanmuganathan Raman

Indian Institute of Technology Gandhinagar, National Institutes of Health (NIH), Bethesda

6D位姿估计

该文针对笼栏、网格等系统性遮挡会使 STEP、ViTPose 在动物跟踪与姿态估计中产生误检、轨迹断裂的问题,提出不改动下游模型的三阶段预处理:用含 72 个方向 Gabor 核的 ResNet-UNet 分割笼体,再用 CRFill 修复遮挡区域,最后在“去笼”帧上估计姿态。实验称关键点检测和轨迹一致性明显改善、性能接近无遮挡场景,但具体量化增益和数据规模文中未充分说明。

VFM-VLM: Vision Foundation Model and Vision Language Model based Visual Comparison for 3D Pose Estimation Figure 1
arXiv preprint2025-12-09

VFM-VLM: Vision Foundation Model and Vision Language Model based Visual Comparison for 3D Pose Estimation

Md Selim Sarowar, Sungho Kim

6D位姿估计

针对机器人抓取中传统6D位姿估计缺少语义上下文、而基础视觉模型在该任务中作用尚不清晰的问题,论文对CLIP与DINOv2两类管线作系统比较:CLIP用于语言 grounding 与直接位姿回归,DINOv2利用稠密特征、关键点、PnP和几何细化。结果显示CLIP语义一致性和可供性推理更强,DINOv2几何精度约提升20%、平移误差更低;作者据此提出语义粗定位加几何精修的混合方向,但实时性、遮挡和对称物体仍未充分解决。

Object Pose Distribution Estimation for Determining Revolution and Reflection Uncertainty in Point Clouds Figure 1
arXiv preprint2025-12-08

Object Pose Distribution Estimation for Determining Revolution and Reflection Uncertainty in Point Clouds

Frederik Hagelskjær, Dimitrios Arapis, Steffen Madsen, Thorbjørn Mosekjær Iversen

nd Dimitrios Arapis

6D位姿估计物体位姿点云

针对工业抓取中常见的无纹理点云与圆柱对称物体,单一6D位姿会掩盖由旋转与反射歧义带来的失败风险。论文将类似 SpyroPose 的位姿分布采样迁移到3D点云,引入融合空间位置与学习特征的聚合器,对初始位姿周围的轴向旋转和反射候选生成概率直方图。真实料箱抓取验证表明,该方法能区分确定与歧义视角,用于避免不可靠抓取;但当前实验主要限于反射/回转不确定性,完整 SE(3) 分布仍属扩展方向。

Dynamic Visual SLAM using a General 3D Prior Figure 1
arXiv preprint2025-12-07

Dynamic Visual SLAM using a General 3D Prior

Xingguang Zhong, Liren Jin, Marija Popović, Jens Behley, Germany MAVLab, TU Delft, Germany

Center for Robotics, University of Bonn, Germany MAVLab, TU Delft, the Netherlands, Lamarr Institute for Machine Learning and Artificial Intelligence, Germany

6D位姿估计相机位姿

针对动态自然场景中运动物体破坏单目视觉 SLAM 数据关联、导致相机位姿和地图退化的问题,论文将基于 patch 的在线 BA 与前馈三维重建先验结合:用重建模型分割动态区域并提供深度/置信度,再通过不确定性感知 BA 和关键帧尺度对齐缓解单目与批处理预测的尺度歧义。多任务实验显示其在动态环境下相机跟踪和深度一致性优于现有方法。

Physics Informed Human Posture Estimation Based on 3D Landmarks from Monocular RGB-Videos Figure 1
arXiv preprint2025-12-07

Physics Informed Human Posture Estimation Based on 3D Landmarks from Monocular RGB-Videos

Tobias Leuthold, Michele Xiloyannis, Yves Zimmermann

6D位姿估计

面向远程康复、运动指导等仅依赖单目 RGB 视频且需在消费级设备实时运行的场景,论文针对 BlazePose 缺少解剖约束、骨长随帧漂移的问题,提出后处理优化:融合其 2D 归一化关键点与 3D world landmarks,并用骨长一致性、生物力学模型和自适应卡尔曼滤波个体化骨长比例约束姿态。在 Physio2.2M 上,相比 BlazePose 3D 估计,3D MPJPE 降低 10.2%,身体段角度误差降低 16.6%,骨长方差也显著减少。

GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimation Figure 1
arXiv preprint2025-12-06

GNC-Pose: Geometry-Aware GNC-PnP for Accurate 6D Pose Estimation

Xiujin Liu

University of Michigan

6D位姿估计

针对单目6D位姿中深度方法依赖训练数据/GPU、传统特征匹配+PnP易受离群点和对称纹理干扰的问题,GNC-Pose以渲染初始化获得粗2D-3D对应,再用基于3D结构一致性的几何权重抑制歧义点,并结合GNC-PnP退火优化与LM细化。其在YCB数据集上无需学习特征、训练数据或类别先验即取得与学习式和非学习式方法有竞争力的精度,但具体增益幅度文中片段未充分说明。

Exploiting Spatiotemporal Properties for Efficient Event-Driven Human Pose Estimation Figure 1
arXiv preprint2025-12-06

Exploiting Spatiotemporal Properties for Efficient Event-Driven Human Pose Estimation

Haoxian Zhou, Chuanzhi Xu, Langyi Chen, Pengfei Ye, Haodong Chen, Yuk Ying Chung, Qiang Qu

The University of Sydney, NSW, Australia

6D位姿估计人体姿态事件相机

针对事件相机人体姿态估计中,将事件流转成稠密帧会丢失稀疏性与高时间分辨率的问题,本文在点云框架中显式建模事件切片间的时序连续性,提出 ETSC、ES-Seq 以及 Sobel 边缘增强表示,以补足稀疏事件下的运动与轮廓信息。在 DHP19 上,该方法可稳定提升 PointNet、DGCNN 和 Point Transformer,平均降低 MPJPE 约 4%。

GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelers Figure 1
arXiv preprint2025-12-05

GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelers

Hochul Hwang, Soowan Yang, Jahir Sadik Monon, Nicholas A Giudice, Sunghoon Ivan Lee, Joydeep Biswas, Donghyun Kim

University of Massachusetts Amherst, University of Maine, University of Texas at Austin

6D位姿估计机器人操作

面向盲人/低视力者导航机器人缺少来自真实导盲实践的设计依据,GuideNav先通过访谈与导盲犬行走观察构建并开源GuideData,再据此提出仅用RGB相机的四足机器人“示教-复现”导航:以拓扑关键帧、视觉地点识别、时间滤波和相对位姿估计替代GPS/LiDAR/稠密地图。实地测试显示其可在5个户外环境稳定完成公里级路线跟随,含BLV用户的研究也验证了可用性。

A Residual Variance Matching Recursive Least Squares Filter for Real-time UAV Terrain Following Figure 1
arXiv preprint2025-12-05

A Residual Variance Matching Recursive Least Squares Filter for Real-time UAV Terrain Following

Xiaobo Wu, Youmin Zhang

6D位姿估计航天器

面向山火巡查中无人机贴地飞行的实时航点估计,论文针对噪声、离群点和非线性时变地形导致的航迹不稳问题,提出以残差方差匹配准则指导的 RVM-RLS 滤波器,在多项式 RLS 框架中结合自适应双递归估计与鲁棒离群抑制。仿真地形和激光测距系统验证显示,其相较基准算法航点估计精度约提升 88%,但动态噪声建模仍文中未充分说明。

An Integrated System for WEEE Sorting Employing X-ray Imaging, AI-based Object Detection and Segmentation, and Delta Robot Manipulation Figure 1
arXiv preprint2025-12-05

An Integrated System for WEEE Sorting Employing X-ray Imaging, AI-based Object Detection and Segmentation, and Delta Robot Manipulation

Panagiotis Giannikos, Lampis Papakostas, Evangelos Katralis, Panagiotis Mavridis, George Chryssinas, Myrto Inglezou, Nikolaos Panagopoulos, Antonis Porichis, Athanasios Mastrogeorgiou, Panagiotis Chatzakos

Halo Labs (United States), University of Essex

6D位姿估计机器人操作

针对WEEE回收中电池人工拆除危险、设备类型复杂且现有检测多停留在人工辅助的问题,本文集成双能X射线成像、预处理、YOLO电池检测、U-Net设备分割与目标跟踪预测,驱动带吸盘的Delta机器人从传送带上分拣含电池设备。系统在NVIDIA Isaac Sim和真实平台完成验证,但片段中未充分说明量化成功率、速度或相对基线增益。

Learning High-Fidelity Cloth Animation via Skinning-Free Image Transfer Figure 1
arXiv preprint2025-12-05

Learning High-Fidelity Cloth Animation via Skinning-Free Image Transfer

Rong Wang, Wei Mao, Changsheng Lu, wei.mao.research@gmail.com

The Australian National University

6D位姿估计

针对基于 LBS 的服装动画缺少显式蒙皮监督、易造成位姿错位并破坏皱褶细节的问题,论文提出无蒙皮框架:分别预测顶点位置表示低频形变、顶点法线表示高频皱褶,并将二者渲染为多视角纹理图像,把 3D 形变转化为 2D 图像迁移,再通过多模态融合重建服装。实验显示该方法在多类服装上较现有学习式方法提升动画质量,并恢复更细的皱褶细节。

YOLO and SGBM Integration for Autonomous Tree Branch Detection and Depth Estimation in Radiata Pine Pruning Applications Figure 1
arXiv preprint2025-12-05

YOLO and SGBM Integration for Autonomous Tree Branch Detection and Depth Estimation in Radiata Pine Pruning Applications

Yida Lin, Bing Xue, Mengjie Zhang, Sam Schofield, Richard Green

Victoria University of Wellington, University of Canterbury

6D位姿估计彩色深度

针对放射松人工高空修枝危险、现有无人机方案依赖昂贵 LiDAR 且难处理细枝的问题,论文将 YOLO 实例分割与 SGBM 双目匹配结合,用低成本双目相机完成枝条检测和三维定位。实验中 YOLO 优于 Mask R-CNN,枝条分割达到 82.0% mAP_mask50–95,系统可在 2 米作业范围内定位枝条,单帧处理时间低于 1 秒。

The Dynamic Prior: Understanding 3D Structures for Casual Dynamic Videos Figure 1
arXiv preprint2025-12-05

The Dynamic Prior: Understanding 3D Structures for Casual Dynamic Videos

Zhuoyuan Wu, Xurui Yang, Jiahui Huang, Yue Wang

PKU Independent Researcher NVIDIA USC University of Michigan

6D位姿估计

针对野外动态视频中运动物体破坏极几何、导致SfM/SLAM位姿和几何重建不稳的问题,论文提出Dynapo:用VLM进行时序语义推理识别动态对象,再以文本提示驱动SAM2生成细粒度动态掩码,无需任务特定训练。该先验可接入位姿优化、深度一致性重建和Stereo4D轨迹估计,在合成与真实视频上提升运动分割SOTA,并显著改善相机位姿、深度和4D轨迹精度。

Text Rationalization for Robust Causal Effect Estimation Figure 1
arXiv preprint2025-12-05

Text Rationalization for Robust Causal Effect Estimation

Lijinghua Zhang, Hengrui Cai : 1

Department of Statistics, University of California, Irvine

6D位姿估计

本文关注用临床笔记等高维文本做混杂调整时,冗余词元会破坏处理组重叠、导致极端倾向评分和不稳定因果效应估计的问题。核心思路是 CATR:用残差独立性诊断筛选保留混杂信息所需的稀疏词元,以缓解观测层面的 positivity 违背。合成实验和 MIMIC-III 研究显示,其 ATE 估计更稳定、误差更低且解释性更好。

Age-Inclusive 3D Human Mesh Recovery for Action-Preserving Data Anonymization Figure 1
arXiv preprint2025-12-04

Age-Inclusive 3D Human Mesh Recovery for Action-Preserving Data Anonymization

Georgios Chatzichristodoulou, Niki Efthymiou, Panagiotis Filntisis, Georgios Pavlakos, Petros Maragos School of ECE

School of ECE, National Technical University of Athens, Robotics Institute, Athena RC, HERON - Hellenic Robotics Center of Excellence, The University of Texas at Austin

6D位姿估计

针对现有3D人体形状与姿态估计主要适配成人、在儿童和婴幼儿上因体型域差与数据伦理限制而失效的问题,论文提出AionHMR:先用结合SMPL-A的优化式拟合生成儿童/婴幼儿伪3D标注,再训练可实时回归网格的Transformer模型。实验显示其显著提升低龄人群重建精度且不损害成人表现,并以3D-BabyRobot展示用网格替代原始图像实现保动作的数据匿名化。

Communicating Properties of Quantum States over Classical Noisy Channels Figure 1
arXiv preprint2025-12-05

Communicating Properties of Quantum States over Classical Noisy Channels

Nikhitha Nunavath, Jiechen Chen, Osvaldo Simeone, Riccardo Bassoli, Frank H. P. Fitzek

6D位姿估计

本文关注在无共享纠缠、且经典信道有噪声时,如何不传完整量子态而只可靠传递可观测量信息。核心思路是把经典阴影测量与不等错误保护结合:更强保护随机测量基,因为基错误会破坏估计;测量结果错误则可通过去偏部分修正。理论上给出随信道误码率变化的样本/通信复杂度界,实验显示 STT-UEP 比等保护阴影传输和量化状态向量更省比特,优势主要来自 scaling 与对基信息的差异化保护。

Equivariant Symmetry-Aware Head Pose Estimation for Fetal MRI Figure 1
arXiv preprint2025-12-04

Equivariant Symmetry-Aware Head Pose Estimation for Fetal MRI

Ramya Muthukrishnan, Borjan Gagoski, Aryn Lee, P. Ellen Grant, Elfar Adalsteinsson, Benjamin Billot, Polina Golland

6D位姿估计

论文面向胎儿 MRI 中因胎动导致的切片定位问题,希望用快速低分辨率 3D navigator 估计胎头 6D 位姿以自适应调整后续成像平面。核心是 E(3)-Pose:在网络结构中显式引入 E(3) 旋转等变性,并用伪向量建模胎头近似左右对称,减少低信噪声、伪影和对称歧义下的过拟合。实验显示其在公开研究数据上保持竞争力,在临床代表性数据上达到 SOTA,并改善跨域泛化与模糊可见性场景的稳定性。

Beampattern Synthesis for Discrete Phase RIS in Communication and Sensing Systems Figure 1
arXiv preprint2025-12-04

Beampattern Synthesis for Discrete Phase RIS in Communication and Sensing Systems

Xiao Cai, Hei Victor Cheng, Daniel E. Lucani

6D位姿估计

针对RIS在未知目标方向下窄波束易漏检、传统扫波束开销高的问题,论文研究离散相位硬件约束下的宽波束合成。核心做法是用惩罚项将离散相位推向凸包边界,并结合MM把非凸问题转化为可解的凸子问题,实现可调波宽。仿真显示其宽波束接近幅相可调的逐功率约束基线,在中低SNR下显著降低AOA估计MSE,并以约8 dB更低SNR达到高检测概率。

Contact-Aware Refinement of Human Pose Pseudo-Ground Truth via Bioimpedance Sensing Figure 1
arXiv preprint2025-12-04

Contact-Aware Refinement of Human Pose Pseudo-Ground Truth via Bioimpedance Sensing

Maria-Paola Forte, Nikos Athanasiou, Giulia Ballardini, Jan Ulrich Bartels, Katherine J. Kuchenbecker, Stuttgart, Tübingen, Germany @is.mpg.de, @tue.mpg.de

Max Planck Institute for Intelligent Systems, Stuttgart and Tübingen, Germany

6D位姿估计人体姿态

针对单目/视频人体姿态在手触脸、双手相触等自接触场景中易把真实接触估成悬空、难生成可靠伪真值的问题,论文提出 BioTUCH:用腕部生物阻抗检测皮肤接触时序,再约束SMPL-X手臂关节优化,将视觉估计与直接接触传感结合。其同步RGB、生物阻抗与动捕数据验证显示,接触检测特异性0.992,三种姿态估计器平均重建误差提升11.7%,接触重建率提升31.6个百分点。

Homogenized limits of Stokes flow and advective transport in thin perforated domains Figure 1
arXiv preprint2025-12-04

Homogenized limits of Stokes flow and advective transport in thin perforated domains

Markus Gahn, Vlad Revnic

Heidelberg University, Institute for Mathematics, Im Neuenheimer Feld 205, Heidelberg

6D位姿估计

面向薄多孔层中流动与物质输运的多尺度计算困难,论文研究厚度为 ε^α、孔隙周期为 ε 的 Stokes–输运方程均匀化与降维。核心在于构造适配薄穿孔域的两尺度收敛框架和 Bogovskii 压力控制,并证明输运解强两尺度收敛。结果得到垂向主导的 Darcy 型极限流和含均匀化系数的扩散–对流方程。

Vertical Planetary Landing on Sloped Terrain Using Optical Flow Divergence Estimates Figure 1
arXiv preprint2025-12-04

Vertical Planetary Landing on Sloped Terrain Using Optical Flow Divergence Estimates

Hann Woei, Zhou

6D位姿估计

面向小型行星旋翼机/着陆器在斜坡上自主降落时算力与载荷受限的问题,本文借鉴昆虫恒定光流散度着陆策略,改用两个局部光流散度并以 INDI 非线性控制分别调节推力和姿态。2D 数值仿真显示,平均散度控制可使高度与速度近似同步指数衰减,散度差还能在接地前对齐坡面;但验证仍限于简化模型。

Open Set Face Forgery Detection via Dual-Level Evidence Collection Figure 1
arXiv preprint2025-12-03

Open Set Face Forgery Detection via Dual-Level Evidence Collection

Zhongyi Cai, Bryce Gernon, Wentao Bao, Yifan Li, Matthew Wright, East Lansing, Rochester, USA

Michigan State University, East Lansing, USA, Rochester Institute of Technology, Rochester, USA

6D位姿估计

针对深度伪造方法快速演化、传统真假二分类或闭集归因难以及时识别新伪造类别的问题,本文将开放集人脸伪造检测重定义为仅依赖真实与已知伪造训练的 uncertainty estimation 任务。核心方法 DLED 结合 evidential deep learning,在空间语义与频域伪迹两层收集类别证据,并用不确定性引导的 Dempster 融合形成统一判断。实验显示其在新伪造类别识别上平均较基线提升约 20%,同时保持常规真假检测竞争力。

A review on fundamental bounds and estimators for photometry and astrometry of celestial point sources using array detectors, from first principles Figure 1
arXiv preprint2025-12-03

A review on fundamental bounds and estimators for photometry and astrometry of celestial point sources using array detectors, from first principles

Sebastián Espinosa, Rene A. Mendez, Jorge F. Silva, Marcos Orchard

6D位姿估计

面向大规模天文巡天中点源位置与亮度的高精度测量需求,本文从像素级泊松成像模型出发综述天体测量/测光的统计极限与估计器。核心洞察是用 Fisher 信息与 CRLB 统一分析 SNR、PSF、像素采样和背景对精度的影响,并比较 ML、LS、WLS 等方法。结果表明 CRLB 只在特定 SNR 条件下可达,高 SNR 也会出现偏离;通量与背景联合估计通常优于顺序估计。

SpaceTools: Tool-Augmented Spatial Reasoning via Double Interactive RL Figure 1
arXiv preprint2025-12-03

SpaceTools: Tool-Augmented Spatial Reasoning via Double Interactive RL

Siyi Chen, Mikaela Angelina Uy, Chan Hee Song, Faisal Ladhak, Adithyavairavan Murali, Qing Qu, Stan Birchfield, Valts Blukis, Jonathan Tremblay

University of Michigan, The Ohio State University, NVIDIA

6D位姿估计

针对VLM在机器人场景中缺乏精确空间/6D几何推理、而手工提示或固定工具链难以扩展的问题,SpaceTools提出双阶段交互式强化学习DIRL:先用单工具IRL教师与全工具强模型轨迹做SFT初始化,再在完整视觉/机器人工具集上继续RL探索,并用Toolshed支撑高吞吐调用。模型在RoboSpatial-Home、BLINK、BOP-ASK等取得SOTA,RoboSpatial较SFT和普通RL分别提升12%和16%,真实7自由度抓放成功率达86%。

C3G: Learning Compact 3D Representations with 2K Gaussians Figure 1
arXiv preprint2025-12-03

C3G: Learning Compact 3D Representations with 2K Gaussians

Honggyu An, Jaewoo Jung, Mungyeom Kim, Chaehyun Kim, Minkyeong Jeon, Jisang Han, Kazumi Fukuda, Takuya Narihira, Hyuna Ko, Junsu Kim, Sunghwan Hong, Yuki Mitsufuji, Seungryong Kim

Yuki Mitsufuji 3,4, KAIST AI ETH AI Center, ETH Zürich SONY AI Sony Group Corporation

6D位姿估计高斯泼溅

针对无位姿稀疏多视图中逐像素 3DGS 产生大量冗余高斯、拖累显存与语义特征提升的问题,C3G 用少量可学习 query token 通过自注意力聚合多视图信息,只在关键空间位置生成约 2K 个紧凑高斯,并复用注意力进行视角不变特征解码。实验显示其在无姿态新视角合成保持竞争质量、用 65× 更少高斯且渲染更快,在 3D 开放词汇分割和多视图特征聚合上优于密集提升方案。

When are novel methods for analyzing complex chemical mixtures in epidemiology beneficial? Figure 1
arXiv preprint2025-12-03

When are novel methods for analyzing complex chemical mixtures in epidemiology beneficial?

Nate Wiecha, Emily Griffith, Brian J. Reich, Jane A. Hoppin

6D位姿估计

该文针对流行病学中化学混合暴露变量相关、高维且可能存在非线性/交互效应时方法选择困难的问题,系统比较通用模型与专用新方法,并把一类错误控制、检验功效、可解释性和预测精度纳入同一模拟评估框架。结果显示,中等相关、交互不复杂或组分效应方向相反时,GLM等通用方法更稳妥;高度相关或强交互情形下,BKMR等新方法才体现明显收益。

MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localization Figure 1
arXiv preprint2025-12-03

MSG-Loc: Multi-Label Likelihood-based Semantic Graph Matching for Object-Level Global Localization

Gihyeon Lee, Jungwoo Lee, Juwon Kim, Young-Sik Shin, Younggun Cho

6D位姿估计物体位姿

面向机器人在开放集、语义歧义和未知物体环境中的全局定位,MSG-Loc指出单标签物体图易放大误分类并导致错误关联。其核心是保留多视角多标签假设,为节点对计算多标签似然,并通过1-hop邻居进行上下文似然传播以筛选匹配。实验覆盖闭集/开集检测、真实室内与合成场景,显示其在数据关联、位姿估计和大词表类别扩展上更稳健,但具体数值增益文中摘录未充分说明。

AfroBeats Dance Movement Analysis Using Computer Vision: A Proof-of-Concept Framework Combining YOLO and Segment Anything Model Figure 1
arXiv preprint2025-12-03

AfroBeats Dance Movement Analysis Using Computer Vision: A Proof-of-Concept Framework Combining YOLO and Segment Anything Model

Kwaku Opoku-Ware, Gideon Opoku

Department of Soil and Water Systems, University of Idaho, Moscow, United States, Department of Computer Engineering, Kwame Nkrumah University of Science and, Technology, Kumasi, Ghana

6D位姿估计

面向舞蹈分析依赖人工主观评价、动捕设备昂贵且干扰自然表演的问题,本文尝试用YOLOv8/v11检测舞者并以SAM生成像素级掩码,实现无标记视频中的跟踪、步数、空间覆盖、运动强度和节奏一致性量化。单段49秒加纳AfroBeats视频上报告检测精度约94%、召回89%、SAM IoU约83%,并观察主舞者指标更高;但仅单视频、缺少系统标注和与OpenPose等对比,结果仍属可行性验证。

DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling Figure 1
arXiv preprint2025-12-03

DynamicVerse: A Physically-Aware Multimodal Framework for 4D World Modeling

Kairun Wen, Yuzhi Huang, Chen, Runyu, Hui Zheng, Yunlong, Panwang Pan, Chenxin Li, Wenyan Cong, Jian Zhang, Jianguo Lü, Chenguo, Dilin Wang, Zhicheng Yan, Hongyu Xu, Justin Theiss, Yue Huang, Xinghao Ding, Rakesh Ranjan, Zhiwen Fan

Meta

6D位姿估计

面向机器人与具身智能所需的真实动态4D世界数据,本文指出现有数据多来自仿真或仅有尺度不定的SfM与弱语义。其核心是DynamicGen流水线:结合视觉/几何/多模态基础模型、窗口BA与全局优化,从单目公开视频生成米制点图、相机参数、实例掩码和物体/相机/场景描述,并构建100K+场景、800K+masklet、千万级帧的DynamicVerse。在深度、相机位姿和内参估计基准上优于现有方法;增益可能主要来自更大规模真实数据与全局优化的结合。

Taming Camera-Controlled Video Generation with Verifiable Geometry Reward Figure 1
arXiv preprint2025-12-02

Taming Camera-Controlled Video Generation with Verifiable Geometry Reward

Zhaoqing Wang, Xiaobo Xia, Zhuolin Bie, Jinlin Liu, Dongdong Yu, Jia-Wang Bian, Changhu Wang

AIsphere National University of Singapore Nanyang Technological University

6D位姿估计

针对相机可控视频生成主要依赖 SFT、难以用稠密几何反馈优化连续相机轨迹的问题,论文提出 CamVerse 在线 RL 后训练框架,用大 3D 模型估计生成/参考视频轨迹,并以分段相对位姿对齐构造可验证几何奖励,缓解奖励稀疏;同时构建 31.5 万带轨迹视频数据集。实验显示其在相机控制精度、几何一致性和视觉质量上均优于 SFT 基线。

Martingales, laminates and minimal Korn inequalities Figure 1
arXiv preprint2025-12-02

Martingales, laminates and minimal Korn inequalities

Gabriele Cassese 1 gabriele.cassese@maths.ox.ac.uk

6D位姿估计

本文回应 Chipot 关于 Korn 型不等式中“最少需要多少个梯度标量测量”的问题,将其改写为秩一凸性、拟凸性与矩阵子空间避开低秩集的代数判定。核心洞察是建立 laminates 与 martingales 的系统联系,构造达到界的显式族。主要结果给出近最优线性增长 N(d)≈2d,并证明 Lipschitz 域上 N′(d)=2d−1,同时推广到矩形情形和 Lp 估计。

DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactions Figure 1
WACV 20262025-12-02

DF-Mamba: Deformable State Space Modeling for 3D Hand Pose Estimation in Interactions

Yifan Zhou, Takehiko Ohkawa, Guwenxiao Zhou, Kanoko Goto, Takumi Hirose, Yusuke Sekikawa, Nakamasa Inoue

Institute of Science Tokyo, Denso IT Laboratory, The University of Tokyo

6D位姿估计手部姿态

面向双手重叠、手物交互等强遮挡场景,论文指出常用 ResNet 难以高效建模局部关节线索与全局上下文关系。DF-Mamba 将 Mamba 状态空间引入 3D 手姿态骨干,提出带可学习偏移的可变形扫描 DSSM,并结合卷积与门控卷积形成三混合结构。在五个 RGB/深度、单手/双手/手物数据集上均优于 VMamba、Spatial-Mamba 等骨干,速度接近或快于 ResNet-50。

VibOmni: Towards Scalable Bone-conduction Speech Enhancement on Earables Figure 1
arXiv preprint2025-12-02

VibOmni: Towards Scalable Bone-conduction Speech Enhancement on Earables

Lixing He, Yunqi Guo, Haozheng Hou, Zhenyu Yan

6D位姿估计

针对耳机、AR/VR 头显等 earables 在嘈杂环境中仅靠近距麦克风难以分离用户语音的问题,VibOmni 利用设备已有 IMU 捕获的骨传导振动作为抗噪模态,与音频经双分支编码解码网络融合;并用少量录音估计骨传导函数生成合成振动数据,缓解配对数据稀缺,再结合多模态 SNR 估计做持续学习与自适应推理。32 名志愿者实测中,PESQ、SNR 和 WER 分别最高提升约 21%、26% 和降低 40%,移动端延迟也低于强基线。

Progress in quantum metrology and applications for optical atomic clocks Figure 1
arXiv preprint2025-12-01

Progress in quantum metrology and applications for optical atomic clocks

Raphael Kaubruegger, Adam M. Kaufman

6D位姿估计

本文关注经典资源难以继续扩展时,如何用纠缠提升光学原子钟等量子传感的测量灵敏度。核心洞察是把相位估计的频率学派与贝叶斯框架、压缩态/GHZ态及退相干约束联系起来,说明抽象量子极限如何转化为真实时钟性能。主要结果是梳理了纠缠钟已达10^-17至10^-18精度、未来在短询问时间和传感网络中更具竞争力,但实际增益仍受相干时间和系统规模限制。

Splash-squeeze singularities and analytic breakdown in ideal incompressible MHD Figure 1
arXiv preprint2025-12-01

Splash-squeeze singularities and analytic breakdown in ideal incompressible MHD

Diego Córdoba, Alberto Enciso, Matthew Hernandez

6D位姿估计

本文并非机器人6D位姿论文,而是研究自由边界理想不可压MHD中流体界面奇性:动机是理解经典 splash 之外,真空磁场被等离子体夹断时是否会触发正则性失效。核心洞察是用磁对齐拉格朗日表述与退化夹缝域的加权椭圆估计,刻画外部磁场在接触点无限阶消失。主要结果构造了解析初值,其解在Sobolev范数有界时形成切向自交并发生解析性崩溃。

Visual Sync: Multi-Camera Synchronization via Cross-View Object Motion Figure 1
arXiv preprint2025-12-01

Visual Sync: Multi-Camera Synchronization via Cross-View Object Motion

Shaowei Liu, David Yifan Yao, Saurabh Gupta

University of Illinois Urbana-Champaign

6D位姿估计多视角

多机位消费级视频常缺少硬件同步和已知位姿,限制4D重建与跨视角融合。VisualSync的核心是把时间对齐转化为跨视角运动点的极线约束最小化,结合VGGT估计几何、MAST3R跨视角匹配和CoTracker稠密跟踪,再由成对搜索到全局偏移优化。在四个复杂数据集上优于SyncNeRF等基线,中位同步误差低于50毫秒。

KM-ViPE: Online Tightly Coupled Vision-Language-Geometry Fusion for Open-Vocabulary Semantic SLAM Figure 1
arXiv preprint2025-12-01

KM-ViPE: Online Tightly Coupled Vision-Language-Geometry Fusion for Open-Vocabulary Semantic SLAM

Zaid Nasser, Mikhail Iumanov, Tianhao Li, Maxim Popov, Jaafar Mahmoud, Malik Mohrat, Ilya Obrubov, Ekaterina Derevyanka, Ivan Sosin, Sergey Kolyubin

Biomechatronics and Energy-Efficient Robotics (BE2R) Lab, ITMO, University, Saint Petersburg, Russia, SBERRoboticsCenter, Moscow, Russia

6D位姿估计未知物体相机位姿

针对传统几何 SLAM 缺乏开放词汇语义且在动态、未标定单目场景中易受移动物体干扰的问题,KM-ViPE 将 DINO 稠密特征、光流/深度几何约束与语言嵌入紧耦合,并用基于高层特征的自适应鲁棒核过滤移动或被搬动物体,实现在线相机位姿估计与语义建图。实验称性能接近现有最佳方法,但具体量化增益和主要来源文中未充分说明。

Is Image-based Object Pose Estimation Ready to Support Grasping? Figure 1
arXiv preprint2025-12-02

Is Image-based Object Pose Estimation Ready to Support Grasping?

Eric C. Joyce, Qianwen Zhao, Nathaniel Burgdorfer, Long Wang, Philippos Mordohai

Stevens Institute of Technology, Hoboken, NJ 07030, USA

6D位姿估计物体位姿

论文关注单目 RGB 6D 位姿估计能否作为机器人抓取的唯一感知来源,指出 BOP 常用位姿指标可能掩盖会导致抓取失败的几何误差。作者将真实图像位姿估计接入物理仿真,用平行夹爪和欠驱动手评估五个开源方法。结果显示位姿更准通常带来更高抓取成功率,但复杂形状上相关性减弱,误差敏感性取决于估计器、夹爪与物体组合。

Register Any Point: Scaling 3D Point Cloud Registration by Flow Matching Figure 1
arXiv preprint2025-12-01

Register Any Point: Scaling 3D Point Cloud Registration by Flow Matching

Yue Pan, Tao Sun, Liyuan Zhu, Lucas Nunes Iro Armeni, Jens Behley, Cyrill Stachniss

6D位姿估计点云

针对多视角点云配准依赖两两匹配与位姿图优化、在低重叠和跨传感器场景中代价高且易累积误差的问题,RAP将配准改写为条件生成,用flow matching学习点级速度场直接生成全局对齐点云,并在测试时加入刚性约束采样。作者还用17个数据集、10万余实例进行训练;实验显示其在成对与跨域多视角基准上达到或超过SOTA,零样本泛化较强,但增益可能主要来自scaling/data与刚性后处理的共同作用。

Probabilistic Neuro-Symbolic Reasoning for Sparse Historical Data: A Framework Integrating Bayesian Inference, Causal Models, and Game-Theoretic Allocation Figure 1
arXiv preprint2025-12-01

Probabilistic Neuro-Symbolic Reasoning for Sparse Historical Data: A Framework Integrating Bayesian Inference, Causal Models, and Game-Theoretic Allocation

Saba Kublashvili Independent Researcher

Independent Researcher

6D位姿估计

这篇论文实际并非6D位姿估计,而是面向极小样本历史事件建模:针对史料稀疏、噪声大且需要可解释反事实的问题,提出HistoricalML,将贝叶斯不确定性、结构因果模型、Shapley公平分配和注意力权重结合。结果在非洲殖民分割中量化德国+107.9%结构异常,在第二次布匿战争中模拟出与史实一致的胜率,并指出迦太基政治支持不足是关键因素。

Differentially Private and Federated Structure Learning in Bayesian Networks Figure 1
arXiv preprint2025-12-01

Differentially Private and Federated Structure Learning in Bayesian Networks

1 INTRODUCTION

6D位姿估计

针对多机构数据难以集中、且贝叶斯网络结构学习在高维下通信与隐私成本过高的问题,本文提出 Fed-Sparse-BNSL 及差分隐私版本,通过贪婪坐标更新只传输少量相关边,并用 zCDP 更紧地核算隐私噪声。合成与真实数据实验显示,其结构恢复接近非私有基线,同时显著降低通信开销并支持异质参与者个性化。

Estimating the prevalence of LLM-assisted text in scholarly writing Figure 1
arXiv preprint2025-12-01

Estimating the prevalence of LLM-assisted text in scholarly writing

Andrew Gray

UCL Library Services, University College London, Gower Street, London WC1E BT, United

6D位姿估计

针对LLM辅助写作在学术论文中常被隐瞒、影响科研诚信的问题,本文用Dimensions全文数据中若干“指示词”的异常增长构建可复现估计,并与既有研究交叉印证。结果显示,2024年全球论文中可能超过10%涉及LLM生成或改写,且显式披露远低于推测使用率,作者据此主张更严格的披露要求。

BlinkBud: Detecting Hazards from Behind via Sampled Monocular 3D Detection on a Single Earbud Figure 1
arXiv preprint2025-12-01

BlinkBud: Detecting Hazards from Behind via Sampled Monocular 3D Detection on a Single Earbud

Yunzhe Li, Jiajun Yan, Yuzhou Wei, Kechen Liu, Yize Zhao, Chong Zhang, Hongzi Zhu, Li Lu, Shan Chang, Minyi Guo

Shanghai Jiao Tong University, Shanghai, Columbia University, University of Electronic Science and Technology of China, Southwest Petroleum University, Donghua University

6D位姿估计

面向行人和骑行者难以及时感知后方高速来车的安全问题,BlinkBud将单耳机摄像头与手机协同,用间歇采样图像而非连续视频完成单目3D检测与跟踪。其关键在于结合卡尔曼轨迹估计和强化学习采样策略,并用IMU估计的俯仰、偏航补偿头部运动。原型实测耳机/手机平均功耗为29.8 mW/702.6 mW,危险检测FPR为4.90%、FNR为1.47%。

TabletopGen: Instance-Level Interactive 3D Tabletop Scene Generation from Text or Single Image Figure 1
arXiv preprint2025-12-01

TabletopGen: Instance-Level Interactive 3D Tabletop Scene Generation from Text or Single Image

Ziqian Wang, Yonghao He, Licheng Yang, Wei Zou, Hongxuan Ma Liu Liu, Wei Sui, Yuxin Guo, Hu Su School of Artificial Intelligence, Project Leader, Corresponding Author

School of Artificial Intelligence, University of Chinese Academy of Sciences, D-Robotics, State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences, Horizon Robotics

6D位姿估计

面向机器人操作仿真中高密度桌面场景难以从文本或单图恢复的问题,TabletopGen采用免训练的实例级流程:先分割并补全每个物体、单独重建3D模型,再用可微旋转优化和俯视空间对齐估计6D位姿与尺度,组装为无碰撞可交互场景。实验和用户研究显示其在视觉质量、布局准确性和物理合理性上优于现有文本/图像驱动方法。

CC-FMO: Camera-Conditioned Zero-Shot Single Image to 3D Scene Generation with Foundation Model Orchestration Figure 1
arXiv preprint2025-11-29

CC-FMO: Camera-Conditioned Zero-Shot Single Image to 3D Scene Generation with Foundation Model Orchestration

China tbs16@mails.tsinghua.edu.cn, China jh-zheng22@mails.tsinghua.edu.cn, China hr20@mails.tsinghua.edu.cn, China gaohuang@tsinghua.edu.cn

Tsinghua University

6D位姿估计

针对单图到3D场景生成中实例质量尚可但物体位姿和尺度不一致、导致场景难以相机对齐的问题,CC-FMO尝试全流程编排基础模型:用VecSet保语义、SLAT补细节的混合实例生成器缓解遮挡误生成,并通过相机条件的闭式尺度求解把基础位姿估计模型用于组合场景。实验显示其在开放场景中生成更高保真、相机一致的3D布局,优于训练式和零样本基线。

Zero-Shot Multi-Criteria Visual Quality Inspection for Semi-Controlled Industrial Environments via Real-Time 3D Digital Twin Simulation Figure 1
arXiv preprint2025-11-28

Zero-Shot Multi-Criteria Visual Quality Inspection for Semi-Controlled Industrial Environments via Real-Time 3D Digital Twin Simulation

Jose Moises Araya-Martinez, Mohan, Gautham, Kenichi Hayakawa Bolaños, Roberto Mendieta, Sardari, Sarvenaz, Jens Lambrecht, Jörg Krüger

bCosta Rica Institute of Technology, School of Computer Engineering, Cartago, Costa Rica, dTechnical University Berlin, Industrial Automation Technology, Pascalstraße 8-9, Berlin, Germany, eTechnical University Berlin, Industry Grade Networks and Clouds, Ernst-Reuter-Platz 7, Berlin, Germany

6D位姿估计

面向半受控工业现场中缺陷样本少、标注成本高且物体位姿不固定的问题,本文提出零样本多准则视觉质检框架:先用已知 CAD 模型的检测与 6D 位姿估计生成实时 RGB-D 数字孪生,再与真实场景比较,并加入位姿细化和统一的结构/逻辑/位置缺陷标注格式。在轴向磁通电机案例中,即便采用简单距离度量,缺陷掩码 IoU 最高达到 63.3%,但整体泛化边界仍需更多场景验证。

Multi-chain Graph Refinement and Selection for Reliable Reasoning in Large Language Models Figure 1
arXiv preprint2025-11-28

Multi-chain Graph Refinement and Selection for Reliable Reasoning in Large Language Models

Yujiao Yang, Jing Lian, Linhui Li

6D位姿估计

该文针对 CoT/ToT/GoT 在复杂推理中分支同质、冗余搜索和中间错误难纠正的问题,提出 MGRS:先生成多条差异化推理链,再通过自验证与交叉验证修正候选步骤,合并为关系 DAG,并按节点成功率累积选择答案。六个基准上平均准确率 82.9%,较强基线高 2.1%,24 点任务达 100% 且相对 FoT 提速 13.6×;但其与仓库“6D Pose”分类关联不明显。

Geometry-Consistent 4D Gaussian Splatting for Sparse-Input Dynamic View Synthesis Figure 1
arXiv preprint2025-11-28

Geometry-Consistent 4D Gaussian Splatting for Sparse-Input Dynamic View Synthesis

Yiwei Li, Jiannong Cao, Penghui Ruan, Divya Saxena, Songye Zhu, Yinfeng Cao

6D位姿估计三维重建高斯泼溅

该文针对动态高斯泼溅在稀疏多视角输入下几何约束不足、4D结构学习不一致而导致新视角合成退化的问题,提出GC-4DGS:用跨视角、跨时间的动态一致性检查筛除不可靠MVS深度,并以全局深度排序和局部平滑正则蒸馏单目深度中的时空一致关系。在N3DV和Technicolor上,其PSNR较RF-DeRF和原4DGS分别提升2.62dB、1.58dB,同时保持实时渲染并可部署到边缘设备。

DiskChunGS: Large-Scale 3D Gaussian SLAM Through Chunk-Based Memory Management Figure 1
IEEE Robotics and Automation Letters2025-11-28

DiskChunGS: Large-Scale 3D Gaussian SLAM Through Chunk-Based Memory Management

C. Feldmann, Maximum Wilder-Smith, Vaishakh Patil, Michael Oechsle, Michael Niemeyer, Keisuke Tateno, Marco Hutter

ETH Zurich, Google (Switzerland)

6D位姿估计相机位姿高斯泼溅

DiskChunGS针对3D Gaussian SLAM受GPU显存限制、难以扩展到大场景的问题,将场景划分为空间chunk,只把当前可见区域加载到VRAM,其余落盘,并结合ORB-SLAM3与chunk感知回环保持全局一致。实验覆盖Replica、TUM、KITTI和Jetson Orin;其在KITTI全部11个序列均无内存失败,并在速度—画质权衡上优于CaRtGS、GigaSLAM等方法。

MARVO: Marine-Adaptive Radiance-aware Visual Odometry Figure 1
arXiv preprint2025-11-28

MARVO: Marine-Adaptive Radiance-aware Visual Odometry

USA sacchin@umich.edu, India atman.kikani2022@vitstudent.ac.in, USA sshrote1@seas.upenn.edu, India nayeemulla.khan@vit.ac.in, India shahinaa@ssn.edu.in

University of Michigan, Vellore Institute of Technology, University of Pennsylvania, Sri Sivasubramaniya Nadar College of Engineering

6D位姿估计相机位姿

面向水下视觉定位中颜色衰减、低纹理和非高斯噪声导致的匹配失稳与轨迹漂移,MARVO将水下成像物理嵌入LoFTR特征匹配,并在GTSAM因子图中融合视觉、IMU和压力深度,再用强化学习细化SE(2)位姿图。实验声称在合成与真实水下场景中优于SuperGlue、LoFTR、ORB-SLAM3和LIBVISO2,降低ATE/RPE和漂移,但具体增益幅度需结合完整表格判断。

Threat-Aware UAV Dodging of Human-Thrown Projectiles with an RGB-D Camera Figure 1
IEEE Robotics and Automation Letters2025-11-28

Threat-Aware UAV Dodging of Human-Thrown Projectiles with an RGB-D Camera

Yuying Zhang, Na Fan, Haowen Zheng, Junning Liang, Zongliang Pan, Qifeng Chen, Ximin Lyu

Sun Yat-sen University, Applied Science and Technology Research Institute, University of Hong Kong, Shenzhen Technology University

6D位姿估计点云彩色深度航天器

针对无人机在运输、航拍等任务中难以及时应对人为投掷物攻击的问题,论文将棒球中的“看投手预判球路”引入无人机避障:用单个 RGB-D 相机结合人体姿态估计与深度信息,在投掷物释放前预测轨迹,并用不确定性感知策略扩展危险区来规划躲避。系统在仅 CPU 硬件上实现约 6 米有效检测和 26.4 ms 平均延迟,真实场景实验显示其在不同投掷者、光照、遮挡和多威胁下较基线具备更好的距离、延迟与躲避成功率。

Megastructures of type-III civilizations orbiting galaxies Figure 1
arXiv preprint2025-11-27

Megastructures of type-III civilizations orbiting galaxies

Zaza N. Osmanov

6D位姿估计

这篇文章的动机是为SETI技术迹象搜索提供比无线电通信更持久的目标,讨论III型文明是否会在星系辐射降至接近CMB背景的远域建造“实验室”式巨构。核心洞察是用星系光度面密度的指数模型估算该临界轨道,并把其动力学与能量需求量纲化到银河系。主要结果显示,对银河系类系统,位置约需在数倍星系半径之外,轨道速度约270 km/s;搬运太阳质量巨构所需能量约为银河系数小时辐射量,因而对III型文明并非根本限制。

Test-time scaling of diffusions with flow maps Figure 1
arXiv preprint2025-11-27

Test-time scaling of diffusions with flow maps

Amirmojtaba Sabour, Michael S. Albergo : 1, Carles Domingo-Enrich : 1, IAIFI, Microsoft Research, malbergo@fas.harvard.edu, carlesd@microsoft.com, nboffi@andrew.cmu.edu, fidler@cs.toronto.edu, kkreis@nvidia.com, eve2@nyu.edu

NVIDIA, University of Toronto, Vector Institute, Harvard University, Kempner Institute, Microsoft Research, Carnegie Mellon University, Courant Institute, New York University, ML Lab at Capital Fund Management (CFM)

6D位姿估计

本文针对扩散模型测试时奖励引导常依赖终端奖励的近似梯度、在早期噪声状态信号弱且不适定的问题,提出利用 flow map 直接预测轨迹终点并构造 FMTT 轨迹倾斜,在重要性采样或搜索中更原则地优化奖励。实验显示其相较去噪器 look-ahead、Best-of-N、ReNO 等在测试时 scaling 上更有效,尤其能处理几何约束和 VLM 自然语言奖励;在人类偏好奖励上增益较小,可能受基模型已偏好对齐限制。

Emergent Extreme-View Geometry in 3D Foundation Models Figure 1
arXiv preprint2025-11-27

Emergent Extreme-View Geometry in 3D Foundation Models

Yiwen Zhang, Joseph Tung, Ruojin Cai, David Fouhey

Cornell University New York University Kempner Institute, Harvard University

6D位姿估计

针对现实中稀疏、少重叠甚至无重叠视角下传统匹配式3D管线失效的问题,本文发现3D基础模型的共享骨干中已隐含可泛化的“3D语言”。作者仅微调少量骨干偏置、冻结解码头来对齐该表示,约8万参数即可提升极端视角相对位姿估计且不损害深度/点图质量;在sELP和野外数据上显著降低旋转误差,并提出含476个未见互联网场景的MegaUnScene基准。

A Framework for Initial Transient Detection and Statistical Assessment of Convergence in CFD Simulations Figure 1
arXiv preprint2025-11-27

A Framework for Initial Transient Detection and Statistical Assessment of Convergence in CFD Simulations

L. Scandurra, P. Alexias, E. de Villiers

6D位姿估计

该文针对CFD时序中初始瞬态会污染稳态统计、人工截断和固定比例丢弃又主观低效的问题,提出从最新样本反向计算均值标准误并结合分数滤波寻找稳定拐点,再用自相关修正的有效样本量构造置信区间和趋势斜率检查。实验显示该方法在不同时间步和欠松弛因子下判断较稳定,可减少自相关数据中的误收敛,但与6D位姿估计关联不明显。

Bringing Your Portrait to 3D Presence Figure 1
arXiv preprint2025-11-27

Bringing Your Portrait to 3D Presence

Jiawei Zhang, Lei Chu, Jiahao Li, Zhenyu Zang, Chong Li Xiao Li, Xun Cao, Hao Zhu, Microsoft Research Asia

Nanjing University, Microsoft Research Asia

6D位姿估计

这篇论文面向单张日常人像生成可动画3D人体头像/半身/全身形象,动机是现有方法依赖固定裁剪、全身可见和昂贵多视数据,难以适应野外输入。核心做法是用 Dual-UV 将图像特征锚定到规范UV空间,并结合2D生成外观与3D渲染几何的因子化合成数据及更稳健的代理网格跟踪。结果显示,仅用半身合成数据训练即可在头部和上半身重建上达到SOTA,全身表现也具竞争力。

UAV-MM3D: A Large-Scale Synthetic Benchmark for 3D Perception of Unmanned Aerial Vehicles with Multi-Modal Data Figure 1
arXiv preprint2025-11-27

UAV-MM3D: A Large-Scale Synthetic Benchmark for 3D Perception of Unmanned Aerial Vehicles with Multi-Modal Data

Longkun Zou, Jiale Wang, Rongqin Liang, Hai Wu, Ke Chen

Pengcheng Laboratory, University of Southern California

6D位姿估计仿真到现实数据集/基准航天器

针对真实低空无人机数据受空域法规、隐私和3D标注成本限制,UAV-MM3D用高保真仿真构建40万帧RGB/IR/LiDAR/Radar/DVS同步多模态基准,覆盖多场景、天气和机型,并提供2D/3D框、6DoF位姿与实例标注。论文还给出LiDAR引导融合的LGFusionNet和轨迹预测基线,主要结果是形成可评测3D检测、6D位姿、跟踪与预测的公开基准;具体性能增益文中未充分说明,可能主要来自scaling/data。

ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy Figure 1
arXiv preprint2025-11-27

ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy

Zhiyi Jiang, Yifu Wang, Xuelian Cheng, Zongyuan Ge

Y. Wang is Vetex Lab, Shanghai, China, Z. Ge is with Faculty of Information Technology, Monash University, Clayton, VIC 3800, Australia

6D位姿估计

该文针对结肠镜单目图像中高反光、弱纹理和光源运动导致几何基础模型失效的问题,提出 ColonAdapter,以自监督方式用单目视频适配预训练3D几何模型;其关键在于引入细节恢复模块、置信加权光度损失和跨帧几何一致性约束,在无需真实内参或深度标注的条件下提升临床场景适应性。实验在合成与真实结肠镜数据上显示,其在相机位姿、单目深度和稠密点图重建任务上达到或超过现有方法。

Seeing without Pixels: Perception from Camera Trajectories Figure 1
arXiv preprint2025-11-26

Seeing without Pixels: Perception from Camera Trajectories

Zihui Xue, Kristen Grauman, Dima Damen, Andrew Zisserman, Tengda Han Google DeepMind

Google DeepMind, The University of Texas at Austin

6D位姿估计

这篇论文追问相机6D位姿轨迹本身是否包含视频语义,而不依赖像素。作者将轨迹从传统几何工具提升为感知模态,提出CamFormer,用轨迹-文本对比学习把相机运动编码到语言语义空间,并用长时上下文缓解轨迹歧义。在5个数据集10项任务上,方法在检索、分类和时序分析中带来约3.2%–13.2%增益,且对多传感器SLAM和RGB估计位姿均较稳健。

Uncertainty Quantification for Visual Object Pose Estimation Figure 1
arXiv preprint2025-11-26

Uncertainty Quantification for Visual Object Pose Estimation

Lorenzo Shaikewitz, Charis Georgiou, Luca Carlone

6D位姿估计物体位姿

面向机器人规划控制中仅有6D位姿点估计而缺少可靠置信度的问题,本文从单目2D语义关键点的高概率误差界出发,提出SLUE,用广义S-lemma与SOS松弛将非凸位姿可行集外包为最小体积椭球,并可投影为平移和轴角界。实验覆盖两个位姿数据集和真实无人机跟踪,显示其平移不确定界明显更紧、姿态界相当且速度优于既有方法。

Enhanced Landmark Detection Model in Pelvic Fluoroscopy using 2D/3D Registration Loss Figure 1
arXiv preprint2025-11-26

Enhanced Landmark Detection Model in Pelvic Fluoroscopy using 2D/3D Registration Loss

Chou Mo, Yehyun Suh, J. Ryan Martin, Daniel Moyer

Department of Computer Science, Vanderbilt University, Nashville, TN, USA, Vanderbilt Institute for Surgery and Engineering, Nashville, TN, USA, Department of Mathematics, University of California-Los Angeles, Los Angeles, CA, USA, Vanderbilt Lab for Immersive AI Translation, Nashville, TN, USA, Department of Orthopedic Surgery, Vanderbilt University Medical Center, Nashville, TN, USA

6D位姿估计

该文针对骨盆透视中患者或成像器械姿态偏离标准 AP 位时,传统 U-Net 热图分割损失难以约束真实几何误差的问题,将可微 Soft-Argmax、基于地标的 2D/3D 配准和 6D 相机位姿估计损失引入训练。实验比较纯分割、纯位姿损失及先分割后位姿微调,结果显示位姿损失微调可提升地标定位精度,但具体增益幅度文中片段未充分说明。

Informed Burn-In Decisions in RAR: Harmonizing Adaptivity and Inferential Precision Based on Study Setting Figure 1
arXiv preprint2025-11-26

Informed Burn-In Decisions in RAR: Harmonizing Adaptivity and Inferential Precision Based on Study Setting

Lukas Pin, Stef Baas, Gianmarco Caruso, David S. Robertson, Sofía S. Villar

Efficient Study Design Group, MRC Biostatistics Unit, University of Cambridge, Cambridge, UK

6D位姿估计

本文关注响应自适应随机化试验中 burn-in 长度常凭经验设定的问题:过短会放大早期噪声、偏倚和一类错误,过长又削弱自适应收益。作者将样本量、效应难度、设计反应性和期望最终分配误差合成一个选取公式,并在基于真实试验设定的仿真中显示,该公式能找到较稳的折中区间,降低错误率膨胀和均方误差,同时保留功效与患者获益。

Metric, inertially aligned monocular state estimation via kinetodynamic priors Figure 1
arXiv preprint2025-11-25

Metric, inertially aligned monocular state estimation via kinetodynamic priors

Jiaxin Liu, Min Li, Wanting Xu, Liang Li, Jiaqi Yang, Laurent Kneip

6D位姿估计

针对柔性/非刚性机器人中传感器相对位姿随形变变化、传统刚体视觉里程计难以恢复尺度和重力的问题,论文把弹性连接视作可提供约束的“被动 IMU”:用 MLP 学习形变到受力/加速度的模型,并以连续时间 B 样条描述平滑运动,通过牛顿定律联合优化单目轨迹。作者在弹簧相机系统上验证可恢复公制度量尺度与惯性对齐位姿,但泛化到更复杂软体平台的效果文中仍未充分说明。

Dance Style Classification using Laban-Inspired and Frequency-Domain Motion Features Figure 1
arXiv preprint2025-11-25

Dance Style Classification using Laban-Inspired and Frequency-Domain Motion Features

Ben Hamscher, Arnold Brosch, Nicolas Binninger, Maksymilian Jan Dejna, Germany @hhu.de

Heinrich-Heine-University Düsseldorf, Germany

6D位姿估计

针对舞蹈风格仅凭外观或端到端视频模型难以区分细微姿态与节奏差异的问题,本文从2D/3D人体关键点出发,构造相对髋部的Laban启发运动特征,并加入FFT频域特征刻画重复节奏。实验覆盖AIST、Motorica、ImperialDance等多数据集和多分类器,显示该可解释特征在较低计算开销下可稳定区分最多10类舞种,但具体相对深度模型的精确增益幅度需看完整实验表。

A novel multi-exposure-to-multi-mediator mediation model for imaging genetic study of brain disorders Figure 1
arXiv preprint2025-11-25

A novel multi-exposure-to-multi-mediator mediation model for imaging genetic study of brain disorders

Neng Wang, Eric V. Slud, Tianzhou Ma

Department of Mathematics, University of Maryland, College Park, MD 20742, USA, Department of Epidemiology and Biostatistics, University of Maryland, College Park, MD 20742, USA

6D位姿估计

针对影像遗传研究中基因暴露和脑影像中介变量同时高维且相关、传统中介分析难以解释联合通路的问题,论文提出多暴露到多中介模型,将两侧变量共同压缩为最大化中介效应的低维聚合量,并用稀疏载荷提升可解释性。方法通过带块坐标更新的 ADMM 求解并给出收敛与渐近性质;仿真中在载荷恢复和中介比例估计上优于对比方法,UK Biobank 示例识别出与尼古丁依赖相关的基因—脑连接通路。

AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend Figure 1
arXiv preprint2025-11-25

AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend

Hengyi Wang, Lourdes Agapito

Department of Computer Science, University College London

6D位姿估计三维重建

AMB3R针对点图式前馈重建缺少显式三维空间紧致性、难以融合多视角对应的问题,在冻结VGGT前端上加入度量尺度头,并以稀疏体素后端经空间填充曲线序列化后用Transformer推理,再回注解码器。文中显示其在相机位姿、深度/尺度估计、三维重建、无标定VO和SfM等13个数据集上达到或超过现有方法,且无需任务微调或测试时优化;但长序列一致性、动态场景和回环仍是限制。

SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery Figure 1
arXiv preprint2025-11-26

SKEL-CF: Coarse-to-Fine Biomechanical Skeleton and Surface Mesh Recovery

Da Li, Jiping Jin, Xuanlong Yu, Wei Liu, Xiaodong Cun, Kai Chen, Rui Fan, Jiangang Kong, Xi Shen Equal contribution, Corresponding author Intellindust AI Lab, Didi Chuxing Co.Ltd

Intellindust AI Lab Shenzhen University ShanghaiTech University, GVC Lab, Great Bay University Didi Chuxing Co.Ltd

6D位姿估计医学/手术

本文针对 SMPL 等人体模型运动学过简、难满足生物力学真实性的问题,提出 SKEL-CF 从单图恢复具解剖约束的 SKEL 骨架与网格。方法用 Transformer 编解码器先粗估相机外参和 SKEL 参数,再逐层细化并监督,同时估计相机内参,并构建 HMR-SKEL 训练集。MOYO 上达到 85.0 MPJPE / 51.4 PA-MPJPE,明显优于 HSMR 的 104.5 / 79.6。

VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstruction Figure 1
arXiv preprint2025-11-25

VGGT4D: Mining Motion Cues in Visual Geometry Transformers for 4D Scene Reconstruction

Yu Hu, Chong Cheng : 1, Sicheng Yu : 1 Xiaoyang Guo, Technology (Guangzhou) Horizon Robotics

The Hong Kong University of Science and Technology (Guangzhou), Horizon Robotics

6D位姿估计三维重建

针对动态物体会破坏 VGGT 等 3D 基础模型的位姿估计与几何重建、而现有 4D 方法常需外部先验或微调的问题,VGGT4D 发现 VGGT 全局注意力浅层已隐含运动线索,通过 Gram 相似度跨层跨时窗挖掘动态掩码,并用投影梯度细化边界,再在早期推理中抑制动态 token。六个动态数据集上,其在动态分割、相机位姿和稠密重建均优于对比方法,并可单次处理 500 帧以上序列。

ShapeForce: Low-Cost Soft Robotic Wrist for Contact-Rich Manipulation Figure 1
arXiv preprint2025-11-25

ShapeForce: Low-Cost Soft Robotic Wrist for Contact-Rich Manipulation

Jinxuan Zhu, Zihao Yan, Yangyu Xiao, Jingxiang Guo, Chenrui Tie, Xinyi Cao, Yuhang Zheng, Lin Shao

School of Computing, National University of Singapore, Singapore

6D位姿估计机器人操作

针对接触丰富操作中六轴力/力矩传感器昂贵且易损的问题,ShapeForce用3D打印柔性腕部把外力/力矩转化为可视形变,并通过腕部RGB相机的标记位姿跟踪生成六维“类力”信号;其关键洞察是许多任务只需相对力变化而非精确标定值。实验覆盖插孔、USB插入、拧瓶盖等任务,在经典搜索/控制和学习策略中均优于无接触反馈基线,并接近商用六轴传感器表现。

Anchoring Convenience Survey Samples to a Baseline Census for Vaccine Coverage Monitoring in Global Health Figure 1
arXiv preprint2025-11-24

Anchoring Convenience Survey Samples to a Baseline Census for Vaccine Coverage Monitoring in Global Health

Dyrkton, Nathaniel, Alam, Shomoita, Shepherd, Susan, Sana, Ibrahim, Phelan, Kevin, Park, Jay JH

c. Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Department of Health Research Methods, Evidence and Impact, McMaster University

6D位姿估计综述

针对乍得、尼日尔农村疫苗覆盖率监测中概率抽样成本高、便利样本易有选择偏倚的问题,论文用基线普查锚定后续非概率调查,比较校准权重与逻辑回归插补两类校正估计器。仿真显示偏倚、覆盖率随非可忽略选择偏倚增强和响应率降低而恶化,扩大村庄抽样比例可改善表现;在较现实的OR≤1.2场景下两法接近95%覆盖率,支持该混合调查作为可行替代方案。

IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenes Figure 1
arXiv preprint2025-11-24

IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenes

Carl Lindström, Mahan Rafidashti, Maryam Fatemi, Lars Hammarstrand, Martin R. Oswald, Lennart Svensson Zenseact

Zenseact Chalmers University of Technology University of Amsterdam

6D位姿估计三维重建高斯泼溅

面向自动驾驶仿真中的动态场景重建,IDSplat针对现有方法依赖人工3D轨迹标注或缺少对象级分解的问题,将动态物体建模为刚体实例及其可学习轨迹。方法结合零样本语言引导视频跟踪、激光雷达3D锚定、DINOv3对应关系估计位姿,并用协调转弯平滑与3DGS联合优化修正轨迹。在Waymo上实现有竞争力乃至优于自监督基线的重建质量,同时保留可编辑实例分解且无需重训练。

Graph-based 3D Human Pose Estimation using WiFi Signals Figure 1
arXiv preprint2025-11-24

Graph-based 3D Human Pose Estimation using WiFi Signals

Chen, Jichao, YangYang, Tang, Ruibo, Slock, Dirk

6D位姿估计人体姿态

针对摄像头人体姿态估计易受遮挡、光照和隐私限制,以及现有 WiFi 方法直接从 CSI 回归关节坐标而忽略骨架拓扑的问题,GraphPose-Fi 将人体关节显式建模为图:先用共享 CNN 提取各天线子载波–时间特征,再以轻量时空注意力筛选关键时间片和天线,最后结合 GCN 与自注意力回归 3D 姿态。在 MM-Fi 数据集多种设置下取得优于既有方法的结果。

Analysis of Deep-Learning Methods in an ISO/TS 15066-Compliant Human-Robot Safety Framework Figure 1
Sensors2025-11-24

Analysis of Deep-Learning Methods in an ISO/TS 15066-Compliant Human-Robot Safety Framework

David Bricher, Andreas Müller

Johannes Kepler University of Linz

6D位姿估计机器人操作

针对协作机器人按最保守速度运行导致效率受限的问题,本文提出基于 RGB-D 与深度学习的人机安全框架,将人体/部位三维定位映射到 ISO/TS 15066 的不同生物力学限值,并据最近身体部位动态调节机器人速度。作者比较识别、分割、姿态估计和部位分割等方法,在 KUKA iiwa 拧紧任务中相较传统安全技术最高缩短约 15% 周期时间;但其仍是可行性验证,非认证安全系统。

LAA3D: A Benchmark of Detecting and Tracking Low-Altitude Aircraft in 3D Space Figure 1
arXiv preprint2025-11-24

LAA3D: A Benchmark of Detecting and Tracking Low-Altitude Aircraft in 3D Space

Hai Wu, Shuai Tang, Jiale Wang, Longkun Zou, Mingyue Guo, Rongqin Liang, Ke Chen, Yaowei Wang

Pengcheng Laboratory South China University of Technology, University of Southern California

6D位姿估计数据集/基准

面向低空经济中无人机、eVTOL等目标的三维感知缺少覆盖多类别与6DoF标注的数据,本文构建LAA3D,结合1.5万真实图像和60万合成帧,并提供3D框、类别和实例ID,统一支持检测、跟踪与位姿估计。作者还建立基准并提出适配变焦相机的MonoLAA;实验显示合成预训练经真实数据微调可有效迁移,但性能提升可能主要来自数据规模与标注覆盖。

Multi-Agent Monocular Dense SLAM With 3D Reconstruction Priors Figure 1
arXiv preprint2025-11-24

Multi-Agent Monocular Dense SLAM With 3D Reconstruction Priors

Yuchen Zhou, Haihang Wu

6D位姿估计相机位姿三维重建

针对单目稠密 SLAM 依赖迭代优化且 MASt3R-SLAM 仅支持单机器人的问题,本文将 3D 重建先验引入多智能体框架:各机器人独立完成局部相机位姿估计与稠密建图,再通过基于回环的地图融合形成全局一致地图。实验显示其在真实 Aria 数据上达到接近 RGB-D 方法 MAGiC-SLAM 的轨迹精度且速度更快,并能输出合理稠密点云;但在合成 Replica 上受 MASt3R 输入分辨率影响,精度仍落后 RGB-D 基线。

Robust Long-term Test-Time Adaptation for 3D Human Pose Estimation through Motion Discretization Figure 1
arXiv preprint2025-11-24

Robust Long-term Test-Time Adaptation for 3D Human Pose Estimation through Motion Discretization

Yilin Wen, Kechuan Dong, Yusuke Sugano

6D位姿估计人体姿态

该文针对3D人体姿态在线测试时自适应在长视频中易受伪标签噪声影响、误差随时间累积的问题,提出在运动潜空间聚类得到离散锚点动作,用其正则化姿态估计并支持无需训练数据的自回放,同时用EMA软重置抑制坏更新。在Ego-Exo4D和3DPW上,方法优于既有在线自适应方案,并显示可利用同一人的长期形体与运动习惯提升精度。

CNN-Based Camera Pose Estimation and Localisation of Scan Images for Aircraft Visual Inspection Figure 1
arXiv preprint2025-11-24

CNN-Based Camera Pose Estimation and Localisation of Scan Images for Aircraft Visual Inspection

Xueyan Oh, Leonard Loh, Shaohui Foong, Zhong Bao Andy Koh, Kow Leong Ng, Poh Kang Tan, Pei Lin Pearlin Toh, U-Xuan Tan

6D位姿估计相机位姿

面向机场过站期间无法布设基础设施、接触机体或使用无人机的飞机外观巡检,论文提出用同一台PTZ相机完成初始化、扫描规划与图像定位:仅用3D飞机模型合成图像并做域随机化微调CNN,同时在损失中加入飞机几何约束以提升6D相机位姿估计。真实飞机实验中,各场景位姿RMSE低于0.24 m和2°,可为缺陷图像标注机体表面位置。

Hierarchical GraphCut Phase Unwrapping based on Invariance of Diffeomorphisms Framework Figure 1
IEEE Open Journal of Signal Processing2025-11-24

Hierarchical GraphCut Phase Unwrapping based on Invariance of Diffeomorphisms Framework

Xiang Gao, Xinmu Wang, Zhou Zhao, Junqi Huang, Xianfeng David Gu

Stony Brook University

6D位姿估计

面向结构光三维扫描中相位展开在噪声、遮挡和复杂表面下难以兼顾速度与精度的问题,论文将 GraphCut 相位展开重写为像素标注,并利用微分同胚不变性,通过共形映射与最优传输生成多个域,分别做分层 GraphCut 后多数投票融合相位计数。实验在仿真和真实数据上报告 45.5× 加速且 L2 误差更低,显示其实时高精度三维重建潜力。

Zero-Reference Joint Low-Light Enhancement and Deblurring via Visual Autoregressive Modeling with VLM-Derived Modulation Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-23

Zero-Reference Joint Low-Light Enhancement and Deblurring via Visual Autoregressive Modeling with VLM-Derived Modulation

Wei Dong, Han Zhou, Junwei Lin, Jun Chen

McMaster University

6D位姿估计

针对真实暗光图像常同时存在低可见度、噪声与运动模糊,且配对监督难获取的问题,本文提出无参考 VAR-LIDE:用 VLM 评估的可见度自适应截断增强曲线,并以空间频率 RoPE 和相位域递归调制补偿模糊结构。实验称在多个低光退化基准上达到 SOTA,优势主要来自对照明迭代和模糊相位的动态调制。

LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging Figure 1
arXiv preprint2025-11-23

LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging

He Huang, Yujun Guo, Wei He LIESMARS, Wuhan, China huang_he@whu.edu.cn, yujunguo@whu.edu.cn, weihe1990@whu.edu.cn

LIESMARS, Wuhan University, Wuhan, China

6D位姿估计

针对光谱压缩成像中深度展开网络直接在完整高光谱立方体上迭代、计算冗余且由2D测量反推3D信号病态的问题,LRDUN将低秩分解显式并入成像模型,改为联合恢复光谱基与子空间图像,并用展开PGD和GFUM提升先验表达。模拟与真实数据实验显示其在重建质量上达到SOTA,同时显著降低计算开销。

Expanding the Workspace of Electromagnetic Navigation Systems Using Dynamic Feedback for Single- and Multi-agent Control Figure 1
arXiv preprint2025-11-23

Expanding the Workspace of Electromagnetic Navigation Systems Using Dynamic Feedback for Single- and Multi-agent Control

Jasan Zughaibi, Denis von Arx, Maurus Derungs, Florian Heemeyer, Luca A. Antonelli, Quentin Boehler, Michael Muehlebach, Bradley J. Nelson

6D位姿估计

针对电磁导航系统受功率与散热限制、有效工作空间难以覆盖临床距离的问题,论文指出瓶颈不只在硬件场强,也在控制架构。其核心是用面向运动的力/力矩目标、能量最优电流分配、实时位姿估计和动态反馈替代传统场对齐思路。实验中 OctoMag 平衡3D倒立摆所需电流由8–14A降至0.1–0.2A,并实现共享空间双倒立摆稳定控制;在临床取向 Navion 平台上可在距线圈50cm处稳定平衡。

Muskie: Multi-view Masked Image Modeling for 3D Vision Pre-training Figure 1
arXiv preprint2025-11-22

Muskie: Multi-view Masked Image Modeling for 3D Vision Pre-training

Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou, Tongrui Hu

National University of Defense Technology

6D位姿估计多视角

Muskie针对DINO等单帧视觉骨干在多视角3D任务中缺乏跨视角一致性的问题,将掩码图像建模扩展为多视角补全:用高比例、连续块遮挡迫使模型从其他视角寻找几何对应,并通过交替注意力融合视内/视间信息。无需深度或位姿监督,预训练后在零样本多视角对应上优于DINO/MAE,并作为骨干提升相机位姿估计与点图重建性能。

The nonlinear porous medium equation for the f-Laplacian: Hamilton-Souplet-Zhang type gradient estimates and implications Figure 1
arXiv preprint2025-11-22

The nonlinear porous medium equation for the f-Laplacian: Hamilton-Souplet-Zhang type gradient estimates and implications

Ali Taheri, Vahideh Vahidifar

School of Mathematical and Physical Sciences, University of Sussex, Falmer, Brighton, United Kingdom

6D位姿估计

本文并非6D位姿估计论文,而是研究光滑度量测度空间中带 f-Laplacian 的非线性多孔介质方程,动机是刻画几何曲率、时间演化度量与非线性扩散的相互作用。核心创新在于针对不同指数范围建立 Hamilton-Souplet-Zhang 型梯度估计,并结合 Bakry-Émery Ricci 下界与时变势函数处理。主要结果包括局部梯度界、抛物 Liouville 型结论及古解刻画,扩展了既有热方程和多孔介质方程估计。

SPIDER: Spatial Image CorresponDence Estimator for Robust Calibration Figure 1
arXiv preprint2025-11-21

SPIDER: Spatial Image CorresponDence Estimator for Robust Calibration

Zhimin Shao, Abhay Yadav, Rama Chellappa, Baltimore, USA @jhu.edu Project Page, GitHub

Johns Hopkins University, Baltimore, USA

6D位姿估计

SPIDER针对大基线、低重叠和跨域图像中外观相似但几何不一致、以及3D基础模型匹配偏向主平面的矛盾,提出以3D VFM为共享骨干、结合2D ConvNet细粒度分支的粗到细双头框架,同时输出稠密warp和几何描述子以平衡敏感性与特异性。实验显示其在常规、零样本及航拍到地面等无约束匹配基准上超过现有方法,并通过多尺度细化降低平面偏置。

3D Ground Truth Reconstruction from Multi-Camera Annotations Using UKF Figure 1
arXiv preprint2025-11-18

3D Ground Truth Reconstruction from Multi-Camera Annotations Using UKF

Linh Van Ma1, Unse Fatima1, Tepy Sokun Chriv1, Haroon Imran1, Moongu Jeon1

6D位姿估计多视角三维重建

面向多相机跟踪/机器人场景中3D真值标注昂贵且常被简化为地面点的问题,论文用标定相机的2D框或姿态关键点,经单应投影与UKF融合,自动恢复目标3D位置、尺寸和椭球形状,并平滑关键点轨迹。在CMC、Wildtrack、Panoptic等数据集上定位精度接近已有3D真值;但方法依赖重叠视野、精确标定和可靠2D标注。

NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior Figure 1
arXiv preprint2025-11-21

NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior

Technology of China, Independent Researcher

University of Science and Technology of China, Independent Researcher

6D位姿估计三维重建

该文针对无相机位姿先验训练 NeRF 时,NoPe-NeRF 等仅依赖局部相邻约束、在大视角变化和复杂轨迹下易失效的问题,提出先用显式特征匹配建立图关系并初始化相对位姿,再进行局部联合优化与引入特征轨迹/BA几何一致性的全局优化。实验显示其在公开基准上同时提升位姿估计精度和新视角合成质量,并对非顺序输入与复杂运动更稳健。

MuM: Multi-View Masked Image Modeling for 3D Vision Figure 1
arXiv preprint2025-11-21

MuM: Multi-View Masked Image Modeling for 3D Vision

David Nordström, Johan Edstedt, Fredrik Kahl, Georg Bökman

Chalmers University of Technology, Linköping University, University of Amsterdam

6D位姿估计多视角

针对 DINO 类自监督特征偏语义、CroCo 依赖重叠视角且采样脆弱的问题,MuM 将 MAE 扩展到同一场景任意多视角,对所有视图统一遮挡,并用带跨帧注意力的轻量解码器学习几何特征,减少对共视和几何标注的依赖。实验显示其在前馈 3D 重建、稠密匹配和相对位姿估计中优于 DINOv3 与 CroCo v2,且训练计算量更低;但单目语义任务仍弱于 DINOv3。

BiFingerPose: Bimodal Finger Pose Estimation for Touch Devices Figure 1
arXiv preprint2025-11-21

BiFingerPose: Bimodal Finger Pose Estimation for Touch Devices

Xiongjun Guan ^{ @orcidlink }, Zhiyu Pan ^{ @orcidlink }, Jianjiang Feng ^{ @orcidlink }, Jie Zhou ^{ @orcidlink }

Department of Automation, Tsinghua University, Beijing 100084, China (e-mail: ; ; ; )

6D位姿估计

该文针对触屏设备仅依赖低分辨率电容图难以估计大角度和 roll 姿态的问题,提出 BiFingerPose,将电容图的全局轮廓与屏下小面积指纹 patch 的局部纹理融合,并用三角概率分布表示角度、再由 2D 姿态映射到 3D。实验和 12 人用户研究显示,其姿态预测较既有 SOTA 提升超过 21%,任务效率约 2.5 倍,操作精度提升 23%。

Leveraging CVAE for Joint Configuration Estimation of Multifingered Grippers from Point Cloud Data Figure 1
arXiv preprint2025-11-21

Leveraging CVAE for Joint Configuration Estimation of Multifingered Grippers from Point Cloud Data

Julien Mérand, Boris Meden, Mathieu Grossard Université Paris-Saclay, CEA, List

6D位姿估计点云机器人操作

多指夹爪抓取中,传统 IK 往往只由指尖位姿求解,面对多解、冗余关节和中间指节约束时还需额外筛选或数值优化。本文将夹爪各连杆点云作为条件输入,用 CVAE 直接回归关节配置,并通过 URDF 生成含碰撞过滤的多种点云训练集。在 MultiDex/Allegro Hand 上,推理约 0.05 ms,精度接近现有方法,显示其可作为抓取规划中替代优化求解的快速模块。

SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting Figure 1
arXiv preprint2025-11-24

SPAGS: Sparse-View Articulated Object Reconstruction from Single State via Planar Gaussian Splatting

Di Wu, Liu Liu, Xueyu Yuan, Wenxiao Chen, Lijun Yue, Liuzhu Chen, Yiming Tang, Meng Wang

6D位姿估计三维重建高斯泼溅

SPAGS面向机器人主动感知中铰接物体重建依赖多阶段、多视角采集的问题,尝试仅用单一状态的稀疏RGB视图完成类别无关的部件级重建。其核心是用高斯信息场选择更有信息量的视角,将3D高斯约束为平面高斯,并结合深度平滑、少样本扩散先验与VLM部件/关节推理。合成与真实实验显示其表面重建精度优于现有基线。

RacketVision: A Multiple Racket Sports Benchmark for Unified Ball and Racket Analysis Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-21

RacketVision: A Multiple Racket Sports Benchmark for Unified Ball and Racket Analysis

Linfeng Dong, Yuchen Yang, Hao Wu, Wei Wang, Yuenan Hou, Zhihang Zhong, Xiao Sun : 2

Zhejiang University, Fudan University, University of Shanghai for Science and Technology, ShanghaiTech University, ShangHai JiAi Genetics & IVF Institute, Shanghai Artificial Intelligence Laboratory

6D位姿估计数据集/基准

针对现有球拍运动数据集多局限于单一项目和球轨迹、缺少球拍姿态标注的问题,RacketVision构建了覆盖乒乓球、网球、羽毛球的1672段视频基准,联合支持球跟踪、球拍姿态估计与轨迹预测。关键洞察是球拍信息并非简单拼接即可受益,朴素融合反而退化;采用Cross-Attention后,LSTM预测模型能有效利用球拍上下文,在三类运动上超过强球轨迹单模态基线。

RadioKMoE: Knowledge-Guided Radiomap Estimation with Kolmogorov-Arnold Networks and Mixture-of-Experts Figure 1
IEEE Wireless Communications Letters2025-11-21

RadioKMoE: Knowledge-Guided Radiomap Estimation with Kolmogorov-Arnold Networks and Mixture-of-Experts

Fupei Guo, Kerry Pan, Songyang Zhang, Yue Wang, Zhi Ding

University of Louisiana at Lafayette, University of California, Berkeley, Georgia State University, University of California, Davis

6D位姿估计

面向5G/6G复杂城市场景中由稀疏观测重建高保真无线电地图的难题,本文提出RadioKMoE:先用KAN学习全局传播规律并生成粗覆盖先验,再结合环境信息和物理启发的无线电深度图,由MoE专家按区域模式细化建筑边界、阴影等局部变化。实验显示其在单频与多频RME中较基线具备更高精度和鲁棒性。

MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots Figure 1
arXiv preprint2025-11-21

MobileOcc: A Human-Aware Semantic Occupancy Dataset for Mobile Robots

Junseo Kim, Guido Dumont, Xinyu Gao, Gang Chen, Holger Caesar, 2628 CD Delft, Netherlands @student.tudelft.nl, @tudelft.nl

Delft University of Technology, Mekelweg 5, CD Delft, Netherlands

6D位姿估计机器人操作数据集/基准

面向人群密集场景的移动机器人,现有占用数据集多来自自动驾驶且把动态体当刚体,难以刻画行人非刚性几何。MobileOcc基于CODa构建语义占用数据集,用RGB-LiDAR融合标注静态/自由空间,并以图像初始化SMPL人体网格、再用LiDAR优化人体占用。论文给出单目、双目和全景占用基线,覆盖占用预测与行人速度预测;人体网格优化在3D人体姿态数据集上也表现稳健,但跨室内和恶劣天气的泛化仍文中未充分说明。

BOP-ASK: Object-Interaction Reasoning for Vision-Language Models Figure 1
arXiv preprint2025-11-20

BOP-ASK: Object-Interaction Reasoning for Vision-Language Models

Vineet Bhat, Sungsu Kim, Valts Blukis, Greg Heinrich, Prashanth Krishnamurthy, Ramesh Karri, Stan Birchfield, Farshad Khorrami, NVIDIA

New York University, NVIDIA

6D位姿估计

论文针对现有VLM空间评测只考察粗粒度方位、难以反映机器人抓取、避障和操作顺序等物体交互能力的问题,提出基于BOP精确6D位姿生成的BOP-Ask数据集与core/lab基准,覆盖抓取姿态、物体位姿、路径规划和关系推理等像素级问答。实验显示,用该数据训练可提升开闭源VLM在本基准及部分域外空间推理任务上的表现,并出现更精细的位姿估计与轨迹规划能力,但增益可能主要来自高质量几何标注与数据规模。

Insurance Supervision under Climate Change: A Pioneer Detection Method Figure 1
The Geneva Papers on Risk and Insurance - Issues and Practice (2025)2025-11-20

Insurance Supervision under Climate Change: A Pioneer Detection Method

Eric Vansteenberhge

6D位姿估计

面对气候变化导致极端损失分布突变、保险机构数据割裂且再保险可能退出的问题,论文提出 Pioneer Detection Method:不依赖真实尾部参数或事后误差,而根据专家判断在时间上的方向变化与同业向其收敛来加权汇总意见。基于 Pareto 尾部风险与贝叶斯学习的蒙特卡洛实验显示,PDM 在冲击后更快逼近真实尾参数,RMSE 优于线性池化、中位数和贝叶斯平均等基线,并在保险主体较少的市场中带来更明显福利改善。

Regularized Unfolding of gamma-ray Spectra for Nuclear Physics Applications Figure 1
arXiv preprint2025-11-14

Regularized Unfolding of gamma-ray Spectra for Nuclear Physics Applications

Lima, Braseth, L. L, Mjøs, A. H, Hjorth-Jensen, Kvellestad, Larsen, A. C

Department of Physics, University of Oslo, N-Oslo, Norway, Norwegian Nuclear Research Center, Norway, Center for Computing in Science Education, University of Oslo, N-Oslo, Norway

6D位姿估计

针对核物理中伽马谱探测响应导致的病态泊松反问题,论文提出带正则化的最大似然展开框架,在非负性、探测器响应约束下显式建模背景与污染源,并给出逐 bin 置信区间。仿真显示其在低复杂度谱上比 FICS/集成法更平滑、偏差更小且覆盖率校准更好;高复杂度谱仍困难,但不确定性覆盖基本保持。

NoPo-Avatar: Generalizable and Animatable Avatars from Sparse Inputs without Human Poses Figure 1
arXiv preprint2025-11-20

NoPo-Avatar: Generalizable and Animatable Avatars from Sparse Inputs without Human Poses

Jing Wen, Alexander G. Schwing

University of Illinois Urbana-Champaign

6D位姿估计人体姿态

针对稀疏图像重建可动画人体时强依赖相机/人体位姿、且位姿估计噪声会显著拉低质量的问题,NoPo-Avatar直接从图像与前景掩码预测规范T-pose下的高斯头像表示。其双分支设计用模板分支补全不可见人体区域、图像分支保留观测细节,并通过交叉注意力融合。实验在THuman2.0、XHuman、HuGe100K上显示,在仅有预测位姿的实际设置中明显优于依赖位姿的基线,在使用真值位姿的实验室设置中也达到相近效果。

Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrations Figure 1
arXiv preprint2025-11-20

Dexterity from Smart Lenses: Multi-Fingered Robot Manipulation with In-the-Wild Human Demonstrations

Irmak Guzey, Haozhi Qi, Julen Urain, Changhao Wang, Jessica Yin, Krishna Bodduluri, Mike Lambeta, Lerrel Pinto, Akshara Rai, Jitendra Malik, Tingfan Wu, Akash Sharma, Meta aina-robot.github.io

New York University, Meta

6D位姿估计机器人操作

本文针对从日常人类视频学习多指机器人操作时的人机形态差异与3D线索缺失问题,提出 Aina:利用 Aria Gen 2 智能眼镜采集野外第一视角数据,将手关键点、立体深度与物体点云提升到3D/近4D表示,训练点云闭环策略并直接迁移到多指手,无需机器人数据、仿真或在线校正。实验在9个日常操作任务上优于既有人到机器人学习方法,并通过消融验证3D手—物表示和智能眼镜感知是关键因素。

Sensor Informativeness, Identifiability, and Uncertainty in Bayesian Inverse Problems for Structural Health Monitoring Figure 1
arXiv preprint2025-11-21

Sensor Informativeness, Identifiability, and Uncertainty in Bayesian Inverse Problems for Structural Health Monitoring

Tammam Bakeer, Max Herbers, Steffen Marx : 2

Independent Researcher, Dresden, Germany

6D位姿估计

针对桥梁结构健康监测中由稀疏倾角数据反推分布式抗弯刚度的病态性,论文将传统正则化重写为贝叶斯反问题,并用 Fisher 信息刻画传感器与荷载路径的可辨识区域。在 openLAB 实桥车辆通行数据上,方法不仅恢复了跨向刚度差异,还给出可信区间,显示信息量虽高但空间分布不均,支座等低信息区域存在实际不可辨识性。

EOGS++: Earth Observation Gaussian Splatting with Internal Camera Refinement and Direct Panchromatic Rendering Figure 1
arXiv preprint2025-11-20

EOGS++: Earth Observation Gaussian Splatting with Internal Camera Refinement and Direct Panchromatic Rendering

Pierrick Bournez, Luca Savant Aira Thibaud Ehret, Gabriele Facciolo

Universite Paris-Saclay, CNRS, ENS Paris-Saclay, Centre Borelli, Gif-sur-Yvette, France

6D位姿估计三维重建高斯泼溅

该文针对卫星多视图三维重建中 NeRF 训练慢、EOGS 依赖全色锐化和外部位姿优化的问题,提出 EOGS++:直接用高分辨率全色影像渲染,并在高斯泼溅训练中引入基于光流的内部 bundle adjustment,配合早停与 TSDF 后处理提升几何质量。在 IARPA 2016 与 DFC2019 上,其建筑 MAE 从 EOGS 的 1.33 降至 1.19,并优于若干 NeRF 方法。

Physics-Informed Machine Learning for Efficient Sim-to-Real Data Augmentation in Micro-Object Pose Estimation Figure 1
arXiv preprint2025-11-20

Physics-Informed Machine Learning for Efficient Sim-to-Real Data Augmentation in Micro-Object Pose Estimation

Zongcai Tan, Lan Wei, Dandan Zhang

6D位姿估计物体位姿仿真到现实

针对微型光学机器人真实显微图像采集和标注昂贵、纯 GAN 合成难以保留离焦和衍射等位姿线索的问题,本文将波动光学渲染与深度对齐引入 PixelGAN,构建物理约束的 sim-to-real 数据增强流程。合成图像 SSIM 较纯学习方法提升 35.6%,生成速度达 0.022 秒/帧;用其训练的 CNN 位姿估计在 pitch/roll 上达 93.9%/91.9%,仅比全真实数据低约 5%,且对未见姿态仅小幅退化。

End-to-End Motion Capture from Rigid Body Markers with Geodesic Loss Figure 1
arXiv preprint2025-11-20

End-to-End Motion Capture from Rigid Body Markers with Geodesic Loss

Hai Lan

University of Chinese Academy of Sciences, Fujian Medical University, Fuzhou University, Chinese Academy of Sciences

6D位姿估计人体姿态

针对传统光学动捕依赖密集无标签标记、准备耗时且易受遮挡重编号影响的问题,论文将单点标记替换为可唯一识别6D位姿的刚体标记RBM,并用时序网络在测地损失下端到端回归SMPL参数。基于AMASS合成训练和Vicon实采验证,方法在精度上达到或接近优化式方案,同时计算量降低一个数量级以上。

Shallow neural network yields regularization for ill-posed inverse problems Figure 1
arXiv preprint2025-11-20

Shallow neural network yields regularization for ill-posed inverse problems

Lan Wang, Qiao Zhu, Bangti Jin, Ye Zhang

6D位姿估计

针对含噪观测下非线性病态反问题中神经网络易过拟合、缺少正则化理论的问题,本文从算子方程出发证明浅层网络的通用逼近与稳定性,将“逐步扩展神经元数”作为迭代正则化机制,使网络规模同时扮演正则化参数。主要结果表明噪声较大时小网络更稳定,并在变分正则化假设下给出收敛率和最优神经元数量选择;与6D位姿估计的直接关系文中未充分说明。

Box6D : Zero-shot Category-level 6D Pose Estimation of Warehouse Boxes Figure 1
arXiv preprint2025-11-19

Box6D : Zero-shot Category-level 6D Pose Estimation of Warehouse Boxes

Yintao Ma, Sajjad Pakdamansavoji, Amir Rasouli, Tongtong Cao Huawei Technologies Canada

Huawei Technologies Canada

6D位姿估计类别级位姿

面向仓库中尺寸多变、纹理弱且常被遮挡的纸箱,Box6D试图避免为每个实例维护CAD模型。其核心是在SAM6D式流程上用单一类别CAD模板,通过RGB-D观测的逐轴二分估计尺寸,并以深度一致性过滤对称性导致的错误位姿假设,结合早停降低计算量。实验覆盖真实仓库数据和公开基准,报告精度达到竞争或更优水平,推理时间约减少76%。

Bayesian semiparametric modelling of biomarker variability in joint models Figure 1
arXiv preprint2025-11-19

Bayesian semiparametric modelling of biomarker variability in joint models

Sida Chen, Jessica K. Barrett, Marco Palma, Jianxin Pan, Cambridge, London, Application for Data Science, Zhuhai, China Yale School of Public Health, New Haven, U.S.A

MRC Biostatistics Unit, University of Cambridge, Cambridge, U.K, Great Ormond Street Institute of Child Health, University College London, London, U.K, Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science, Beijing Normal-Hong Kong Baptist University, Zhuhai, China

6D位姿估计

该文并非6D位姿估计研究,而是面向纵向生物标志物与生存结局联合建模,解决轨迹型个体内变异(TB-WIV)对轨迹设定和结点选择敏感的问题。作者在贝叶斯框架下引入P-spline与FPCA等半参数建模方式,并与既有方法仿真比较;结果显示两者在参数推断和生存预测上更稳定,在英国囊性纤维化数据中发现肺功能TB-WIV与死亡风险正相关。

WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion Figure 1
arXiv preprint2025-11-19

WALDO: Where Unseen Model-based 6D Pose Estimation Meets Occlusion

Sajjad Pakdamansavoji ∗ ^, Yintao Ma, Amir Rasouli

Huawei Technologies Canada

6D位姿估计

WALDO针对未见物体在遮挡场景下的模型式6D位姿估计,指出传统检测—分割—初值—精修流水线易因早期错误累积而失效。方法在推理中估计可见性并对可见区域动态非均匀采样,保留多位姿假设并迭代精修,同时用遮挡增强训练,并提出按可见性加权的评估指标。实验显示其在ICBIN准确率提升超过5%,BOP提升超过2%,推理约快3倍。

Scriboora: Rethinking Human Pose Forecasting Figure 1
arXiv preprint2025-11-19

Scriboora: Rethinking Human Pose Forecasting

Germany daniel.bermuth@uni-a.de

University of Augsburg, Germany, University of Augsburg

6D位姿估计人体姿态

本文针对人体绝对姿态预测中评测协议混乱、复现困难且缺少真实部署噪声评估的问题,重建统一训练/评测流水线并审计多种方法;核心洞察是将姿态预测视为序列到序列任务,迁移语音识别中的 Conformer 并优化为 MotionConformer。结果显示其在保持实时吞吐的同时达到新的 SOTA,且真实姿态估计噪声会显著拉低性能,但可通过无监督微调部分恢复。

Asymptotic stability of planar entropy wave for 3-d Navier-Stokes equations in Eulerian coordinates Figure 1
arXiv preprint2025-11-19

Asymptotic stability of planar entropy wave for 3-d Navier-Stokes equations in Eulerian coordinates

Renjun Duan, Feimin Huang, Rui Li, Lingda Xu

Department of Mathematics, The Chinese University of Hong Kong, Shatin, Hong Kong, China, Department of Applied Mathematics, The Hong Kong Polytechnic University, Hong Kong, China

6D位姿估计

本文针对三维欧拉坐标下 Navier–Stokes 平面熵波稳定性长期未解的问题,重点处理多维结构条件失效与非零初始质量诱发扩散波带来的慢衰减误差。作者通过新的变量变换恢复左右结构条件,并结合熵波导数定号的加权能量估计控制低阶项;在零质量情形进一步利用 Poincaré 型不等式和关键抵消,证明了渐近稳定性并给出最优衰减率。

Deep Learning for Accurate Vision-based Catch Composition in Tropical Tuna Purse Seiners Figure 1
arXiv preprint2025-11-19

Deep Learning for Accurate Vision-based Catch Composition in Tropical Tuna Purse Seiners

Xabier Lekunberri, Ahmad Kamal, Izaro Goienetxea, Jon Ruiz, Iñaki Quincoces, Jaime Valls Miro, Ignacio Arganda-Carreras, Jose A. Fernandes-Salvador

AZTI, Marine Research, Basque Research and Technology Alliance (BRTA), Txatxarramendi Ugartea z/g, Sukarrieta (Bizkaia), 48395, Spain, University of the Basque Country (UPV/EHU), San Sebastian, Spain, Donostia International Physics Center (DIPC), San Sebastian, Spain, Biofisika Institute (CSIC, UPV/EHU), Leioa, Spain

6D位姿估计

该研究针对围网金枪鱼电子监控视频人工复核量大、黄鳍金枪鱼与大眼金枪鱼难区分的问题,构建基于船上观察员真值的多阶段视觉流程:YOLOv9+SAM2分割、ByteTrack跟踪,并用层级分类提升泛化。专家一致性很低,说明任务本身困难;最佳组合可处理并分类84.8%的个体,渔获组成平均绝对误差为4.5%。

RocSync: Millisecond-Accurate Temporal Synchronization for Heterogeneous Camera Systems Figure 1
arXiv preprint2025-11-18

RocSync: Millisecond-Accurate Temporal Synchronization for Heterogeneous Camera Systems

Jaro Meyer, Frédéric Giraud, Joschua Wüthrich, Marc Pollefeys, Philipp Fürnstahl, Lilian Calvet

ETH Zurich, Zurich, Switzerland, Research in Orthopedic Computer Science, Balgrist University Hospital, University of Zurich, Zurich, Switzerland

6D位姿估计

多相机6D位姿、三维重建等任务对毫秒级同步敏感,但真实场景常混用RGB/IR、消费级与专业相机,难以硬同步。RocSync用自制红光/红外LED Clock在画面中编码全局时间,并从曝光形成的弧段恢复曝光窗口,实现与内容、视场和音频无关的亚帧对齐;相对硬同步残差为1.34 ms RMSE,并在多视角位姿估计、三维重建和25台以上异构手术相机中验证有效。

A visual study of ICP variants for Lidar Odometry Figure 1
arXiv preprint2025-11-18

A visual study of ICP variants for Lidar Odometry

Dingler, Sebastian, Burrichter, Hannes

6D位姿估计相机位姿点云

针对激光里程计中 ICP 易受动态物体、非重叠视野和噪声影响的问题,论文以二维可视化方式分析多维目标函数,系统比较点云配准链路各阶段的 ICP 变体,并提出 ego blind spot filter 与 Octree Correspondence Filter 过滤错误对应。结果显示该视角能揭示局部极小和失配来源,所提过滤策略可缓解动态与盲区干扰,但具体精度增益文中未充分说明。

Integrated Positioning and Communication for Cooperative Multi-LEO Uplink Communications: A Dual-Timescale Kalman Filter-Aided Approach Figure 1
arXiv preprint2025-11-18

Integrated Positioning and Communication for Cooperative Multi-LEO Uplink Communications: A Dual-Timescale Kalman Filter-Aided Approach

Ali Hanif, Yuchen Zhang, Pinjun Zheng, Tareq Y. Al-Naffouri

6D位姿估计

低轨卫星上行通信受链路预算紧、信道相干时间短影响,可靠 CSI 获取困难。本文把在环 LEO 定位引入多星协同通信,利用位置相关参数与随机信道增益的不同时间尺度,以 UKF 跟踪用户位置/速度、以 KF 做数据辅助信道估计,并用 EM 联合检测。数值实验显示其在信道估计精度和通信性能上优于常规基线。

BEDLAM2.0: Synthetic Humans and Cameras in Motion Figure 1
arXiv preprint2025-11-18

BEDLAM2.0: Synthetic Humans and Cameras in Motion

Joachim Tesch, Giorgio Becherini, Prerana Achar, Anastasios Yiannakidis, Muhammed Kocabas, Priyanka Patel, Tübingen, Germany Meshcapade GmbH

Max Planck Institute for Intelligent Systems, Tübingen, Germany

6D位姿估计仿真到现实

针对同时存在人体与相机运动时,世界坐标系下3D人体运动估计缺少高质量真值视频的问题,BEDLAM2.0在原BEDLAM上扩展了真实相机焦距与平移、缩放、环绕、跟踪及手持/头显采集的相机运动,并提升体型、服装、头发、鞋和场景多样性。数据集含2.7万余序列、800万帧,训练多种SOTA回归器时较BEDLAM在标准指标上显著提升,B1+B2组合达到世界坐标人体姿态估计SOTA。

A Quantitative Method for Shoulder Presentation Evaluation in Biometric Identity Documents Figure 1
arXiv preprint2025-11-18

A Quantitative Method for Shoulder Presentation Evaluation in Biometric Identity Documents

Computer Science, s243942@student.dtu.dk

Department of Applied Mathematics and Computer Science, Technical University of Denmark (DTU)

6D位姿估计

针对证件照质量控制中“肩部正对相机”缺少独立量化指标的问题,论文提出 SPE:仅用左右肩两个 3D 关键点分别估计肩部偏航与滚转,并以几何均合成合规分数,可实时运行。121 张肖像实验显示该分数与人工标注相关性约 r=0.80,低分样本过滤能降低相对人工标签的分类错误;但评估未接入真实人脸识别 FNMR,且标注来自单一评审者。

Simultaneous Localization and 3D-Semi Dense Mapping for Micro Drones Using Monocular Camera and Inertial Sensors Figure 1
arXiv preprint2025-11-18

Simultaneous Localization and 3D-Semi Dense Mapping for Micro Drones Using Monocular Camera and Inertial Sensors

Jeryes Danial, Yosi Ben Asher, Itzik Klein

6D位姿估计

面向微型无人机在低算力平台上既要实时定位又要获得可导航几何的需求,论文提出边缘感知单目视觉惯性SLAM:用稀疏关键点估计位姿,结合轻量深度预测与边缘重建生成半稠密地图,并以EKF融合IMU缓解尺度歧义。系统在DJI Tello与TUM RGBD上展示实时建图、走廊导航和避障能力,但具体精度增益幅度文中未充分说明。

LSP-YOLO: A Lightweight Single-Stage Network for Sitting Posture Recognition on Embedded Devices Figure 1
arXiv preprint2025-11-18

LSP-YOLO: A Lightweight Single-Stage Network for Sitting Posture Recognition on Embedded Devices

Nanjun Li : 1, Ziyue Hao, Quanqiang Wang, Xuanyin Wang

6D位姿估计

针对久坐场景中传统传感器或视觉两阶段坐姿识别侵入性强、边缘端计算开销大的问题,论文提出基于 YOLOv11-Pose 的单阶段 LSP-YOLO,将关键点估计与坐姿分类通过点卷积和中间监督端到端融合,并用 PConv+SimAM 构成 Light-C3k2 降低复杂度。在自建 5000 张、6 类坐姿数据集上,最小模型仅 1.9MB,PC 端达到 94.2% 准确率和 251 FPS,并在 SV830C+GC030A 上验证实时部署。

Dental3R: Geometry-Aware Pairing for Intraoral 3D Reconstruction from Sparse-View Photographs Figure 1
arXiv preprint2025-11-18

Dental3R: Geometry-Aware Pairing for Intraoral 3D Reconstruction from Sparse-View Photographs

Yiyi Miao, Taoyu Wu, Tong Chen, Ji Jiang, Zhe Tang, Zhengyong Jiang, Angelos Stefanidis, Limin Yu, Jionglong Su

6D位姿估计三维重建

Dental3R面向远程正畸中仅有少量、无位姿口内手机照片的三维重建问题,针对大基线、反光和光照不一致导致的位姿/几何不稳,提出几何感知配对策略GAPS,为DUSt3R选择紧凑高价值视图子图以降低匹配开销并增强初始化;随后在3DGS训练中加入小波正则,缓解稀疏视角下的过平滑并保留牙釉质边界等细节。论文在950例临床数据和195例视频测试集上报告优于现有方法的新视角合成质量,但作为arXiv预印本,其临床级几何精度和泛化边界仍需进一步验证。

V2VLoc: Robust GNSS-Free Collaborative Perception via LiDAR Localization Figure 1
arXiv preprint2025-11-18

V2VLoc: Robust GNSS-Free Collaborative Perception via LiDAR Localization

Wenkai Lin, Qiming Xia, Wen Li, Xun Huang, Chenglu Wen

6D位姿估计点云

V2VLoc针对隧道、遮挡或干扰等GNSS失效场景下多车协同感知难以对齐的问题,引入回归式LiDAR定位生成位姿与置信度,并用PASTAT进行置信度感知的时空特征校正,同时构建支持定位与检测的仿真数据集。实验显示该框架在V2VLoc上达到GNSS-free协同检测SOTA,并在真实V2V4Real上验证了泛化性。

ArbESC+: Arabic Enhanced Edit Selection System Combination for Grammatical Error Correction Resolving conflict and improving system combination in Arabic GEC Figure 1
arXiv preprint2025-11-18

ArbESC+: Arabic Enhanced Edit Selection System Combination for Grammatical Error Correction Resolving conflict and improving system combination in Arabic GEC

Faculty of Computing, Saudi Arabia aalhothali@kau.edu.sa

Department of Computer Sciences, Faculty of Computing and Information Technology, King Abdulaziz University, Saudi Electronic University, King Abdulaziz University

6D位姿估计

针对阿拉伯语形态和句法复杂、标注资源有限且既有GEC多依赖单模型的问题,论文提出ArbESC+,在编辑级融合AraT5、ByT5、mT5、AraBART等9个系统输出,用二分类器选择候选修正,并加入重叠过滤与冲突消解。实验在QALB-14、QALB-15 L1/L2上分别达到82.63%、84.64%、65.55% F0.5,优于单模型基线。

iGaussian: Real-Time Camera Pose Estimation via Feed-Forward 3D Gaussian Splatting Inversion Figure 1
arXiv preprint2025-11-18

iGaussian: Real-Time Camera Pose Estimation via Feed-Forward 3D Gaussian Splatting Inversion

Hao Wang, Linqing Zhao, Xiuwei Xu, Jiwen Lu, Haibin Yan

6D位姿估计相机位姿三维重建高斯泼溅

针对基于 NeRF/3DGS 的相机定位常需反复渲染-比较-优化、难以满足机器人实时性的痛点,iGaussian 将预建 3D 高斯场景反演为前馈位姿估计:先用球面采样参考视角和场景先验网络回归粗 6DoF 位姿,再通过图像-高斯属性互相关、特征匹配与多视角加权融合细化。实验在 NeRF Synthetic、Mip-NeRF 360、T&T+DB 上将中位旋转误差降至 0.2°,移动机器人跟踪达 2.87 FPS,约比优化式方法快 10 倍。

GRLoc: Geometric Representation Regression for Visual Localization Figure 1
arXiv preprint2025-11-17

GRLoc: Geometric Representation Regression for Visual Localization

Changyang Li, Xuejian Ma, Lixiang Liu, Zhan Li, Qingan Yan, Yi Xu

6D位姿估计相机位姿

GRLoc针对绝对位姿回归易记忆训练视角、缺少几何约束的问题,将相机定位改写为“逆渲染”式的几何表示回归:先从图像预测世界坐标系下的raymap和pointmap,分别服务于旋转与平移,再用可微确定性求解器恢复6D位姿。论文的关键洞察是解耦旋转/平移可缓解优化冲突;在7-Scenes和Cambridge Landmarks上相对现有APR取得SOTA,室外平均误差降幅尤为明显。

RSPose: Ranking Based Losses for Human Pose Estimation Figure 1
arXiv preprint2025-11-17

RSPose: Ranking Based Losses for Human Pose Estimation

Muhammed Can Keles, Bedrettin Cetinkaya, Sinan Kalkan, Emre Akbas

6D位姿估计人体姿态

本文针对热图式人体姿态估计中 MSE 损失定位峰值不敏感、正负像素极不均衡以及训练目标与 mAP 不一致的问题,提出 RSPose:用 Spatial-RS 对前景关键点与背景像素做排序,并用 Instance-Sort 对齐置信度与定位质量。该损失可用于 1D/2D 热图模型,在 COCO、CrowdPose、MPII 上验证;ViTPose-H 在 COCO-val 达到 79.9 AP,SimCC-ResNet50 提升 1.5 AP 至 73.6。

Credal Ensemble Distillation for Uncertainty Quantification Figure 1
arXiv preprint2025-11-14

Credal Ensemble Distillation for Uncertainty Quantification

Kaizheng Wang, Fabio Cuzzolin, David Moens, Hans Hallez

6D位姿估计

这篇工作针对深度集成在不确定性估计中效果好但推理开销高的问题,提出 Credal Ensemble Distillation,将集成教师压缩为单个 CREDIT 模型;其关键不是拟合单一 softmax,而是预测逐类概率区间并重建 credal set,同时用交集概率做分类。在多组 OOD 检测基准上,CED 的不确定性估计与深度集成、ED/EDD 等方法相当或更优,并显著降低推理成本,但与 6D 位姿估计的直接关系文中未充分说明。

Minimax Multi-Target Conformal Prediction with Applications to Imaging Inverse Problems Figure 1
arXiv preprint2025-11-24

Minimax Multi-Target Conformal Prediction with Applications to Imaging Inverse Problems

Jeffrey Wen, wen.254@buckeyemail.osu.edu

Department of Electrical and Computer Engineering, The Ohio State University, Department of Biomedical Engineering

6D位姿估计

针对病态成像逆问题中深度重建可能产生幻觉、且下游往往有多个评价或任务目标的不确定性需求,本文提出最小化最大单目标覆盖率的多目标 conformal prediction,在保证有限样本联合边际覆盖的同时压缩并平衡各目标区间。合成数据和四个加速 MRI 实验显示,相比 IA、QN、CPTS 等方法,其单目标覆盖更均衡且仍满足联合覆盖;与 6D 位姿估计的直接关联文中未充分说明。

GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-17

GeoX-Bench: Benchmarking Cross-View Geo-Localization and Pose Estimation Capabilities of Large Multimodal Models

Yushuo Zheng, Jiangyong Ying, Huiyu Duan : 1, Chunyi Li, Zicheng Zhang, Jing Liu, Xiaohong Liu : 1, Guangtao Zhai

Shanghai Jiao Tong University, Shanghai Artificial Intelligence Laboratory, Tianjin University, Institute of Natural Science

6D位姿估计数据集/基准

面向GPS受限下导航、自动驾驶和户外机器人所需的跨视角地理定位与相机朝向推理,GeoX-Bench构建了覆盖49国128城的全景-卫星配对与75万余QA,系统评测25个LMM。结果显示模型在粗粒度定位上尚可,但在精细位姿估计和跨视角几何推理上显著失效;几何指令微调能提升表现,但仍未弥合核心差距。

Hybrid-Domain Adaptative Representation Learning for Gaze Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-17

Hybrid-Domain Adaptative Representation Learning for Gaze Estimation

Qida Tan, Hongyu Yang, Wenchao Du

Sichuan University

6D位姿估计

本文针对单张低分辨率人脸图像中眼部线索弱、表情/佩戴物/成像质量导致跨域凝视估计退化的问题,提出 HARL:用高质量近眼图像通过无监督域适配约束低质量人脸特征,并以逆 Gram 矩阵对齐特征相关性,同时引入稀疏图融合头姿与视线的几何约束。方法在 EyeDiap、MPIIFaceGaze、Gaze360 上分别达到 5.02°、3.36°、9.26°,跨数据集评测也保持竞争力。

GaRLILEO: Gravity-aligned Radar-Leg-Inertial Enhanced Odometry Figure 1
arXiv preprint2025-11-17

GaRLILEO: Gravity-aligned Radar-Leg-Inertial Enhanced Odometry

Chiyun Noh affiliationmark: affiliationmark, Sangwoo Jung affiliationmark: affiliationmark, Hanjun Kim affiliationmark, Yafei Hu affiliationmark, Laura Herlant affiliationmark, and Ayoung Kim affiliationmark

Robotics and AI Institute, Cambridge, USA

6D位姿估计相机位姿

GaRLILEO面向足式机器人在楼梯、斜坡等接触冲击和打滑场景中的垂直里程计漂移问题,提出不依赖相机/LiDAR的雷达-腿-IMU连续时间框架:用雷达多普勒与腿运动学构建自车速度样条以解耦IMU加速度,并以软S²约束重力因子稳定估计重力方向。自采室内外数据表明其达到SOTA精度,尤其改善楼梯和坡面上的垂直位姿估计。

End-to-End Multi-Person Pose Estimation with Pose-Aware Video Transformer Figure 1
arXiv preprint2025-11-17

End-to-End Multi-Person Pose Estimation with Pose-Aware Video Transformer

Yonghui Yu, Jiahang Cai : 1, Xun Wang, China

Zhejiang Gongshang University, China

6D位姿估计

针对视频多人姿态估计依赖检测、裁剪和 NMS 导致端到端优化困难、拥挤场景效率与精度受限的问题,PAVE-Net 用空间编码器、时空姿态解码器和姿态感知注意力在帧间关联同一人体,并进一步建模关节点时空依赖。其在 PoseTrack2017 相比图像式端到端方法提升 6.0 mAP,精度接近两阶段视频方法且效率更高,但不处理姿态跟踪。

Difficulty-Aware Label-Guided Denoising for Monocular 3D Object Detection Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-17

Difficulty-Aware Label-Guided Denoising for Monocular 3D Object Detection

Soyul Lee, Seungmin Baek, Dongbo Min

Ewha Womans University Medical Center

6D位姿估计

单目3D检测因深度线索缺失,尤其在远距、遮挡、截断目标上定位不稳。MonoDLGD的核心是把3D真值标签作为训练期几何监督进行扰动—重建,并用实例不确定性调节噪声强度:难例少扰动、易例强扰动,避免统一去噪破坏结构信号。结合3D-DAB查询先验后,方法在KITTI各难度设置达到SOTA,且扰动重建仅用于训练,推理阶段基本无额外开销。

CapeNext: Rethinking and refining dynamic support information for category-agnostic pose estimation Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-17

CapeNext: Rethinking and refining dynamic support information for category-agnostic pose estimation

Yu Zhu, Dan Zeng, Shuiwang Li, Qijun Zhao, Qiaomu Shen, Bo Tang

Sun Yat-sen University, Guilin University of Technology, Sichuan University, Beijing Institute of Technology, Southern University of Science and Technology

6D位姿估计类别级位姿

CapeNext针对类别无关姿态估计中固定文本关键点嵌入易产生跨类别歧义、且难区分同类实例细节的问题,提出将查询图像也作为动态“支持”信息,并结合类别文本,通过层次化跨模态交互与双流特征细化来调整关键点表示。在MP-100上,不同骨干网络下均显著超过现有CAPE方法。

Inertia-Informed Orientation Priors for Event-Based Optical Flow Estimation Figure 1
arXiv preprint2025-11-17

Inertia-Informed Orientation Priors for Event-Based Optical Flow Estimation

Pritam P. Karmokar, USA pritam.karmokar@mavs.uta.edu, william.beksi@uta.edu

The University of Texas at Arlington

6D位姿估计事件相机

针对事件相机光流中事件稀疏且对比度最大化优化高度非凸、依赖初始化与正则的问题,论文提出 OPCM:利用由相机三维线速度和角速度生成的像素级方向图作为惯性先验,引导事件轨迹搜索并约束方向对齐;在无速度时可退化为标准 CM。方法在 MVSEC、DSEC、ECD 上取得优于现有方法的精度与更稳定收敛,但收益主要限于自运动主导场景。

PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photos Figure 1
arXiv preprint2025-11-18

PFAvatar: Pose-Fusion 3D Personalized Avatar Reconstruction from Real-World Outfit-of-the-Day Photos

Dianbing Xi : 1, Guoyuan An : 1, Jingsen Zhu, Zhijian Liu, Yuan Liu, Ruiyuan Zhang, Jiayuan Lu, Yuchi Huo, Rui Wang

6D位姿估计三维重建

PFAvatar面向真实OOTD相册中姿态多变、遮挡和背景复杂导致传统标定/分割式3D人体重建不稳的问题,改用姿态感知扩散模型端到端学习整身外观,并以CPPL抑制少样本微调漂移,再通过SMPL-X规范空间采样、多分辨率3D-SDS和NeRF表示蒸馏头像。实验显示其在保真度、细节和遮挡/截断鲁棒性上优于现有方法,个性化约5分钟完成。

CoordAR: One-Reference 6D Pose Estimation of Novel Objects via Autoregressive Coordinate Map Generation Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-22

CoordAR: One-Reference 6D Pose Estimation of Novel Objects via Autoregressive Coordinate Map Generation

Dexin Zuo, Ang Li, Wei Wang, Wenxian Yu, Danping Zou : 1

Shanghai Jiao Tong University, Midea Group (China)

6D位姿估计未知物体

针对未知物体缺少 CAD 模型时的 6D 位姿估计,CoordAR 将单参考视角下的参考—查询 3D 对应从连续坐标回归改为离散坐标图 token 的自回归概率生成,并用 RGB/坐标解耦编码与 Transformer 融合提升全局一致性和不确定性表达。论文报告其在多个基准上超过现有单参考方法,并在对称、遮挡等场景中更稳健。

ActiveGrasp: Information-Guided Active Grasping with Calibrated Energy-based Model Figure 1
arXiv preprint2025-11-16

ActiveGrasp: Information-Guided Active Grasping with Calibrated Energy-based Model

Boshu Lei, Wen Jiang : 1, Archimedes, Athena RC @seas.upenn.edu, kostas@cis.upenn.edu

University of Pennsylvania Archimedes, Athena RC

6D位姿估计

针对密集杂乱场景中单视角难以提供可靠抓取信息的问题,ActiveGrasp将下一最佳视角选择直接建立在SE(3)抓取分布的信息增益上,而非可见性或2D/3D投影启发式。其校准能量模型把能量与抓取成功率对齐,并用分布熵下降选择视角;仿真和真实机器人实验显示,在有限视角预算下抓取成功率优于已有方法,同时提供可复现实验平台。

OPFormer: Object Pose Estimation leveraging foundation model with geometric encoding Figure 1
arXiv preprint2025-11-16

OPFormer: Object Pose Estimation leveraging foundation model with geometric encoding

Artem Moroz, Vít Zeman, Martin Mikšík, Elizaveta Isianova, Miroslav David Pavel Burget, Robotics, Cybernetics

Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague

6D位姿估计物体位姿

面向新物体6D位姿估计中对CAD依赖强、几何表征不足与效率受限的问题,OPFormer将CNOS检测、DINOv2特征和Transformer匹配结合,在多模板联合编码中加入NOCS几何位置先验,并支持由多视图图像快速重建NeRF完成无模型上板。其通过解2D-3D对应的PnP输出位姿,在BOP-Classic-Core、BOP-H3及BOP 2023/2024设置中表现出有竞争力的精度-速度折中。

Visible Structure Retrieval for Lightweight Image-Based Relocalisation Figure 1
arXiv preprint2025-11-16

Visible Structure Retrieval for Lightweight Image-Based Relocalisation

Fereidoon Zangeneh, Leonard Bruns, Amit Dekel, Alessandro Pieropan, Patric Jensfelt

Amit Dekel2, Division for Robotics, KTH Royal Institute of Technology

6D位姿估计

本文针对大规模场景中结构化重定位需在海量3D点中搜索2D-3D对应、依赖图像检索会带来随观测数增长的存储与计算开销的问题,提出Visible Structure Retrieval:用小型场景特定网络从查询图像直接预测其可见SfM结构点子集,再进行描述子匹配与PnP。实验在Cambridge和Aachen上达到接近主流结构化/检索方法的精度,检索存储为O(1),Aachen单图约89ms,显著快于HLoc但精度略低。

Transfer learning for high-dimensional Factor-augmented sparse linear model Figure 1
arXiv preprint2025-11-18

Transfer learning for high-dimensional Factor-augmented sparse linear model

Bo Fu School of Mathematics, Dandan Jiang* School of Mathematics

School of Mathematics and Statistics, Xi’an Jiaotong University

6D位姿估计

针对目标样本少、协变量强相关且存在潜在共同因子的高维回归场景,论文提出 Trans-FARM,将迁移学习嵌入因子增强稀疏线性模型,在分离潜在因子与个体成分后利用异构辅助数据估计目标系数。其创新在于同时处理模型错设、多重共线性和负迁移,给出非渐近 ℓ1/ℓ2 误差界、信息源检测一致性及联合置信区间;仿真和实证显示估计误差下降且对数据异质性较稳健。

VISAGNN: Versatile Staleness-Aware Efficient Training on Large-Scale Graphs Figure 1
arXiv preprint2025-11-16

VISAGNN: Versatile Staleness-Aware Efficient Training on Large-Scale Graphs

Rui Xue

North Carolina State University

6D位姿估计

该文针对大规模深层 GNN 训练中历史嵌入虽能缓解邻居爆炸、却因缓存更新滞后带来偏差和收敛变慢的问题,提出 VISAGNN,将“陈旧度”显式注入消息传递注意力、训练损失和历史嵌入表示,使模型降低过期邻居信息的权重并进行正则约束。实验显示其可叠加到既有历史嵌入方法上,在大规模基准上提升精度、效率和收敛速度;但与 6D 位姿估计的直接关系文中未充分说明。

Towards Rotation-only Imaging Geometry: Rotation Estimation Figure 1
arXiv preprint2025-11-16

Towards Rotation-only Imaging Geometry: Rotation Estimation

Xinrui Li, Qi Cai, Yuanxin Wu

6D位姿估计

本文针对 SfM 中 BA 对位姿与三维点初始化敏感、传统旋转平均依赖相对位姿且难以达到 BA 精度的问题,提出将位姿-only 几何进一步压缩到旋转流形:在特定关系下由旋转和观测表达平移,并把重投影误差直接写成旋转-only 优化,覆盖双视图和多视图。实验显示其旋转估计精度与鲁棒性优于现有方法,部分结果接近多轮 BA,同时给出场景结构导致平移退化的判别思路。

Changes in Real Time: Online Scene Change Detection with Multi-View Fusion Figure 1
arXiv preprint2025-11-15

Changes in Real Time: Online Scene Change Detection with Multi-View Fusion

Chamuditha Jayanga Galappaththige, Jason Lai, Lloyd Windrim Donald Dansereau, Niko Sünderhauf

Dimity Miller 1,2, QUT Centre for Robotics ARIAM ACFR, University of Sydney Abyss Solutions

6D位姿估计多视角

面向机器人复访场景中视角不受控、需边走边发现物体/场景变化的问题,本文将在线、无位姿先验、免标注和多视角一致性合并到同一SCD框架:用PnP快速对齐参考3DGS场景,以自监督融合损失整合像素与特征变化线索,并按变化掩码选择性更新3DGS。真实复杂场景实验显示其超过10 FPS,精度优于在线及离线基线。

One target to align them all: LiDAR, RGB and event cameras extrinsic calibration for Autonomous Driving Figure 1
arXiv preprint2025-11-15

One target to align them all: LiDAR, RGB and event cameras extrinsic calibration for Autonomous Driving

IT andrea.bertogalli@mail.polimi.it, IT giacomo.boracchi@polimi.it, IT luca.magri@polimi.it

6D位姿估计点云事件相机

面向自动驾驶中 LiDAR、RGB 与事件相机难以统一外参标定、尤其事件数据稀疏异步导致配准不稳的问题,论文设计可被三类传感器共同观测的 3D 标定靶,将平面、ChArUco 与闪烁 LED 特征合入一次采集,并配套 LiDAR/事件特征检测,实现直接联合估计多传感器相对位姿;自建车载传感器数据实验显示其精度与鲁棒性优于若干成对或两步标定方法。

AURA: Development and Validation of an Augmented Unplanned Removal Alert System using Synthetic ICU Videos Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-15

AURA: Development and Validation of an Augmented Unplanned Removal Alert System using Synthetic ICU Videos

Junhyuk Seo, Hyeyoon Moon, Kyu-Hwan Jung, Namkee Oh, Taerim Kim

Samsung Medical Center, Sungkyunkwan University

6D位姿估计仿真到现实

针对 ICU 非计划拔管难以用真实视频训练与标注的问题,AURA 用文本到视频扩散生成合成 ICU 场景,并基于姿态估计检测手部接近气管管路的“碰撞”和关键点速度表征的躁动。专家认为合成数据具备一定临床真实感;测试显示碰撞检测准确率较高,但躁动识别仅中等,现实部署效果仍需真实 ICU 数据验证。

AMR-MoEGA: Antimicrobial Resistance Prediction using Mixture of Experts and Genetic Algorithms Figure 1
arXiv preprint2025-11-15

AMR-MoEGA: Antimicrobial Resistance Prediction using Mixture of Experts and Genetic Algorithms

Anshul Bagaria

6D位姿估计

针对传统药敏实验耗时、静态SNP模型难以刻画耐药进化的问题,AMR-MoEGA将多抗生素耐药预测的MoE/XGBoost模型嵌入遗传算法,把预测耐药概率作为适应度,并用突变、交叉近似HGT来模拟代际演化。实验展示了可解释的耐药获得轨迹,敏感性分析显示对突变率和选择压力较稳健,并与AMR数据库和文献模式相符;但文中未充分说明相对基线的定量增益。

VPHO: Joint Visual-Physical Cue Learning and Aggregation for Hand-Object Pose Estimation Figure 1
arXiv preprint2025-11-15

VPHO: Joint Visual-Physical Cue Learning and Aggregation for Hand-Object Pose Estimation

Jun Zhou, Chi Xu, Kaifeng Tang, Yuting Ge, Tingrui Guo, Li Cheng

6D位姿估计物体位姿手部姿态

VPHO针对单目RGB手-物体位姿估计中“看起来对但物理不合理”或引入物理后牺牲视觉一致性的问题,将2D热图等视觉线索与3D力/接触等物理线索联合学习,并用扩散生成的多候选位姿做视觉层级聚合与物理约束筛选。实验显示其在手和物体位姿精度及接触、穿透等物理合理性指标上均优于现有方法。

Understanding the Representation of Older Adults in Motion Capture Locomotion Datasets Figure 1
arXiv preprint2025-11-12

Understanding the Representation of Older Adults in Motion Capture Locomotion Datasets

1 Yunkai Yu, 2 Yingying Wang, 3 Rong Zheng

6D位姿估计人体姿态数据集/基准

面向姿态估计、跌倒检测等依赖 MoCap 真值或合成数据的应用,论文关注老年人在公开步态数据中的代表性不足问题。作者系统梳理 41 个公开 MoCap locomotion 数据集,并提出用年龄敏感、抗噪且适合小样本的步态参数评估“old-style”动作保真度。结果显示仅 8 个数据集含真实老年人、全身数据更少且动作多限于走路和站立;4 个风格化数据集中的老年风格前行总量约 12 分钟,且常过度受控,难以真实反映衰老步态差异。

EcoSpa: Efficient Transformer Training with Coupled Sparsity Figure 1
arXiv preprint2025-11-09

EcoSpa: Efficient Transformer Training with Coupled Sparsity

Jinqi Xiao, Cheng Luo, Lingyi Huang, Cheng Yang, Yang Sui, Huy Phan, Xiao Zang, Yibiao Ying, Zhexiang Tang, Anima Anandkumar

Rutgers University, California Institute of Technology, Rice University

6D位姿估计

针对 Transformer 稀疏训练在高稀疏率下破坏注意力与 FFN 中成对权重矩阵乘性交互的问题,EcoSpa 将重要性评估和剪枝粒度从单矩阵改为耦合矩阵对,并通过对齐行/列移除保持结构关系。实验显示其在 LLaMA-1B 预训练中减少约50%显存、训练加速21%,在 GPT-2-Medium 上实现2.2×压缩且困惑度更低,并带来1.6×推理加速。

LARM: A Large Articulated-Object Reconstruction Model Figure 1
arXiv preprint2025-11-14

LARM: A Large Articulated-Object Reconstruction Model

Sylvia Yuan, Ruoxi Shi, Xinyue Wei, Xiaoshuai Zhang, Hao Su, Minghua Liu

University of California San Diego

6D位姿估计三维重建

针对关节物体重建依赖密集多视图、逐实例优化且难以同时获得几何、纹理和运动结构的问题,LARM将LVSM式前馈新视角合成扩展到关节场景,用Transformer联合建模相机位姿与关节状态,并输出深度、前景和部件掩码以支持显式网格与关节估计。实验显示其在新视角/新状态合成和三维关节物体重建上优于多类基线,生成结果更贴合输入图像;但泛化仍受关节物体数据规模限制。

YCB-Ev SD: Synthetic event-vision dataset for 6DoF object pose estimation Figure 1
arXiv preprint2025-11-14

YCB-Ev SD: Synthetic event-vision dataset for 6DoF object pose estimation

Pavel Rojtberg, Julius Kühn

6D位姿估计物体位姿事件相机仿真到现实数据集/基准

面向事件相机在6DoF物体位姿估计中缺少类似BOP的规模化合成资源这一问题,论文构建了YCB-Ev SD:基于YCB-Video PBR场景、SD分辨率和模拟线性相机运动生成5万段34ms事件序列,并提供原始事件与预计算表示。实验用YOLOX6D-s比较事件直方图与时间表面,发现双通道极性编码贡献最大,线性衰减时间表面优于指数衰减和单通道方案。

Dual Riemannian Newton Method on Statistical Manifolds Figure 1
arXiv preprint2025-11-14

Dual Riemannian Newton Method on Statistical Manifolds

Derun Zhou13, Keisuke Yano23, Mahito Sugiyama13

6D位姿估计

针对统计流形上参数估计中自然梯度仅一阶、传统二阶方法忽略信息几何双联络结构的问题,论文提出双黎曼牛顿法:用一个联络定义重traction时,在其对偶联络下建立牛顿方程。该框架可覆盖一般概率分布,并证明在对偶平坦坐标下退化为欧式牛顿步、局部二次收敛;实验在代表性统计模型上显示优于自然梯度和 Adam。

6D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data Figure 1
arXiv preprint2025-11-14

6D Strawberry Pose Estimation: Real-time and Edge AI Solutions Using Purely Synthetic Training Data

Saptarshi Neil Sinha, Julius Kühn, Mika Silvan Goschke, Michael Weinmann

Delft University of Technology

6D位姿估计仿真到现实

面向草莓选择性采摘中仅有2D/粗3D定位难以支持机械臂安全操作、真实6D标注稀缺的问题,本文用多形态草莓3D模型和BlenderProc程序化渲染生成纯合成训练数据,并采用YOLOX-6D-Pose做单阶段位姿估计与边缘部署评估。结果显示模型在RTX 3090与Jetson Orin Nano上ADD-S精度相近,3090速度更快,而Orin Nano具备农机端实时部署潜力;定性上对成熟和半成熟草莓较可靠,但未成熟果检测仍是短板。

3D Gaussian and Diffusion-Based Gaze Redirection Figure 1
arXiv preprint2025-11-14

3D Gaussian and Diffusion-Based Gaze Redirection

Abiram Panchalingam, Indu Bodala, Stuart Middleton

School of Electronics and Computer Science, University of Southampton

6D位姿估计高斯泼溅

论文针对现有3DGS凝视重定向在细微、连续视线变化上易失真、影响凝视估计数据增强的问题,提出DiT-Gaze:以Diffusion Transformer替代传统U-Net渲染器,并在3D高斯空间用中间视角弱监督构造平滑视线流形,同时用正交约束解耦视线、头姿和表情表征。实验报告其在感知质量和重定向精度上优于GazeGaussian,将凝视误差降至6.353°,相对降低4.1%。

Deep Learning-Enhanced Analysis for Delineating Anticoagulant Essay Efficacy Using Phase Microscopy Figure 1
arXiv preprint2025-11-14

Deep Learning-Enhanced Analysis for Delineating Anticoagulant Essay Efficacy Using Phase Microscopy

S. Shrivastava, Mahendra Rathor, D. Yenurkar, Sneha Chaubey, S. Mukherjee, Rohit Kumar Singh

Laboratory of Information Photonics, Department of Physics, Indian Institute of Technology, Banaras Hindu University, IIT, School of Biomedical Engineering, Indian Institute of Technology, Banaras Hindu University, IIT (BHU), Varanasi-221005

6D位姿估计

针对离体血样凝固会影响血液学检测、且传统计数或染色显微方法难以兼顾聚团识别和无标记形态分析的问题,本文将数字全息显微的相位重建与自动图像处理、Cellpose 分割结合,用于高通量量化红细胞数量、聚集和形态变化。实验比较 EDTA 与 KFeOx 纳米颗粒抗凝剂,结果显示 KFeOx-NPs 可抑制凝血并较好保持红细胞形态,而 EDTA 在约 6 小时内引发明显形态改变。

Learning bounds for doubly-robust covariate shift adaptation Figure 1
arXiv preprint2025-11-14

Learning bounds for doubly-robust covariate shift adaptation

Jeonghwan Lee, Cong Ma

6D位姿估计

针对训练源域与测试目标域存在协变量偏移、且目标标签稀缺时重要性加权对密度比估计误差敏感的问题,本文为双重稳健协变量偏移自适应建立首个有限样本学习界。核心洞察是过量目标风险可由两个 pilot 估计的 L2 误差乘积与模型类 Rademacher 复杂度控制;在正确设定的参数模型下,进一步用非渐近 MLE 分析得到 O(1/n) 快速收敛,并将难度刻画为源/目标 Fisher 信息失配。

WetExplorer: Automating Wetland Greenhouse-Gas Surveys with an Autonomous Mobile Robot Figure 1
arXiv preprint2025-11-14

WetExplorer: Automating Wetland Greenhouse-Gas Surveys with an Autonomous Mobile Robot

Jose Vasquez, Xuping Zhang

Aarhus University

6D位姿估计机器人操作综述

湿地温室气体通量依赖人工搬运设备、逐点放置采样腔,频率和空间覆盖受限。WetExplorer 将低接地压履带底盘、升降采样机构、双 RTK/IMU/编码器融合定位、Hybrid-A* 与 Pure-Pursuit 规划以及深度视觉环位姿估计整合到 ROS2 系统中,实现无人多点采样;实验报告定位均误差 1.71 cm,目标位姿约 7 mm/3°,采样腔全流程放置误差在 70 mm 内。

Depth Anything 3: Recovering the Visual Space from Any Views Figure 1
arXiv preprint2025-11-13

Depth Anything 3: Recovering the Visual Space from Any Views

Haotong Lin, Sili Chen, Jun Hao Liew, Donny Y. Chen, Zhenyu Li, Guang Shi, Jiashi Feng, Bingyi Kang

6D位姿估计彩色深度

面向机器人和混合现实中从单图、多视图或视频统一恢复3D几何的需求,DA3主张用更少任务工程替代专用SfM/MVS管线:以普通预训练Transformer为骨干,通过跨视角自注意力和单一深度-射线表示同时预测深度与位姿,并用教师-学生伪标注统一多源数据。在新视觉几何基准上,其相机位姿精度较VGGT平均提升35.7%、几何精度提升23.6%,单目深度也超过DA2;但部分增益可能来自scaling / data。

OmniVGGT: Omni-Modality Driven Visual Geometry Grounded Transformer Figure 1
arXiv preprint2025-11-14

OmniVGGT: Omni-Modality Driven Visual Geometry Grounded Transformer

Haosong Peng, Hao Li, Yalun Dai, Yushi Lan, Yihang Luo, Tianyu Qi, Zhengshen Zhang, Yufeng Zhan, Junfei Zhang, Wenchao Xu, Ziwei Liu HKUST, NTU, SYSU, NUS, Alibaba Group

HKUST NTU SYSU NUS Alibaba Group

6D位姿估计

OmniVGGT针对现有3D基础模型多依赖RGB、难利用深度与相机内外参等几何线索的问题,在VGGT上加入轻量GeoAdapter,用零初始化卷积稳定注入几何信息,并以随机多模态融合训练支持测试时任意数量辅助模态。实验显示其在深度估计、多视图立体和相机位姿估计上优于已有方法,RGB-only也达SOTA;接入VLA后在机器人操作基准中较点云基线取得稳定提升。

EDGC: Entropy-driven Dynamic Gradient Compression for Efficient LLM Training Figure 1
arXiv preprint2025-11-13

EDGC: Entropy-driven Dynamic Gradient Compression for Efficient LLM Training

Qingqing Yi, Jiaang Duan, H. M. Hu, Hua Qin, Haiyan Zhao, Shiyou Qian, Dingyu Yang, Jian Cao, Jinghua Tang, Yinghao Yu, Chenzhi Liao, Kangjin Wang, Liping Zhang

6D位姿估计

针对大模型分布式训练中梯度通信开销高、固定压缩率难以适应训练动态的问题,EDGC利用梯度熵随训练下降的观察,通过采样估计熵、建立熵与低秩压缩rank的关系,并用窗口机制按迭代和流水线阶段动态调节压缩率。在GPT2-2.5B/12.1B训练中,通信延迟最高降46.45%,总训练时间最高省16.13%,且精度基本保持。

RobIA: Robust Instance-aware Continual Test-time Adaptation for Deep Stereo Figure 1
arXiv preprint2025-11-13

RobIA: Robust Instance-aware Continual Test-time Adaptation for Deep Stereo

Jueun Ko, Hyewon Park : 1, Hyesong Choi, hyesong@ssu.ac.kr

Ewha Womans University Soongsil University

6D位姿估计多视角

面向机器人/自动驾驶中双目深度在天气、光照和场景持续变化下易退化的问题,RobIA把测试时适应从静态域扩展到连续域:用沿极线的轻量自注意力MoE做实例级参数高效适配,并以AdaptBN教师补全手工伪标签低置信区域。实验显示其在动态目标域上优于现有适应方法且计算开销较低,但具体数值增益文中片段未充分说明。

Bridging Constraints and Stochasticity: A Fully First-Order Method for Stochastic Bilevel Optimization with Linear Constraints Figure 1
arXiv preprint2025-11-15

Bridging Constraints and Stochasticity: A Fully First-Order Method for Stochastic Bilevel Optimization with Linear Constraints

Cac Phan, Kai Wang

Georgia Institute of Technology

6D位姿估计

针对随机双层优化在下层存在线性约束时缺少有限时间理论的问题,论文提出完全一阶的 F2CSA 方法,用平滑惩罚与近似原始-对偶解构造随机超梯度,避免 Hessian/二阶信息,并显式控制偏差与方差。理论证明其以约 O(δ^{-1}ε^{-5}) 随机梯度复杂度收敛到 Goldstein 驻点;实验称在高维下较 Hessian 方法更省时,但主要贡献偏优化理论而非 6D 位姿估计。

STORM: Segment, Track, and Object Re-Localization from a Single 3D Model Figure 1
arXiv preprint2025-11-12

STORM: Segment, Track, and Object Re-Localization from a Single 3D Model

Yu Deng, Teng Cao, Hikaru Shindo, Quentin Delfosse, Jiahong Xue, Kristian Kersting

6D位姿估计

STORM面向机器人场景中6D位姿跟踪对CAD、人工掩码和逐物体适配依赖强、遮挡或快速运动下易漂移且难自检的问题,提出参考条件化框架:用HSFA融合参考与查询特征,并以BCE训练的兼容性验证器将logit作为能量分数触发重定位。LM-O和YCB-Video实验显示其在无标注跟踪中优于强基线,并能从严重遮挡和大视角变化中恢复。

Regularity and error estimates in physics-informed neural networks for the Kuramoto-Sivashinsky equation Figure 1
arXiv preprint2025-11-12

Regularity and error estimates in physics-informed neural networks for the Kuramoto-Sivashinsky equation

Mohammad Mahabubur Rahman, Deepanshu Verma

School of Mathematical and Statistical Sciences, Clemson University

6D位姿估计

这篇工作并非6D位姿估计方法,而是针对高维Kuramoto–Sivashinsky方程中非线性、反扩散项与缺失无散度结构导致的正则性和PINN误差难题。作者把Besov空间中的全局正则性判据与PINN残差分析结合,给出该方程PINN近似的严格误差估计,并用数值实验对理论界进行验证。

PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Model Figure 1
arXiv preprint2025-11-12

PALMS+: Modular Image-Based Floor Plan Localization Leveraging Depth Foundation Model

Yunqian Cheng, Benjamin Princen, Santa Cruz Santa Cruz, United States @ucsc.edu

University of California, Santa Cruz

6D位姿估计彩色深度

针对无 GPS 室内定位中仅靠平面图匹配易受手机 LiDAR 距离短和布局歧义影响的问题,PALMS+用单目深度基础模型从带位姿 RGB 图像重建尺度对齐点云,再与楼层平面图做几何卷积匹配,输出位置与朝向后验并可接粒子滤波。无需训练,在 Structured3D、校园数据和33条真实轨迹上均优于 PALMS 与 F3Loc。

DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation Figure 1
arXiv preprint2025-11-12

DreamPose3D: Hallucinative Diffusion with Prompt Learning for 3D Human Pose Estimation

Jerrin Bright, Yuhao Chen, John S. Zelek, Vision, Image Processing Lab

Vision and Image Processing Lab, University of Waterloo

6D位姿估计人体姿态

针对单目3D人体姿态估计中逐帧预测易忽略长时序线索、且仅靠几何信息难以消解动作意图歧义的问题,DreamPose3D将任务改写为“意图驱动的运动想象”:从2D姿态序列自动生成动作提示并经CLIP编码来条件扩散去噪,同时在注意力中注入运动学关节亲和关系,并用hallucinative解码器预测连续3D姿态以约束时序一致性。论文报告其在Human3.6M与MPI-INF-3DHP上达到SOTA,并在噪声棒球转播数据上表现出较强鲁棒性。

Robust Cauchy-Based Methods for Predictive Regressions Figure 1
arXiv preprint2025-11-17

Robust Cauchy-Based Methods for Predictive Regressions

Rustam Ibragimov, Jihyun Kim

Imperial College Business School, New Economic School, School of Economics, Sungkyunkwan University, HSE University

6D位姿估计

本文针对预测回归中变量高持久性、内生性、厚尾以及误差波动持久化导致常规检验尺寸失真的问题,基于 Cauchy 估计提出两类更易实现的稳健检验:t 统计量分组推断与 Cauchy-OLS 混合方差估计。仿真显示其在多种有限样本设定下控制尺寸较好;实证上发现股息价格比对超额收益有预测力,而盈利价格比不显著。

Zero-Order Sharpness-Aware Minimization Figure 1
arXiv preprint2025-11-12

Zero-Order Sharpness-Aware Minimization

Yao Fu

Xi’an Jiaotong University, SGIT AI Lab, State Grid Corporation of China

6D位姿估计

尽管仓库归入6D Pose,本文实际关注资源受限下大模型提示微调的零阶优化:为缓解传统ZO梯度估计方差高、收敛慢且泛化不足,提出ZOSA,将批量Rademacher单边估计、基于损失方差的自适应步长与SAM式平坦极小值搜索结合。理论给出收敛与泛化分析,实验在合成任务和GLUE少样本微调中较ZO-AdaMM、SABO等取得更快收敛和更高准确率/F1。

PressTrack-HMR: Pressure-Based Top-Down Multi-Person Global Human Mesh Recovery Figure 1
arXiv preprint2025-11-13

PressTrack-HMR: Pressure-Based Top-Down Multi-Person Global Human Mesh Recovery

Jiayue Yuan, Fangting Xie, Guangwen Ouyang, Changhai Ma, Ziyu Wu, Heyu Ding, Quan Wan, Yi Ke, Yuchen Wu, Xiaohui Cai

6D位姿估计

针对视觉多人 HMR 易受遮挡、光照与隐私限制,而压力垫方法多停留在单人场景的问题,PressTrack-HMR 将多人压力信号先检测分割再按帧关联,引入面向足底压力框的 PressTrack 与 UoE 相似度,并为每人恢复全局人体网格。论文还构建 MIP 多人交互压力数据集,实验取得 93.6% MOTA、89.2 mm MPJPE 和 112.6 mm WA-MPJPE100。

Optimal convergence rates of an adaptive finite element method for unbounded domains Figure 1
arXiv preprint2025-11-12

Optimal convergence rates of an adaptive finite element method for unbounded domains

Théophile Chaumont-Frelet, Gregor Gantner

Inria Univ. Lille and Laboratoire Paul Painlevé, Villeneuve-d’Ascq, France, Institute for Numerical Simulation, University of Bonn, Friedrich-Hirzebruch-Allee 7, Bonn, Germany

6D位姿估计

这篇论文并非6D位姿估计工作,而是针对无界域上线性反应-扩散方程的自适应有限元求解。其动机是截断无界计算域会同时引入离散误差与人工边界误差;核心做法是构造包含截断边界影响的残差型后验误差估计器,并用其驱动网格细化和边界外推。文中证明该算法可靠、高效、R线性收敛,并在自由度意义下达到最优收敛率,数值例子与理论一致。

LODESTAR: Degeneracy-Aware LiDAR-Inertial Odometry with Adaptive Schmidt-Kalman Filter and Data Exploitation Figure 1
arXiv preprint2025-11-12

LODESTAR: Degeneracy-Aware LiDAR-Inertial Odometry with Adaptive Schmidt-Kalman Filter and Data Exploitation

Eungchang Mason Lee, Member, IEEE, Kevin Christiansen Marsim, Graduate Student Member, Hyun Myung, Senior Member

Manuscript received: July, 14, 2025; Revised October, 11, 2025; Accepted November

6D位姿估计相机位姿点云

针对长走廊、高空飞行等场景中 LiDAR 点云稀疏或方向分布失衡导致 LIO 退化、漂移的问题,LODESTAR 将滑窗状态按退化程度划分为 active/fixed,并用 Schmidt-Kalman 更新让固定状态通过协方差充当锚点;同时依据可定位性贡献和雅可比条件数筛选/利用量测。实验显示其在多类退化数据上较现有 LiDAR 里程计和退化感知模块具备更好或相当的精度与鲁棒性,但无 LiDAR 回波时仍会失效。

SMF-VO: Direct Ego-Motion Estimation via Sparse Motion Fields Figure 1
arXiv preprint2025-11-12

SMF-VO: Direct Ego-Motion Estimation via Sparse Motion Fields

Sangheon Yang, Yeongin Yoon, Hong Mo Jung, Jongwoo Lim

Department of Artificial Intelligence, Hanyang University, Seoul, Korea, Department of Mechanical Engineering, Seoul National University, Seoul, Korea, the Robot Vision Lab, Seoul National University

6D位姿估计

针对传统 VO/VIO 依赖局部地图、PnP/P3P 位姿求解和持续优化导致嵌入式实时性差的问题,SMF-VO 将自运动估计改为“运动中心”:从稀疏光流的运动场方程直接求瞬时线速度和角速度,并用 3D 射线表示适配鱼眼等相机模型。在 EuRoC、KITTI、TUM-VI 上精度接近主流 VO/VIO,树莓派 5 纯 CPU 可超过 100 FPS。

RadHARSimulator V2: Video to Doppler Generator Figure 1
arXiv preprint2025-11-12

RadHARSimulator V2: Video to Doppler Generator

Weicheng Gao ID

6D位姿估计

针对雷达HAR仿真依赖人体模型或动捕、场景灵活性不足的问题,RadHARSimulator V2提出从普通视频生成雷达回波、RTM与DTM:视觉端完成目标跟踪、2D/3D姿态估计与时序平滑,雷达端结合延迟/镜像建模、STFT和DnCNN,并配套混合并串联识别网络。数值实验显示模拟器和模型有效,但文中摘要未给出明确量化指标,增益来源不清。

Robust Backdoor Removal by Reconstructing Trigger-Activated Changes in Latent Representation Figure 1
arXiv preprint2025-11-12

Robust Backdoor Removal by Reconstructing Trigger-Activated Changes in Latent Representation

Kazuki Iwahana, Yusuke Yamasaki, Akira Ito, Takayuki Miura

NTT Social Informatics Laboratories

6D位姿估计

针对后门防御中无法获得中毒样本、TAC 估计不准导致误删或漏删后门神经元的问题,本文将潜表示中诱导干净样本转向某类的最小扰动建模为凸二次优化,并用异常小的扰动范数识别投毒类,再以该扰动进行微调消除后门。在 CIFAR-10、GTSRB、TinyImageNet 多攻击和架构上,方法在保持干净精度的同时取得更强后门抑制;但其与 6D 位姿估计关联文中未充分说明。

SasMamba: A Lightweight Structure-Aware Stride State Space Model for 3D Human Pose Estimation Figure 1
arXiv preprint2025-11-12

SasMamba: A Lightweight Structure-Aware Stride State Space Model for 3D Human Pose Estimation

Hu Cui, Wenqiang Hua, Renjing Huang, Shurui Jia, Tessai Hayama, Information, Management Systems Engineering, School of Computer Science, Technology, Telecommunications @stn.nagaokaut.ac.jp, huawenqiang@xupt.edu.cn rjhuang27@gmail.com, t-hayama@kjs.nagaokaut.ac.jp

Information and Management Systems Engineering, Nagaoka University of Technology

6D位姿估计人体姿态

针对现有 Mamba/SSM 3D 人体姿态方法将骨架序列展平成一维扫描、破坏关节空间拓扑并混淆时空特征的问题,SasMamba 提出 SAS-SSM:先用结构感知时空卷积建模局部关节交互,再以步幅扫描形成多尺度全局结构表示,在保持线性复杂度的同时兼顾局部与长程依赖。实验在 Human3.6M 和 MPI-INF-3DHP 上取得有竞争力或 SOTA 的精度,并以更少参数优于多种混合模型。

Adaptive graph Kolmogorov-Arnold network for 3D human pose estimation Figure 1
arXiv preprint2025-11-11

Adaptive graph Kolmogorov-Arnold network for 3D human pose estimation

Abu Taib Mohammed Shahjahan, Montreal, Canada abutaibmohammed.shahjahan@mail.concordia.ca

Concordia University, Montreal, Canada

6D位姿估计人体姿态

针对GCN人体骨架建模受限于一跳邻域、难以捕捉遮挡和深度歧义下的远程关节依赖,并存在偏低频的谱偏置,本文提出PoseKAN,将KAN的可学习边函数引入2D到3D姿态提升。方法结合多跳特征传播、残差PoseKAN块和全局响应归一化,在局部/全局信息间自适应平衡。实验在两个基准上相对现有方法取得有竞争力或更优结果,但具体增益来源可能主要来自multi-hop scaling与归一化的组合。

Information-Driven Fault Detection and Identification for Multi-Agent Spacecraft Systems: Collaborative On-Orbit Inspection Mission Figure 1
arXiv preprint2025-11-11

Information-Driven Fault Detection and Identification for Multi-Agent Spacecraft Systems: Collaborative On-Orbit Inspection Mission

Gupta, Akshita, Bhardwaj, Arna, Nakka, Yashwanth Kumar, Choi, Changrak, Rahmani, Amir

Purdue University, West Lafayette, IN, 47907, USA, Georgia Institute of Technology, Atlanta, GA, 30332, USA, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, 91104, USA

6D位姿估计航天器

面向多航天器在轨协同检查中任务耦合强、故障会直接影响信息获取的问题,论文提出以全局信息增益代价 H 贯通任务分配、轨道重构与本地感知控制的任务感知 FDI 框架,并用 H 的偏离及高阶梯度区分检查传感器退化、执行器和状态传感器故障,配合自适应阈值处理时变观测几何。仿真显示该方法能在保持检查目标推进的同时检测并分类多类故障。

CO2-Meter: A Comprehensive Carbon Footprint Estimator for LLMs on Edge Devices Figure 1
arXiv preprint2025-11-11

CO2-Meter: A Comprehensive Carbon Footprint Estimator for LLMs on Edge Devices

Zhenxiao Fu, Chen Fan, Lei Jiang

6D位姿估计

面向大模型从云端转向边缘设备带来的运行与制造碳排放问题,CO2-Meter将外设采集/通信/输出能耗、LLM prefill/decode 分阶段推理能耗和 SoC 单元级隐含碳统一建模,并用方程模型与 GNN 预测器估计碳足迹。实验显示其外设模型误差较低,LLM 能耗预测在已见和未见配置上相对 NNLQP/RF 更准,且可定位碳热点以指导边缘平台设计。

RePose-NeRF: Robust Radiance Fields for Mesh Reconstruction under Noisy Camera Poses Figure 1
arXiv preprint2025-11-11

RePose-NeRF: Robust Radiance Fields for Mesh Reconstruction under Noisy Camera Poses

Sriram Srinivasan Bellatrix Aerospace sriram@bellatrix.aero, Gautam Ramachandra Bellatrix Aerospace gautam@bellatrix.aero

6D位姿估计相机位姿三维重建

针对真实多视角重建中相机外参噪声会破坏 NeRF 几何一致性、且隐式场难以直接用于机器人仿真和操作的问题,RePose-NeRF 在 Instant-NGP 框架上联合优化辐射场与相机位姿,并通过可微束调整后提取带纹理多边形网格。实验称其在标准基准和位姿不确定下获得更稳定、准确的网格重建,但结论中也指出噪声超过约 15°或视角极稀疏时性能下降。

RAPTR: Radar-based 3D Pose Estimation using Transformer Figure 1
arXiv preprint2025-11-11

RAPTR: Radar-based 3D Pose Estimation using Transformer

Sorachi Kato, Ryoma Yataka, Pu (Perry) Wang, Pedro Miraldo, Takuya Fujihashi, Mitsubishi Electric Corporation, Japan

Mitsubishi Electric Research Laboratories (MERL), USA, The University of Osaka, Japan, Information Technology R&D Center (ITC), Mitsubishi Electric Corporation, Japan

6D位姿估计

室内雷达人体3D姿态估计常依赖昂贵的3D关键点标注,限制了遮挡、杂乱和多人场景的数据扩展。RAPTR改用更易获取的3D框与2D关键点弱监督,设计两阶段Transformer解码器、3D模板/重力损失以及伪3D可变形注意力,在3D空间关联多视角雷达特征并缓解深度歧义。在HIBER和MMVR上相对现有雷达方法分别降低34.3%和76.9%的关节/近似位姿误差。

SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering Figure 1
arXiv preprint2025-11-11

SkelSplat: Robust Multi-view 3D Human Pose Estimation with Differentiable Gaussian Rendering

Laura Bragagnolo

University of Padova, University of Amsterdam

6D位姿估计人体姿态多视角高斯泼溅

针对多视角3D人体姿态方法依赖大规模3D标注、对相机布局和遮挡场景泛化差的问题,SkelSplat将每个关节建模为可微渲染的3D高斯,并用one-hot关节通道改造Gaussian Splatting以独立优化骨架位置,从而在无需3D真值和场景微调的情况下融合任意视角;在Human3.6M、CMU及遮挡基准上优于无3D监督方法,跨数据集误差较学习式融合最多降低47.8%。

Effective Capacity Analysis of Joint Near and Far-Field Communication in 6G URLLC Networks Figure 1
arXiv preprint2025-11-11

Effective Capacity Analysis of Joint Near and Far-Field Communication in 6G URLLC Networks

Humera Hameed, Waqas Aman, Muhammad Mahboob Ur Rahman, Ali A. Nasir

6D位姿估计

面向6G URLLC中超大孔径阵列导致近场/远场共存、且距离估计误差会影响时延保障的问题,本文把用户距离作为跨传播区随机变量,提出基于距离的场区判别,并在考虑误分类与速率中断的马尔可夫状态模型下推导有效容量闭式表达。仿真显示估计方差、QoS指数及Fraunhofer边界会显著改变可支持到达率;但该工作本质是通信理论分析,与6D位姿估计关联不明显。

WEDepth: Efficient Adaptation of World Knowledge for Monocular Depth Estimation Figure 1
arXiv preprint2025-11-11

WEDepth: Efficient Adaptation of World Knowledge for Monocular Depth Estimation

Gongshu Wang, Zhirui Wang, Kan Yang

Aerospace Information Research Institute, Chinese Academy of Sciences

6D位姿估计彩色深度

针对单目深度估计中尺度歧义强、全量微调视觉基础模型易过拟合并破坏先验的问题,WEDepth将冻结的VFM作为多层特征增强器,通过Partition-Enhance-Inject模块让深度预测分支的多尺度模式与VFM token交互,再注入像素特征。其在NYU-Depth v2和KITTI上达到或接近SOTA,且单次前向即可推理,并展示较强零样本迁移能力。

In-Orbit GRB Identification Using LLM-based model for the CXPD CubeSat Figure 1
Research in Astronomy and Astrophysics2025-11-12

In-Orbit GRB Identification Using LLM-based model for the CXPD CubeSat

Cunshi Wang, Zuke Feng, Difan Yi, Yuyang Li, Lirong Xie, Huanbo Feng, Yi Liu, Qian Liu, Yang Huang, Hongbang Liu, Xinyu Qi, Yangheng Zheng, Ali Luo, Guirong Xue, Jifeng Liu

National Space Science Center, University of Chinese Academy of Sciences, Guangxi University, Beijing Chaoyang Emergency Medical Center

6D位姿估计

面向CXPD立方星宽视场软X射线偏振观测中背景复杂、下传受限导致的在轨GRB实时识别难题,论文用Geant4构建2–10 keV背景与GRB谱模拟数据,并将miniCPM-V2.6经LoRA微调、4bit量化后部署为轻量MLLM分类/回归器。验证集分类达到100%,谱指数估计RMSE为0.118,并通过模拟卫星处理链展示在轨可行性,但结果主要基于仿真数据,真实在轨泛化仍需验证。

Stabilization of Time-Varying Perturbed Quantum Systems via Reduced Filters Figure 1
arXiv preprint2025-11-11

Stabilization of Time-Varying Perturbed Quantum Systems via Reduced Filters

Weichao Liang, Daoyi Dong

6D位姿估计

面向连续测量量子反馈在大规模系统中计算量高、且受未知初态和时变扰动影响的问题,论文构造只跟踪 QND 基下密度矩阵对角元的降阶滤波器,将估计量从 O(N²) 降至 O(N)。作者证明该滤波反馈在时变哈密顿扰动、耗散和测量效率变化下仍能全局指数稳定到目标子空间,并以三能级系统数值验证;与仓库的 6D 位姿主题关联不明显。

An Image-Based Path Planning Algorithm Using a UAV Equipped with Stereo Vision Figure 1
IECON 2022 – 48th Annual Conference of the IEEE Industrial Electronics Society2025-11-11

An Image-Based Path Planning Algorithm Using a UAV Equipped with Stereo Vision

Selim Ahmet Iz, Mustafa Ünel

Faculty of Engineering and Natural Sciences, Sabanci University, Istanbul, Turkey

6D位姿估计多视角航天器

针对单幅俯视图难以区分丘陵、坑洞等地形深度而导致UGV全局路径不安全的问题,本文利用搭载双目视觉的UAV生成视差/深度图,并结合边缘、直线、角点检测及ArUco与圆检测自动确定起终点和候选路标。V-REP与实验室场景中,该方法相较A*显著更快,路径质量接近或优于PRM,且能同时考虑图像特征与正负障碍深度。

RoboTAG: End-to-end Robot Configuration Estimation via Topological Alignment Graph Figure 1
arXiv preprint2025-11-11

RoboTAG: End-to-end Robot Configuration Estimation via Topological Alignment Graph

Yifan Liu, Fangneng Zhan, Wanhua Li, Haowen Sun Katerina Fragkiadaki, pfister@seas.harvard.edu

Tsinghua University, Harvard University, Massachusetts Institute of Technology, Nanyang Technological University, Carnegie Mellon University

6D位姿估计机器人操作

针对单目 RGB 机器人构型/相机位姿估计对标注依赖强、2D 表征忽略三维先验导致 sim-to-real 困难的问题,RoboTAG 将 2D 与 3D 分支组织为拓扑对齐图,用状态节点、前向边和跨分支对齐边构成闭环,并以 2D-3D 一致性监督训练,从未标注野外图像中获得额外约束。实验显示其在多种机器人和仿真/真实场景中达到更优表现,消融表明 3D 先验与 TAG 闭环均带来增益。

LeCoT: revisiting network architecture for two-view correspondence pruning Figure 1
Science China Information Sciences2025-11-10

LeCoT: revisiting network architecture for two-view correspondence pruning

Luanyuan Dai, Xiaoyu Du, Jinhui Tang

Nanjing University of Science and Technology

6D位姿估计

针对双视图匹配中初始对应含大量外点、MLP难建模上下文而CNN又依赖局部感受野和数据压缩的问题,LeCoT将无位置编码的完整Transformer作为剪枝骨干,并提出空间-通道融合Transformer块与逐阶段预测块,在稀疏对应间直接聚合全局上下文并迭代优化内点概率。实验显示其在对应剪枝、相对位姿、单应估计、视觉定位和三维重建上均超过现有方法。

Aerial Image Stitching Using IMU Data from a UAV Figure 1
arXiv preprint2025-11-10

Aerial Image Stitching Using IMU Data from a UAV

Selim Ahmet Iz, Mustafa Ünel

6D位姿估计航天器

针对无人机航拍拼接中纯特征匹配易受弱纹理、误匹配、大位移和姿态变化影响的问题,论文将机载 IMU 的平移与旋转估计引入拼接流程,并结合俯仰角、飞行高度导致的透视畸变校正与单应矩阵计算,再交由常规拼接算法融合。实验在四旋翼航拍数据上表明,该方法相较部分特征式基线能减少接缝和畸变,在大位移、旋转及相机姿态变化场景下更稳定。

Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenes Figure 1
IROS 20252025-11-10

Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenes

Meijun Guo, Yongliang Shi, Caiyun Liu, Yixiao Feng, Ming Ma, Tinghai Yan, Weining Lu, Bin Liang

School of Mechatronical Engineering, Beijing Institute of Technology, Beiing National Research Center for Information Science and Technology, Qiyuan Lab, Peking University

6D位姿估计三维重建高斯泼溅

面向弱纹理、重复纹理户外场景中 COLMAP 位姿不稳与 3DGS 几何失真的问题,论文将 LiDAR-IMU 里程计先验引入 COLMAP 三角化和 BA,并用法向约束与有效秩正则约束高斯方向和形状。在公开与自采数据上,位姿优化耗时约为原来的三分之一且保持精度,重建质量较常规 3DGS 更好,弱纹理场景收益更明显。

Semi-distributed Cross-modal Air-Ground Relative Localization Figure 1
arXiv preprint2025-11-10

Semi-distributed Cross-modal Air-Ground Relative Localization

Weining Lu, Deer Bin, Lian Ma, Ming Ma, Zhihao Ma, Xiangyang Chen, Longfei Wang, Yixiao Feng, Zhouxian Jiang, Yongliang Shi, Bin Liang

Beijng National Research Center for Information Science and Technology, Qiyuan Lab, JiangHuai Advanced Technology Center

6D位姿估计

针对空地协同中传统多机器人 SLAM 依赖同构传感器、与各自状态估计强耦合且通信量大的问题,论文提出半分布式跨模态相对定位:UAV/UGV 独立 SLAM,仅交换稀疏关键点与描述子,UGV 结合 LiDAR-相机-IMU 做两阶段局部 BA,并用增量全局描述子库检索历史共视。实验显示精度和效率优于对比方法,通信带宽可压到 0.3 Mbps 以下。

Spectrum and Physics-Informed Neural Networks (SaPINNs) for Input-State-Parameter Estimation in Dynamic Systems Subjected to Natural Hazards-Induced Excitation Figure 1
arXiv preprint2025-11-10

Spectrum and Physics-Informed Neural Networks (SaPINNs) for Input-State-Parameter Estimation in Dynamic Systems Subjected to Natural Hazards-Induced Excitation

Antonina Kosikova, Apostolos Psaros, Andrew Smyth

Department of Civil Engineering and Engineering Mechanics, Columbia University, New York, NY 10027, USA

6D位姿估计

针对地震、强风等自然灾害下外部激励未知导致结构系统输入、状态与参数联合识别病态的问题,论文提出 SaPINNs,在 PINN 动力学约束中加入经验灾害谱作为未知激励先验,并用 Deep Ensemble 表征不确定性。在线性、非线性系统及 El Centro 地震等实验中,相比常规 PINNs 能更稳定恢复物理一致的输入、状态和参数,且不确定性更合理。

Thermal conductivity of commodity polymers under high pressures Figure 1
arXiv preprint2025-11-09

Thermal conductivity of commodity polymers under high pressures

Otavio Higino Moura de Alencar, James Wu, Marcus Müller, Debashish Mukherji

Quantum Matter Institute, University of British Columbia, Vancouver BC V6T 1Z4, Canada, Department of Physics, University of California, Berkeley, California 94720, United States

6D位姿估计

面向航空、深海和润滑等高压场景中聚合物散热受限的问题,本文用全原子分子动力学结合量子修正与简化扩散模型,分离PMMA中键合/非键合单体能量传递贡献。结果显示压力从常压升至10 GPa时热导率约增至4倍,非键合传热速率增幅约6倍,是高压下热输运增强的主导因素,并与实验数据基本一致。

Video Dataset for Surgical Phase, Keypoint, and Instrument Recognition in Laparoscopic Surgery (PhaKIR) Figure 1
arXiv preprint2025-11-09

Video Dataset for Surgical Phase, Keypoint, and Instrument Recognition in Laparoscopic Surgery (PhaKIR)

Tobias Rueckert, Raphaela Maerkl, David Rauber, Leonard Klausmann, Max Gutbrod, Daniel Rueckert, Hubertus Feussner, Dirk Wilhelm, Christoph Palm

Regensburg Center of Biomedical Engineering (RCBE), OTH Regensburg and Regensburg University, Regensburg, Germany, Regensburg Center of Health Sciences and Technology (RCHST), OTH Regensburg, Regensburg, Germany, Biomedical Image Analysis Group, Department of Computing, Imperial College London, London, UK, Research Group MITI, TUM University Hospital, School of Medicine and Health, Technical University of Munich, Munich, Germany

6D位姿估计数据集/基准医学/手术

面向手术机器人视觉中器械定位与流程理解缺少多中心、完整时序和多任务标注数据的问题,PhaKIR汇集3家医院8段完整腹腔镜胆囊切除视频,统一提供阶段标签、器械关键点和像素级实例分割。其主要贡献是把流程上下文与器械姿态/实例信息放在同一真实手术序列中,形成485,875帧阶段标注和各19,435帧关键点、分割标注,并已用于MICCAI 2024 EndoVis挑战验证数据可用性。

Bridging Theory and Practice: A Stochastic Learning-Optimization Model for Resilient Automotive Supply Chains Figure 1
arXiv preprint2025-11-09

Bridging Theory and Practice: A Stochastic Learning-Optimization Model for Resilient Automotive Supply Chains

United Kingdom muhammadshahnawaz039@gmail.com, Pakistan adeel.22313033@math.qau.edu.pk

Glasgow Caledonian University, Department of Mathematics, Quaid-i-Azam University

6D位姿估计

针对JIT汽车供应链在需求波动和供给中断下缺乏定量韧性验证的问题,论文将贝叶斯参数更新与随机库存优化闭环结合,对比静态(s,S)策略。365期仿真显示,稳定场景成本降7.4%、供应中断下降5.7%,但突发需求冲击下因贝叶斯更新保守反而成本显著上升,适用边界较明确。

EchoMark: Perceptual Acoustic Environment Transfer with Watermark-Embedded Room Impulse Response Figure 1
arXiv preprint2025-11-09

EchoMark: Perceptual Acoustic Environment Transfer with Watermark-Embedded Room Impulse Response

Chenpei Huang1, Lingfeng Yao1, Lening Wang2, Lan Zhang3, Xun Chen4, Kyu In Lee1, Miao Pan1

6D位姿估计

针对声学环境迁移可让伪造语音“搬入”目标房间而带来的溯源与安全问题,EchoMark将水印直接嵌入房间脉冲响应而非语音内容,采用编码器-水印器-生成器-检测器一体化架构,并利用符合听觉感知的RIR衰减先验提高隐蔽容量。实验显示其AEM音质接近无水印RIR重建基线,12-bit水印检测和解码均超过99%,且对噪声和移除攻击保持鲁棒。

VDNeRF: Vision-only Dynamic Neural Radiance Field for Urban Scenes Figure 1
arXiv preprint2025-11-09

VDNeRF: Vision-only Dynamic Neural Radiance Field for Urban Scenes

Zhengyu Zou, Jingfeng Li, Hao Li, Xiaolei Hou, Jinwen Hu, Jingkun Chen, Lechao Cheng, Dingwen Zhang

6D位姿估计三维重建

VDNeRF面向自动驾驶/机器人中仅有图像、相机位姿难获得且场景含动态物体的问题,将静态NeRF用于联合优化相机轨迹与背景,动态NeRF结合时间编码和3D场景流建模前景,并通过渐进式子场景训练缓解相机运动与物体运动歧义。实验显示其在主流城市场景数据集上的位姿估计和动态新视角合成均优于现有无位姿NeRF方法。

Whole-Body Control With Terrain Estimation of A 6-DoF Wheeled Bipedal Robot Figure 1
arXiv preprint2025-11-09

Whole-Body Control With Terrain Estimation of A 6-DoF Wheeled Bipedal Robot

Cong Wen, Yunfei Li, Kexin Liu, Yixin Qiu, Xuanhong Liao, Tianyu Wang, Dingchuan Liu, Tao Zhang, Ximin Lyu

Sun Yat-sen University, Dongguan University of Technology, China General Nuclear Power Corporation (China)

6D位姿估计人体姿态机器人操作

针对轮式双足机器人常用简化倒立摆模型难以发挥腿部动力学、在坡面和不平地形上适应性不足的问题,论文为6-DoF DIABLO建立闭环全身动力学与基于地面法向的接触模型,并用LiDAR惯性里程计结合改进PCA在线估计地形,将PD、LQR与层级优化整合进全身控制。仿真和实机实验表明,该方法能提升地形估计稳定性、抗扰能力和不平地形通过能力。

Quasi-Monte Carlo time-splitting methods for Schrödinger equation with Gaussian random potential Figure 1
arXiv preprint2025-11-09

Quasi-Monte Carlo time-splitting methods for Schrödinger equation with Gaussian random potential

Zhizhang Wu, Zhiwen Zhang, Xiaofei Zhao

Z. Wu: Department of Mathematics, The University of Hong Kong, Pokfulam Road, Hong Kong SAR, China, X. Zhao: School of Mathematics and Statistics & Computational Sciences Hubei Key Laboratory, Wuhan University, Wuhan, 430072, China

6D位姿估计高斯泼溅

针对高斯随机势薛定谔方程中物理观测量期望计算,标准 Monte Carlo 收敛慢且高斯变量无界使采样与误差分析困难。论文将时间分裂离散与随机平移格点 QMC 结合,通过半离散解的随机空间正则性分析和非标准加权 Sobolev 空间设计权函数,得到 QMC-TS 格式。主要结果证明其采样误差可达到与维度无关、接近一阶的收敛率,并给出时间分裂与截断误差估计,数值实验验证误差界较尖锐。

We Can Hear You with mmWave Radar! An End-to-End Eavesdropping System Figure 1
arXiv preprint2025-11-09

We Can Hear You with mmWave Radar! An End-to-End Eavesdropping System

Dachao Han, Teng Huang, Han Ding, Cui Zhao, Fei Wang, Ge Wang, Wei Xi

Xi’an Jiaotong University

6D位姿估计

针对扬声器外放带来的语音隐私泄露风险,论文提出 mmSpeech,用商用毫米波雷达感知物体受声激励产生的微振动,在无视距、隔墙且不预知说话人条件下重建语音。核心在于分析振动物材料与雷达采样率的匹配,并用生成器—判别器网络及合成训练提升泛化。实验含 47 名说话人、2400 段语音,FWSegSNR 9.43 dB、STOI 0.80,优于既有方法。

Event-driven physics-informed operator learning for reliability analysis Figure 1
arXiv preprint2025-11-08

Event-driven physics-informed operator learning for reliability analysis

New Delhi 110016, India. souvik@am.iitd.ac.in

Department of Applied Mechanics, Indian Institute of Technology Delhi, Yardi School of Artificial Intelligence (ScAI)

6D位姿估计事件相机

面向高维不确定性、非线性与多物理场系统的可靠性分析,传统蒙特卡洛和神经算子代理计算/能耗过高。论文提出 NeuroPOL,将变量脉冲神经元嵌入物理信息小波神经算子,用事件驱动稀疏通信替代连续激活,并以 PDE 约束训练。五个 PDE 基准上,其失效概率和 FPFT 接近蒙特卡洛与常规物理信息算子,部分状态预测 NMSE 低至 0.0065%,层级脉冲率可低至约 5%,显示边缘部署潜力。

3D Mapping Using a Lightweight and Low-Power Monocular Camera Embedded inside a Gripper of Limbed Climbing Robots Figure 1
arXiv preprint2025-11-08

3D Mapping Using a Lightweight and Low-Power Monocular Camera Embedded inside a Gripper of Limbed Climbing Robots

Taku Okawara, Ryo Nishibe, Mao Kasano, Kentaro Uno, Kazuya Yoshida

6D位姿估计机器人操作

面向月球/火星天窗等垂直地形攀爬,传统夹爪手眼 RGB-D 相机功耗和体积偏大,单目又有尺度不确定。论文将轻量单目相机嵌入夹爪,并用因子图融合单目视觉约束与肢体正运动学,联合估计夹爪时序位姿和全局尺度。仿真与实机结果表明,该系统可实时生成具度量尺度的3D地形图,并支持对凸起可抓取点的自主抓取。

An Open-Source, Reproducible Tensegrity Robot that can Navigate Among Obstacles Figure 1
IEEE Robotics and Automation Letters2025-11-08

An Open-Source, Reproducible Tensegrity Robot that can Navigate Among Obstacles

William R. Johnson, Patrick Meng, Nelson Chen, Luca Cimatti, Augustin Vercoutere, Mridul Aanjaneya, Rebecca Kramer-Bottiglio, Kostas E. Bekris

Yale University, Rutgers, The State University of New Jersey

6D位姿估计机器人操作

针对张拉整体机器人因柔顺结构和强耦合动力学难以建模、规划与避障的问题,本文给出一套可复现开源3杆平台:低成本硬件结合物理建模、系统辨识、位姿估计、A*规划与每步重规划控制。实验显示其能在已知障碍中到达目标,并在跌落、斜坡、颗粒介质及户外场景下保持导航能力,且两地复现实验证明平台具备迁移性。

Pedicle Screw Pairing and Registration for Screw Pose Estimation from Dual C-arm Images Using CAD Models Figure 1
arXiv preprint2025-11-07

Pedicle Screw Pairing and Registration for Screw Pose Estimation from Dual C-arm Images Using CAD Models

Yehyun Suh, Lin Li, Aric Plumley, Chaochao Zhou, Daniel Moyer, Kongbin Kang

AIX Research, Alphatec Spine, Carlsbad, CA, USA, Department of Computer Science, Vanderbilt University, Nashville, TN, USA

6D位姿估计

针对脊柱手术中双 C 臂 AP/LAT 影像下椎弓根螺钉对应关系难判、进而影响 6D 位姿估计的问题,论文将人工标注关键点得到的双视几何初始化与螺钉 CAD 模型的 2D-3D 投影配准结合,用几何一致性同时筛选正确配对并优化位姿。实验显示正确螺钉组合在配准前后均优于错误组合,配准后投影误差降低、Dice 分数提升,但数据规模与自动化程度仍有限。

Multi-modal Loop Closure Detection with Foundation Models in Severely Unstructured Environments Figure 1
arXiv preprint2025-11-07

Multi-modal Loop Closure Detection with Foundation Models in Severely Unstructured Environments

Laura Alejandra Encinar Gonzalez, John Folkesson, Rudolph Triebel, Riccardo Giubilato

6D位姿估计

面向行星探测等无 GNSS、低纹理且结构稀疏场景,论文针对单视觉易混淆、单 LiDAR 易稀疏歧义的问题,提出 MPRF:用 DINOv2+SALAD 做两阶段视觉候选检索,再结合 SONATA LiDAR 描述子,通过 PnP/RANSAC 与 ICP 输出可接入 SLAM 后端的相对 6DoF 位姿。S3LI 与 Vulcano 实验显示其检索精度优于现有方法,并在低纹理区域提升位姿估计鲁棒性。

4D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videos Figure 1
arXiv preprint2025-11-07

4D3R: Motion-Aware Neural Reconstruction and Rendering of Dynamic Scenes from Monocular Videos

Mengqi Guo, Bo Xu, Yanyan Li

National University of Singapore, Wuhan University

6D位姿估计三维重建

4D3R面向单目动态视频中相机位姿未知、运动物体干扰SfM/4D-GS的问题,将位姿估计与重建联合处理:用基础模型给出初始几何和运动先验,再通过结合SAM2动态分割的运动感知BA筛选静态约束,并以控制点、形变MLP和LBS构建紧凑MA-GS。实验显示其在真实动态场景中较现有方法最高提升1.8dB PSNR,并将计算需求约降至五分之一。

No Pose Estimation? No Problem: Pose-Agnostic and Instance-Aware Test-Time Adaptation for Monocular Depth Estimation Figure 1
arXiv preprint2025-11-07

No Pose Estimation? No Problem: Pose-Agnostic and Instance-Aware Test-Time Adaptation for Monocular Depth Estimation

Mingyu Sung, Hyeonmin Choe, Il-Min Kim, Sangseok Yun, Jae-Mo Kang

6D位姿估计彩色深度

该文针对单目深度模型在真实驾驶场景中遇到天气、光照和动态物体分布变化时,现有测试时自适应依赖SfM与位姿网络、易在动态环境失效的问题,提出PITTA:完全不使用相机位姿,而是用全景分割得到的动态实例掩码选择性约束深度,并结合图像/深度边缘设计depth-refining与edge-guided损失。作者在DrivingStereo和Waymo多环境评测中报告其优于现有TTA方法,但具体增益对外部分割器质量的敏感性仍需关注。

Pressure2Motion: Hierarchical Human Motion Reconstruction from Ground Pressure with Text Guidance Figure 1
arXiv preprint2025-11-22

Pressure2Motion: Hierarchical Human Motion Reconstruction from Ground Pressure with Text Guidance

Zhengxuan Li, Qinhui Yang, Yiyu Zhuang, Chuan Guo, Xinxin Zuo Xiaoxiao Long, Yao Yao, Xun Cao, Qiu Shen, Snap Inc

Nanjing University Snap Inc. Concordia University

6D位姿估计三维重建

针对传统动捕依赖相机、穿戴设备且不利于隐私的问题,Pressure2Motion尝试仅用地面压力序列和文本提示重建全身三维运动。其关键在于用双层压力特征提取器分离运动轨迹与细粒度姿态变化,并将这些物理线索层次化注入预训练文本到运动扩散模型。论文还构建了配对文本、压力与运动的MPL基准,实验显示生成动作更真实且物理一致,达到该新任务的SOTA。

Synchronous Observer Design for Landmark-Inertial SLAM with Almost-Global Convergence Figure 1
arXiv preprint2025-11-06

Synchronous Observer Design for Landmark-Inertial SLAM with Almost-Global Convergence

Arkadeep Saha, Pieter van Goor, Antonio Franchi, Ravi Banavar

Centre for Systems and Control, Indian Institute of Technology Bombay, Robotics and Mechatronics (RaM) group, University of Twente, Enschede, The Netherlands, Robotics and Mechatronics (RaM) Group, EEMCS Faculty, University of Twente, DIAG, Sapienza University of Rome

6D位姿估计相机位姿

针对传统 EKF SLAM 易不一致、图优化计算量高以及 LI-SLAM 中惯性与路标观测存在不可观规范自由度的问题,本文从几何观测器角度重构连续时间 LI-SLAM。核心做法是引入编码全部可观状态的 LI-SLAM base space,并在该商流形上设计同步非线性观测器,从而显式处理竖直轴旋转和平移不变性。理论证明误差系统局部指数稳定且几乎全局渐近收敛,仿真用于验证这些收敛结论。

A Two-stage Adaptive Lifting PINN Framework for Solving Viscous Approximations to Hyperbolic Conservation Laws Figure 1
arXiv preprint2025-11-06

A Two-stage Adaptive Lifting PINN Framework for Solving Viscous Approximations to Hyperbolic Conservation Laws

Yameng Zhu, Ran Bi

School of Mathematics, Nanjing University, Nanjing 210093, People’s Republic of China

6D位姿估计

针对双曲守恒律在近无黏极限下激波导致强形式残差失效、小黏性边界层难训练的问题,本文提出两阶段自适应提升 PINN:先用较大黏性得到粗解并构造 r-adaptive 提升坐标,再在目标小黏性上训练。理论给出误差分解、隐式重要性采样和 NTK 条件改善解释;在 Burgers 与 Euler Lax 管等算例中收敛更稳、间断附近重构更准。

Deep Dictionary-Free Method for Identifying Linear Model of Nonlinear System with Input Delay Figure 1
arXiv preprint2025-11-06

Deep Dictionary-Free Method for Identifying Linear Model of Nonlinear System with Input Delay

Patrik Valábek, Marek Wadinger, Michal Kvasnica, Martin Klaučo

6D位姿估计

针对带输入时滞的非线性系统难以用传统线性控制建模的问题,本文用带 LSTM 的 Deep Koopman 网络学习潜在空间中的线性动力学,避免 eDMD 依赖预设字典并用历史信息编码时滞。仿真结果显示,在未知真实非线性动力学时预测精度显著优于常规 eDMD,并接近已知动力学字典的 eDMD,但实验主要限于模拟系统。

MedSapiens: Taking a Pose to Rethink Medical Imaging Landmark Detection Figure 1
arXiv preprint2025-11-06

MedSapiens: Taking a Pose to Rethink Medical Imaging Landmark Detection

Marawan Elbatel, Anbang Wang, Keyuan Liu, Kaouther Mouheb, Enrique Almar-Munoz, Lizhuo Lin, Yanqi Yang, Karim Lekadir, Xiaomeng Li

The Hong Kong University of Science and Technology, Hong Kong, The University of Hong Kong, Hong Kong, Erasmus MC, Netherlands, Medical University of Innsbruck, Austria, University of Barcelona, Spain

6D位姿估计医学/手术

医学解剖标志点检测常受小数据、单任务模型和跨任务泛化差限制。MedSapiens的关键洞察不是设计新结构,而是将面向人体姿态估计、具备空间关键点先验的Sapiens经多医学数据集预训练与LoRA微调用于医学影像标志点检测。实验显示其相对通用模型平均SDR最高提升5.26%,任务专用微调后相对专用模型最高提升21.81%,少样本未见任务提升2.69%;增益可能主要来自大规模姿态预训练与多数据训练。

DMSORT: An efficient parallel maritime multi-object tracking architecture for unmanned vessel platforms Figure 1
arXiv preprint2025-11-16

DMSORT: An efficient parallel maritime multi-object tracking architecture for unmanned vessel platforms

Shengyu Tang, Zeyuan Lu, Jiazhi Dong, Changdong Yu, Xiaoyu Wang, Yaohui Lyu, Weihao Xia

6D位姿估计物体位姿

面向无人船海上视觉跟踪中相机抖动、遮挡、低分辨率和船载算力受限的问题,DMSORT将检测/ReID与动态相机运动估计并行化,用RCDN增强多尺度检测、Li-TAE提取轻量外观特征,并在卡尔曼滤波中补偿平台运动、用聚类优化融合运动与外观线索。在Singapore Maritime Dataset上,文中报告其达到SOTA,并在ReID类MOT框架中运行最快、身份一致性更稳。

Simple 3D Pose Features Support Human and Machine Social Scene Understanding Figure 1
arXiv preprint2025-11-06

Simple 3D Pose Features Support Human and Machine Social Scene Understanding

Qin, Wenshuo, Leyla Işık

Wenshuo Qin & Leyla Isik; Johns Hopkins University

6D位姿估计

这篇论文针对现有视觉 DNN 难以对齐人类社会场景判断的问题,检验人类是否依赖显式 3D 身体空间信息。作者从双人短视频中结合姿态与深度估计提取 SMPL-X 3D 关节,并进一步压缩为每个人的位置与朝向特征。结果显示,3D 关节在多项社会评分上优于多数 350+ 视觉模型,12 维 3D 特征几乎解释完整关节性能,且优于 2D 对应特征并可提升 DNN 表现。

CORE - A Cell-Level Coarse-to-Fine Image Registration Engine for Multi-stain Image Alignment Figure 1
arXiv preprint2025-11-12

CORE - A Cell-Level Coarse-to-Fine Image Registration Engine for Multi-stain Image Alignment

Esha Sadia Nasir, Behnaz Elhaminia, Mark Eastwood, Catherine King, Owen Cain, Lorraine Harper, Paul Moss, Dimitrios Chanouzas, David Snead, Nasir Rajpoot, Adam Shephard, Shan E Ahmed Raza

Tissue Image Analytics (TIA) Centre, Department of Computer Science, University of Warwick, UK, Department of Cellular Pathology, Queen Elizabeth Hospital Birmingham, UK, Renal Unit, Queen Elizabeth Hospital Birmingham, University Hospitals Birmingham NHS Foundation Trust, UK, Histofy Ltd, Coventry, UK, Dimitrios Chanouzas

6D位姿估计

多染色全切片图像在核级联合分析中常受跨模态外观差异、组织形变和伪影影响,传统配准难以稳定工作。CORE以提示式组织掩膜和密集特征做粗对齐,再用自动检测的细胞核质心进行形状感知点集刚性配准,并通过CPD估计非刚性位移场。作者在3个公开和2个私有WSI数据集上验证,报告其在亮场与免疫荧光场景中较现有方法具备更好的泛化、精度和鲁棒性。

FusionDP: Foundation Model-Assisted Differentially Private Learning for Partially Sensitive Features Figure 1
arXiv preprint2025-11-05

FusionDP: Foundation Model-Assisted Differentially Private Learning for Partially Sensitive Features

Linghui Zeng, Ruixuan Liu, Atiquer Rahman Sarkar, Xiaoqian Jiang, Joyce C. Ho, Li Xiong

6D位姿估计

本文关注仅部分特征敏感时,传统 DP-SGD 对整条样本加噪导致效用损失的问题。FusionDP 用基础模型根据非敏感特征补全敏感特征,形成混合输入,并改造 DP-SGD 与表征对齐目标,只保护原始敏感特征。实验在 PhysioNet 败血症预测和 MIMIC-III 临床文本分类上优于多种隐私基线,但具体增益幅度与对基础模型质量的依赖仍需结合完整实验细节判断。

Electric Vehicle Charging Load Modeling: A Survey, Trends, Challenges and Opportunities Figure 1
arXiv preprint2025-10-30

Electric Vehicle Charging Load Modeling: A Survey, Trends, Challenges and Opportunities

Xiachong Lin, Arian Prabowo, Imran Razzak, Hao Xue, Matthew Amos, Sam Behrens, Flora D. Salim

6D位姿估计数据集/基准综述

面向电动车规模化接入带来的充电负荷不确定性,本文系统梳理近五年负荷建模研究。其核心洞察是以信息融合视角重组统计、仿真与数据驱动方法,并按时间/空间尺度、任务类型和融合层级分析适用性。主要结果是总结各类模型在可解释性、计算成本、数据依赖与鲁棒性上的权衡,指出开放数据、多源融合和真实场景评估仍是关键瓶颈。

AI-Enhanced Wi-Fi Sensing Through Single Transceiver Pair Figure 1
arXiv preprint2025-10-21

AI-Enhanced Wi-Fi Sensing Through Single Transceiver Pair

Yuxuan Liu, Chiya Zhang, Yifeng Yuan, Chunlong He, Weizheng Zhang, Gaojie Chen

6D位姿估计

面向大规模、低成本 Wi‑Fi 感知部署,论文追问单收发对在带宽和天线受限下为何仍能借助 AI 超越传统雷达分辨率。其核心洞察是增益主要来自训练中学到的目标结构先验与时间相关性,而非硬件分辨率本身;据此构建实时 CSI 感知与可视化系统,在人体姿态估计和室内定位中分别达到 0.2189 m 平均 HPE 误差、0.6124 m 定位误差,并在商用硬件上不低于 42 fps。

Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks Figure 1
arXiv preprint2025-11-04

Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks

Dmitrii Pozdeev, Alexey Artemov, Ananta R. Bhattarai

Dmitrii Pozdeev, Technical University of Munich (TUM), University of Bielefeld

6D位姿估计

针对人头跟踪中稀疏关键点和3DMM难覆盖头发、配饰且遮挡下对应不稳定的问题,DenseMarks用ViT为头部每个像素预测3D规范立方体嵌入,并以公开视频点轨迹的对比学习结合关键点、分割和空间平滑约束来形成可查询的密集语义空间。实验显示其在几何感知点匹配和单目3DMM头部跟踪上优于多种基础模型特征,尤其提升了跨姿态与包含头发区域的对应质量。

Object Detection as an Optional Basis: A Graph Matching Network for Cross-View UAV Localization Figure 1
arXiv preprint2025-11-04

Object Detection as an Optional Basis: A Graph Matching Network for Cross-View UAV Localization

Tao Liu, Kan Ren, Qian Chen

6D位姿估计航天器

针对 GNSS 受限时无人机需依赖机载图像与卫星图检索定位、但跨视角/跨时相差异导致匹配不稳的问题,论文将显著目标检测作为可选中间表示,把目标语义与空间关系构成图,并用 GNN 进行图内关系推理和训练期节点匹配。实验在 University-1652、SUES-200、Dense-UAV 等数据上显示检索与定位精度提升;消融表明语义节点、全局特征和图嵌入损失是主要增益来源。

A New Perspective on Precision and Recall for Generative Models Figure 1
arXiv preprint2025-11-04

A New Perspective on Precision and Recall for Generative Models

Benjamin Sykes, Loïc Simon, Julien Rabin, Jalal Fadili

6D位姿估计

本文关注生成模型评估中过度依赖单一 Precision/Recall 标量、难以刻画保真度与多样性权衡的问题。作者从二分类对偶视角重新表述整条 PR 曲线,并结合总变差距离与 KDE 等估计给出统计分析和极小极大风险上界,同时说明该框架可统一若干只评估极值的既有指标。实验在可控、真实与混合设置中展示不同曲线行为,但与 6D 位姿估计的直接关联文中未充分说明。

Cycle-Sync: Robust Global Camera Pose Estimation through Enhanced Cycle-Consistent Synchronization Figure 1
arXiv preprint2025-11-04

Cycle-Sync: Robust Global Camera Pose Estimation through Enhanced Cycle-Consistent Synchronization

Shaohan Li, Yunpeng Shi, Gilad Lerman School of Mathematics, Davis nicklsh1996@gmail.com, lerman@umn.edu, ypshi@ucdavis.edu

School of Mathematics, University of Minnesota, Department of Mathematics, University of California, Davis

6D位姿估计相机位姿

针对 SfM 中相机位置估计缺少尺度、外点多且传统方法未充分利用环一致性的难题,Cycle-Sync 将 MPLS 改造为全局位姿同步框架,用迭代估计距离重定义环一致性,并结合 Welsch 鲁棒损失与可插拔外点剔除,同时扩展到旋转同步。论文给出较强的确定性精确恢复保证;合成与真实数据表明其无需 bundle adjustment 也优于多种含 BA 的 SfM 基线。

No Figure
arXiv preprint2025-11-04

Are Euler angles a useful rotation parameterisation for pose estimation with Normalizing Flows?

Sfikas, Giorgos, Nikolaidou, Konstantina, Papadopoulou, Foteini, Retsinas, George, Kesidis, Anastasios L

6D位姿估计

针对单图6D位姿中旋转因物体对称和投影不确定而呈多峰分布的问题,论文考察在归一化流中直接使用欧拉角是否比SO(3)上更复杂的矩阵/四元数流更实用。核心洞察是欧拉角虽有万向节锁等缺陷,但维度低、无需每层投影,可能带来更易优化的密度模型。实验显示其整体拟合略优于旋转矩阵参数化NF,但在真值集中于欧拉奇异点附近的数据上退化,说明优势并非普适。

A Joint Variational Framework for Multimodal X-ray Ptychography and Fluorescence Reconstruction Figure 1
arXiv preprint2025-11-04

A Joint Variational Framework for Multimodal X-ray Ptychography and Fluorescence Reconstruction

DMS-2038118, Elle Buser : 1, Zichao Wendy Di, Yuanzhe Xi : 1

Department of Mathematics, Emory University, Atlanta, 30322 (), Mathematics and Computer Science Division & Advanced Photon Science, Argonne National Lab ()

6D位姿估计三维重建

针对叠层相干衍射成像高分辨但非凸不适定、XRF具元素特异性却受探针模糊限制的问题,本文将两者写入共享空间变量的联合变分最小二乘框架,用物理耦合约束结构与成分一致性。模拟实验显示,相比独立反演可更快收敛、降低相对误差并得到更锐利的元素重建;但验证仍限于仿真,实验校准、探测器响应和自吸收等影响文中未充分说明。

A new approach for the analysis of evolution partial differential equations on a finite interval Figure 1
arXiv preprint2025-11-04

A new approach for the analysis of evolution partial differential equations on a finite interval

Türker Özsarı, Dionyssios Mantzavinos, Konstantinos Kalimeris

Department of Mathematics, Bilkent University, Ankara, Turkey, Department of Mathematics, University of Kansas, Lawrence, KS 66045, USA, Mathematics Research Center, Academy of Athens, Athens, Greece

6D位姿估计

面向带非齐次边界条件的有限区间演化偏微分方程,直接建立适定性常受缺少傅里叶工具限制。本文的关键洞察是用 Fokas 统一变换把有限区间解表示为两个半线问题解的叠加,并将未知半线数据化为 Sobolev 空间中的不动点逆问题。作者在热方程和线性 KdV 上证明该约化,给出热方程数值模拟,并说明可把半线正则性估计迁移到有限区间以支撑非线性局部适定性分析。

HGFreNet: Hop-hybrid GraphFomer for 3D Human Pose Estimation with Trajectory Consistency in Frequency Domain Figure 1
arXiv preprint2025-11-03

HGFreNet: Hop-hybrid GraphFomer for 3D Human Pose Estimation with Trajectory Consistency in Frequency Domain

Kai Zhai, Ziyan Huang, Qiang Nie, Xiang Li, Bo Ouyang

6D位姿估计人体姿态

本文针对单目视频2D到3D人体姿态提升中的深度歧义、2D检测误差导致的轨迹抖动问题,提出HGFreNet:用hop-hybrid图注意力扩大骨架多跳感受野并结合Transformer建模时空相关,同时在频域约束3D轨迹一致性,并引入预估3D序列辅助跨帧深度推断。Human3.6M和MPI-INF-3DHP实验显示,其在位置精度与时间一致性上优于已有SOTA。

Clutter Suppression in Bistatic ISAC with Joint Angle and Doppler Estimation Figure 1
arXiv preprint2025-11-03

Clutter Suppression in Bistatic ISAC with Joint Angle and Doppler Estimation

M. Ertug Pihtili, Julia Equi, Ossi Kaltiokallio, Jukka Talvitie, Elena Simona Lohan, Ertugrul Basar, Mikko Valkama Tampere Wireless Research Center, Electrical Engineering Unit, Tampere, Finland Ericsson Research, Helsinki, Finland

Tampere Wireless Research Center, Electrical Engineering Unit, Tampere University, Tampere, Finland, Ericsson Research, Helsinki, Finland

6D位姿估计

面向6G双基地ISAC在毫米波和大规模阵列下易受静态背景杂波干扰、导致角度/多普勒等感知参数失准的问题,论文提出无需纯杂波参考测量的2D-rootMUSIC杂波抑制与联合角度-多普勒估计方法。仿真显示其在强杂波场景中提升SCNR并保持较准确参数估计,在参考信号存在不确定性时优于背景相减基线。

Defining Energy Indicators for Impact Identification on Aerospace Composites: A Physics-Informed Machine Learning Perspective Figure 1
arXiv preprint2025-11-03

Defining Energy Indicators for Impact Identification on Aerospace Composites: A Physics-Informed Machine Learning Perspective

Natália Ribeiro Marinho, Richard Loendersloot, Frank Grooteman, Jan Willem Wiegman, Uraz Odyurt, Tiedo Tinga

6D位姿估计

针对航空复合材料低速冲击损伤难以从稀疏、噪声传感信号中反推出能量的问题,论文将物理观察偏置落实到输入空间设计:从时域、频域和时频域构造可解释特征,并经显著性、相关性、降维与抗噪筛选后送入FCNN。实验覆盖完好与损伤状态,能量预测误差较传统时序方法和纯数据驱动模型约降低三倍。

SE(3)-PoseFlow: Estimating 6D Pose Distributions for Uncertainty-Aware Robotic Manipulation Figure 1
arXiv preprint2025-11-03

SE(3)-PoseFlow: Estimating 6D Pose Distributions for Uncertainty-Aware Robotic Manipulation

Yufeng Jin, Niklas Funk, Vignesh Prasad, Zechu Li, Mathias Franzius, Jan Peters, Georgia Chalvatzaki

Department of Computer Science, TU Darmstadt, Germany, Honda Research Institute Europe GmbH, Offenbach, Germany, DFKI, Research Department SAIROL, Darmstadt, Germany

6D位姿估计机器人操作

针对遮挡、局部观测和物体对称导致的6D位姿多解性,SE(3)-PoseFlow不再回归单一位姿,而是在SE(3)流形上用flow matching生成样本化位姿分布,并结合带masked cross-attention的DiT融合RGB-D特征以提升杂乱场景鲁棒性。论文报告在Real275、YCB-V和LM-O上达到SOTA,并展示该分布可用于主动感知消歧和不确定性感知抓取。

Floor Plan-Guided Visual Navigation Incorporating Depth and Directional Cues Figure 1
arXiv preprint2025-11-03

Floor Plan-Guided Visual Navigation Incorporating Depth and Directional Cues

Weiqi Huang, Jiaxin Li, Zan Wang, Huijun Di, Wei Liang, Zhu Yang

Beijing Institute of Technology, Yangtze Delta Region Academy of Beijing Institute of Technology

6D位姿估计彩色深度

针对传统视觉导航需先探索建图、效率低,以及平面图与第一视角RGB存在模态和内容错位的问题,本文提出GlocDiff:从平面图拓扑提取全局最短路径方向先验,从当前RGB估计局部深度几何,并用条件扩散策略生成连续动作。FloNa实验显示其在更少训练数据下优于基线,消融表明全局路径和局部深度均关键,并可零微调部署到AGV但真实成功率仅40%。

Tackling the Kidnapped Robot Problem via Sparse Feasible Hypothesis Sampling and Reliable Batched Multi-Stage Inference Figure 1
IEEE Transactions on Instrumentation and Measurement2025-11-11

Tackling the Kidnapped Robot Problem via Sparse Feasible Hypothesis Sampling and Reliable Batched Multi-Stage Inference

Muhua Zhang, Lei Ma, Ying Wu, Kai Shen, Deqing Huang, Henry Leung

Southwest Jiaotong University, University of Calgary

6D位姿估计机器人操作

针对机器人在无先验位姿或定位丢失后的“绑架机器人”重定位难题,论文提出单帧2D LiDAR与栅格地图的被动全局重定位框架:用可通行约束RRT稀疏采样可行位置,结合SMAD粗排序、TAM精评估和批量多阶段早停推理。真实室内实验中,相比最强基线平均成功率提升约26.9个百分点,运行时间多降至亚秒到1.6秒。

LiDAR-VGGT: Cross-Modal Coarse-to-Fine Fusion for Globally Consistent and Metric-Scale Dense Mapping Figure 1
arXiv preprint2025-11-03

LiDAR-VGGT: Cross-Modal Coarse-to-Fine Fusion for Globally Consistent and Metric-Scale Dense Mapping

Lijie Wang, Lianjie Guo, Ziyi Xu, Qianhao Wang, Fei Gao, Xieyuanli Chen

Technology, Institute of Cyber-Systems and Control, Zhejiang University, and Technology, National University of Defense Technology

6D位姿估计点云

面向大规模机器人彩色建图中,LIVO依赖外参/同步且LiDAR稀疏,VGGT又缺少尺度和全局一致性的问题,LiDAR-VGGT用LIO为VGGT分段重建提供尺度初始化,再通过带包围盒正则的跨模态Sim(3)精配准和全局PGO抑制FOV差异带来的尺度畸变。多数据集实验显示其可生成更稠密、具公制尺度且全局一致的彩色点云,优于VGGT类方法和LIVO基线。

Web-Scale Collection of Video Data for 4D Animal Reconstruction Figure 1
arXiv preprint2025-11-03

Web-Scale Collection of Video Data for 4D Animal Reconstruction

Brian Nlong Zhao, Jiajun Wu

Stanford University, University of Illinois Urbana-Champaign, University of Cambridge

6D位姿估计三维重建

针对野外动物4D重建缺少大规模、物体中心视频数据的问题,论文提出从YouTube自动挖掘并处理视频的流水线,生成含掩码、关键点、光流等标注的30K片段/200万帧数据,并构建AiM基准。实验显示现有2D指标偏好模型驱动方法但可能掩盖不真实3D形状,作者进一步用序列级优化改进3D-Fauna形成4D-Fauna基线。

Active learning-based variance reduction for Monte Carlo simulations: A feasibility study for the nanodosimetry around a gold nanoparticle Figure 1
arXiv preprint2025-11-01

Active learning-based variance reduction for Monte Carlo simulations: A feasibility study for the nanodosimetry around a gold nanoparticle

1 Introduction

6D位姿估计

针对纳米剂量学中金纳米粒子周围电离簇的蒙特卡洛模拟代价高、重要性采样分布难以先验设定的问题,论文提出一种受主动学习启发的方差缩减方案,用高斯过程采样器迭代优化入射冲量参数分布,并通过 TCP 接口联动 Geant4。结果显示该分布显著优于均匀照射,在粒子附近通量提升超过四个数量级,结果接近参考方差缩减方法,但仍略高估背景贡献。

Residual Balancing for Non-Linear Outcome Models in High Dimensions Figure 1
arXiv preprint2025-10-31

Residual Balancing for Non-Linear Outcome Models in High Dimensions

Isaac Meza Lopez

Department of Economics, Harvard University

6D位姿估计

本文关注高维协变量下非线性结果模型的因果效应估计,动机是线性 ARB 难以处理 GLM 链接函数曲率带来的残余偏差。核心洞察是仅做一阶平衡不够,需基于泰勒展开加入由链接函数一、二阶导数加权的二阶平衡约束。论文给出偏差分解、权重优化构造,并证明在稀疏与正则条件下估计量具备 √n 一致性和渐近正态性。

On the well-posedness of the intermediate nonlinear Schrödinger equation on the line Figure 1
arXiv preprint2025-10-31

On the well-posedness of the intermediate nonlinear Schrödinger equation on the line

Andreia Chapouto, Justin Forlano, Thierry Laurens

School of Mathematics, Monash University, VIC 3800, Australia, Department of Mathematics, University of Wisconsin–Madison, WI, 53706, USA

6D位姿估计

本文实际研究一维中间非线性薛定谔方程而非6D位姿估计,动机是把适定性推进到更接近L2临界空间并覆盖有限/无限水深及CCM情形。核心做法是用规范变换、双线性Strichartz估计和解的精细分解回收导数损失,并发现新的Lax pair。主要结果是在Hs、s>1/4中证明局部适定性,且小L2质量下得到全局适定性。

VLM6D: VLM based 6Dof Pose Estimation based on RGB-D Images Figure 1
arXiv preprint2025-10-31

VLM6D: VLM based 6Dof Pose Estimation based on RGB-D Images

Md Selim Sarowar, Sung‐Ho Kim

School of Electronics Engineering, Advanced Visual Intelligence Lab(AVI), Yeungnam University, South Korea

6D位姿估计点云彩色深度

该文面向真实机器人操作中光照变化、弱纹理与严重遮挡导致的6D位姿估计泛化不足问题,提出VLM6D双流RGB-D框架:用自监督DINOv2提取RGB语义/外观特征,并将深度反投影为点云后由PointNet++建模几何,再经跨模态融合和多任务头预测位姿。实验声称在Occluded-LineMOD上达到新SOTA、鲁棒性更好,但具体指标与消融增益在给定文本中未充分说明。

FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models Figure 1
arXiv preprint2025-11-10

FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models

Junkang Liu, Fanhua Shang, Hongying Liu, Yuxuan Tian, Yuanyuan Liu, Jin Liu, Kewen Zhu, Zhouchen Lin

6D位姿估计

本文关注大模型联邦训练中直接使用 AdamW 会因非 IID 数据带来二阶矩高方差、局部过拟合与动量反复重置而通信低效的问题,提出 FedAdamW:用全局更新校正本地步方向,并以块/均值方式聚合二阶矩以保留自适应统计、降低通信。理论上给出无需异质性假设的线性加速收敛界,并用 PAC-Bayes 解释解耦权重衰减;在语言与视觉 Transformer 上减少通信轮数并提升测试精度,但与 6D 位姿任务的直接关联文中未充分说明。

Improved refined bilinear estimates and well-posedness for generalized KdV type equations on $\mathbb{R}$ Figure 1
arXiv preprint2025-10-31

Improved refined bilinear estimates and well-posedness for generalized KdV type equations on $\mathbb{R}$

Luc Molinet, Tomoyuki Tanaka

Graduate School of Engineering Science, Yokohama National University, Yokohama, Kanagawa, 240-Japan

6D位姿估计

本文针对广义 KdV 型一维色散方程在实线上的 Cauchy 问题,动机是降低 Sobolev 正则性门槛并获得无条件适定性。核心在于改进实线上的精细线性与双线性估计,结合能量方法处理解析非线性。结果给出局部无条件适定性的阈值,并在 α∈[5/4,2] 推出解的全局存在性。

Cooperative Integrated Estimation-Guidance for Simultaneous Interception of Moving Targets Figure 1
arXiv preprint2025-10-30

Cooperative Integrated Estimation-Guidance for Simultaneous Interception of Moving Targets

Lohitvel Gopikannan, Shashi Ranjan Kumar, Abhinav Sinha

6D位姿估计

面向多无人平台同时拦截移动目标时“并非所有载体都有传感器”的现实约束,论文把目标状态估计与协同制导合在同一框架中:有传感器节点直接观测,无传感器节点通过有向通信图上的预设时间观测器共享估计,并结合 TPNG 的精确剩余时间公式实现预设时间内的 time-to-go 一致。结果主要以仿真验证,在多种交会场景下可收敛到目标状态并同步拦截;真实系统、噪声和执行器约束验证文中未充分说明。

Graph Guided Modulo Recovery of EEG Signals Figure 1
arXiv preprint2025-10-30

Graph Guided Modulo Recovery of EEG Signals

Soujanya Hazra

6D位姿估计

针对 EEG 个体幅值差异导致传统 ADC 易饱和、模采样后原信号恢复病态的问题,论文提出 GraphUnwrapNet,将多通道 EEG 的电极与时间连接建成图,并用预估引导特征注入提供粗折叠边界线索。在 STEW 数据集上,该方法相较传统优化恢复更稳定,并达到接近现有深度模型的精度,但具体增益来源仍可能与图结构先验和预估模块共同相关。

Orbital Optimization and Neural-Network-Assisted Configuration Interaction Calculations of Rydberg States Figure 1
arXiv preprint2025-10-30

Orbital Optimization and Neural-Network-Assisted Configuration Interaction Calculations of Rydberg States

Gianluca Levi, Max Kroesbergen, Louis Thirion, Yorick L. A. Schmerwitz, Elvar Ö. Jónsson, Pavlo Bilous, Philipp Hansmann, Hannes Jónsson

Department of Physics, Friedrich-Alexander-Universität Erlangen/Nürnberg, Erlangen, Germany

6D位姿估计

针对分子 Rydberg 态电子分布高度弥散、常规原子基组易将其过度束缚的问题,本文将平面波 Hartree–Fock 中的激发态轨道变分优化与神经网络选择性 CI 结合。核心洞察是使用面向目标激发态的轨道可显著改善多体计算收敛,并允许在较大轨道空间中筛选关键行列式。H₂、H₂O 和 NH₃ 实验显示,所得激发能接近实验及高质量弥散基组多体结果,而缺少额外弥散函数的基组会系统性高估。

Tight Differentially Private PCA via Matrix Coherence Figure 1
arXiv preprint2025-10-30

Tight Differentially Private PCA via Matrix Coherence

Tommaso d’Orsi, Gleb Novikov

Bocconi University, Italy, Lucerne School of Computer Science and Information Technology, Switzerland

6D位姿估计

针对私有低秩近似中误差常随环境维度恶化的问题,本文从矩阵相干性重新刻画差分隐私 PCA:仅要求前 r 个奇异向量的 rank-r 相干性低,并结合 SVD 与高斯扰动机制,使误差主要由该相干性和谱间隙决定。理论上改进既有最优界,在稠密 Wishart 单 spike PCA 中达到非私有最优算法同阶保证,并进一步证明高斯扰动不增大相干性,扩展到低相干图上的 Max-Cut/CSP 私有求解。

Statistical Inference for Matching Decisions via Matrix Completion under Dependent Missingness Figure 1
arXiv preprint2025-10-30

Statistical Inference for Matching Decisions via Matrix Completion under Dependent Missingness

PAGE 1, Congyuan Duan1, Wanteng Ma2, Dong Xia1, Kan Xu3

Department of Mathematics, Hong Kong University of Science and Technology, Department of Statistics and Data Science, University of Pennsylvania

6D位姿估计

本文关注双边匹配平台中历史观测受容量约束而非独立缺失的问题,动机是仅凭随机或既有匹配数据评估并改进新匹配策略。核心洞察是把全体匹配收益建模为低秩矩阵,并针对匹配诱导的依赖缺失设计 Grassmannian 非凸矩阵补全、去偏与投影推断框架。理论上覆盖一对一、一对多和双边随机到达机制,给出近最优逐项收敛率、线性函数渐近正态与有限样本保证,实验显示估计、置信区间和策略评估较可靠。

Transcending Sparse Measurement Limits: Operator-Learning-Driven Data Super-Resolution for Inverse Source Problem Figure 1
arXiv preprint2025-10-30

Transcending Sparse Measurement Limits: Operator-Learning-Driven Data Super-Resolution for Inverse Source Problem

Guanyu Pan, Jianing Zhou, Xiaotong Liu, Yunqing Huang 1 Corresponding author, Nianyu Yi

School of Mathematics and Computational Science, Xiangtan University, Xiangtan 411105, China, National Center for Applied Mathematics in Hunan, Xiangtan 411105, China, College of Mathematics and Informatics, South China Agricultural University, Guangzhou 510006, China

6D位姿估计

本文针对窄孔径、单频且仅有少量边界采样时 Helmholtz 逆源定位严重欠采样、传统 DSM 失效的问题,提出先用 DeepONet 将 6–10 个稀疏观测超分辨为稠密合成孔径,再交给 DSM 反演的模块化框架,并补充有限孔径唯一性与单源误差分析。两源、三源实验显示,相比直接用稀疏数据,重建数据可将定位误差降低约一个数量级,在 π/4 孔径下仍有效。

Sketch2PoseNet: Efficient and Generalized Sketch to 3D Human Pose Prediction Figure 1
arXiv preprint2025-11-16

Sketch2PoseNet: Efficient and Generalized Sketch to 3D Human Pose Prediction

Li Wang, Yiyu Zhuang, Yanwen Wang, Xun Cao, Chuan Guo, Xinxin Zuo, Hao Zhu

Nanjing University, Concordia University

6D位姿估计人体姿态

面向动画/影视中从抽象、比例失真的草图快速生成3D人体姿态的问题,Sketch2PoseNet用“合成中学习”构建SKEP-120K草图-3D姿态数据,并结合扩散先验特征与前馈网络、几何一致性损失进行端到端估计。实验显示其在多风格草图上较以往优化式方法更准且约快500倍,但细端关节和个体体型仍是局限。

JOGS: Joint Optimization of Pose Estimation and 3D Gaussian Splatting Figure 1
arXiv preprint2025-10-30

JOGS: Joint Optimization of Pose Estimation and 3D Gaussian Splatting

Xianben Yang, Yuxuan Li, Tao Wang, Yi Jin, Yidong Li, Haibin Ling

6D位姿估计三维重建高斯泼溅

JOGS针对3DGS依赖COLMAP等外部位姿估计带来的耗时与误差传播问题,将相机位姿和高斯场景表示放入同一优化框架。方法用交替方向思路分两阶段更新:固定姿态优化3D高斯,再借助结合几何与光度约束的LK3D光流细化位姿,并加入跨视角重投影约束。实验在Tanks and Temples、LLFF-NeRF和Shiny上显示,其新视角合成与重建质量优于现有无COLMAP方法,整体也超过标准COLMAP基线。

Evaluating the effectiveness of Stochastic CTMC and deterministic models in correlating rabies persistence in human and dog populations Figure 1
arXiv preprint2025-10-27

Evaluating the effectiveness of Stochastic CTMC and deterministic models in correlating rabies persistence in human and dog populations

Mfano Charles, Sayoki G. Mfinanga, G.A. Lyakurwa, Delfim F. M. Torres, Verdiana G. Masanja

School of Computational and Communication Science and Engineering, Department of ICT and Mathematics, Department of Mathematics, University of Aveiro, 3810-Aveiro, Portugal, National Institute for Medical Research- Muhimbili Medical Research Centre

6D位姿估计

该文面向犬—人狂犬病在资源受限地区持续传播的问题,比较确定性模型与随机CTMC框架。其主要贡献是把环境库、流浪犬和家犬纳入统一传播模型,并用多类型分枝过程给出随机持续阈值与灭绝概率分析。1万条样本路径的仿真显示,两类模型总体趋势接近,但在低感染率、小规模感染场景下随机性会显著影响暴发概率和控制判断。

STITCH 2.0: Extending Augmented Suturing with EKF Needle Estimation and Thread Management Figure 1
IEEE Robotics and Automation Letters2025-10-29

STITCH 2.0: Extending Augmented Suturing with EKF Needle Estimation and Thread Management

Kush Hari, Ziyang Chen, Hansoul Kim, Ken Goldberg

Berkeley College, University of California, Berkeley

6D位姿估计

针对 STITCH 1.0 在连续缝合中因针位姿噪声、线缠绕和落针导致难以完全闭合伤口的问题,STITCH 2.0 在 dVRK 增强灵巧框架中加入 EKF 6D 针位姿估计、点云去噪、自动 3D 缝合点对齐及理线/解缠策略。15 次实验中平均完成 4.87 针、伤口闭合率 74.4%,较基线多 66% 缝合且耗时少 38%;允许两次人工介入时可达 6 针和 100% 闭合。

Inverse-free quantum state estimation with Heisenberg scaling Figure 1
arXiv preprint2025-10-29

Inverse-free quantum state estimation with Heisenberg scaling

Kean Chen

University of Pennsylvania, Philadelphia, USA

6D位姿估计

本文关注无逆查询条件下的量子态/振幅估计:以往实现海森堡级误差缩放通常依赖 U 的逆,或需估计整个酉算子而带来 d² 开销。论文提出仅用前向查询的纯态估计协议,核心洞察是无需完整酉估计也能相干提取目标态信息,将态估计复杂度降至 O(min{d^{3/2}/ε,d/ε²}),并推出振幅估计 O(min{d^{3/2}/ε,1/ε²}),改进既有上界并否定相关猜想。

LieSolver: A PDE-constrained solver for IBVPs using Lie symmetries Figure 1
arXiv preprint2025-10-29

LieSolver: A PDE-constrained solver for IBVPs using Lie symmetries

PAGE 1, Ren´e P. Klausena, Ivan Timofeeva, Johannes Franka, Jonas Naujoksa, Thomas

a Department of Artificial Intelligence, Fraunhofer Heinrich Hertz Institute, d Centre of eXplainable Artificial Intelligence, Technological University Dublin

6D位姿估计

针对 PINN 求解初边值 PDE 时残差损失与真实误差不单调、训练不稳的问题,LieSolver 将预先确定的 Lie 对称变换作为可学习模块,使任意参数下模型都严格满足 PDE,只需拟合初边界条件。文中在限于线性齐次 PDE 的实验中显示,其模型更紧凑、收敛更快且精度高于 vanilla PINN,并可在适定问题中由测试损失导出误差估计。

Seeing Clearly and Deeply: An RGBD Imaging Approach with a Bio-inspired Monocentric Design Figure 1
arXiv preprint2025-10-29

Seeing Clearly and Deeply: An RGBD Imaging Approach with a Bio-inspired Monocentric Design

Zongxi Yu, Xiaolong Qian, Shaohua Gao, Qi Jiang, Yao Gao, Kailun Yang, Kaiwei Wang

6D位姿估计点云彩色深度

面向机器人、无人机等对小型低功耗高保真 RGBD 感知的需求,论文指出纯单目深度依赖语义先验且主动/双目方案体积功耗较高。其核心是用仿生全球面单心透镜让深度自然编码到随距离变化的 PSF 中,并结合物理退化仿真与双头多尺度网络,从单次编码成像同时恢复全清晰 RGB 和深度。实验主要在仿真中验证,深度 Abs Rel 0.026、RMSE 0.130,图像恢复 SSIM 0.960、LPIPS 0.082,但真实硬件泛化仍文中未充分说明。

Non-Invasive Calibration Of A Stewart Platform By Photogrammetry Figure 1
The International Journal of Advanced Manufacturing Technology2025-10-29

Non-Invasive Calibration Of A Stewart Platform By Photogrammetry

Sourabh Karmakar, Cameron J. Turner

Clemson University

6D位姿估计

针对 Stewart 平台正运动学多解、标定常需外接传感器或改硬件的问题,本文在自建 6-UPS 平台 Tiger 66.1 上,将改进 DH 正运动学与多视角摄影测量结合,仅用高分辨率相机和现成软件估计平台中心 6D 位姿误差,并用最小二乘设计三种补偿策略。实验显示三种策略均提升位姿精度,但文中片段未充分说明具体误差降幅和各增益来源。

A Black Box Variational Inference Scheme for Inverse Problems with Demanding Physics-Based Models Figure 1
arXiv preprint2025-10-28

A Black Box Variational Inference Scheme for Inverse Problems with Demanding Physics-Based Models

G. Robalo Rei, C. P. Schmidt, J. Nitzler, M. Dinkel, W. A. Wall

Institute for Computational Mechanics, Technical University of Munich

6D位姿估计

针对昂贵、不可微物理前向模型中的贝叶斯逆问题,论文希望减少后验推断所需的模型调用。核心做法是在黑盒变分推断中用重要性采样复用历史仿真,并设计批序贯采样机制,仅在现有样本不足以估计目标梯度时追加评估。实验覆盖密度匹配和固态电池电化学-力学模型校准,相比基础 BBVI、SMC 与 MCMC 显著降低计算开销;与6D位姿估计的直接关系文中未充分说明。

Understanding Multi-View Transformers Figure 1
arXiv preprint2025-10-28

Understanding Multi-View Transformers

Michal Stary, Julien Gaubil, Ayush Tewari, Vincent Sitzmann

TUM, Claude Bernard University Lyon 1, University of Cambridge, MIT CSAIL

6D位姿估计多视角

针对 DUSt3R 等多视角 Transformer 虽能前馈重建 3D、但内部机制不透明的问题,论文用受限容量的 pointmap probes 从各解码层残差连接中读出并可视化几何状态。分析显示模型在层间迭代细化位姿与尺度,自注意力主要恢复第二视角内部几何,交叉注意力推动重叠区域对齐;结果还表明该变体更依赖对应关系及重建几何,而非显式全局相机位姿。

Greedy Sampling Is Provably Efficient for RLHF Figure 1
arXiv preprint2025-10-28

Greedy Sampling Is Provably Efficient for RLHF

Di Wu Electrical, NJ 08540 cs1083@princeton.edu Jing Yang Electrical, VA 22903 yangjing@virginia.edu &Cong Shen Electrical, VA 22903 cong@virginia.edu

University of Virginia, Princeton University

6D位姿估计

本文针对RLHF理论中偏好反馈与KL正则目标带来的分析难题,尤其是既有结果多依赖BT模型及乐观/悲观置信构造的限制,证明在一般偏好模型下直接基于经验估计的贪婪采样已足够高效。核心洞察是KL正则使最优策略相对参考策略具有有界似然比结构。结果给出在线O(log T)遗憾与离线O(ε^-1)样本复杂度,并在BT模型和仿真中得到匹配验证。

GeVI-SLAM: Gravity-Enhanced Stereo Visua Inertial SLAM for Underwater Robots Figure 1
arXiv preprint2025-10-28

GeVI-SLAM: Gravity-Enhanced Stereo Visua Inertial SLAM for Underwater Robots

Yuan Shen, Yuze Hong, Guangyang Zeng, Tengfei Zhang, Pui Yi Chui, Ziyang Hong, Junfeng Wu

School of Data Science, Chinese University of Hong Kong, Shenzhen, China, School of Life Sciences, Chinese University of Hong Kong, China

6D位姿估计相机位姿机器人操作多视角

面向水下机器人在弱纹理、近退化几何和低加速度下视觉惯性 SLAM 易初始化不稳、外点多的问题,GeVI-SLAM 利用双目已知尺度先稳健估计重力,再用重力约束将跟踪降为 yaw+平移的 4-DOF PnP,并配合无偏估计与自适应 6-DOF 融合。仿真和水池实验显示其较 ORB-SLAM3、VINS-Fusion、SVIN2 具有更低 ATE/RPE 和更稳定跟踪,但仍缺少回环与折射建模。

Contributions to Semialgebraic-Set-Based Stability Verification of Dynamical Systems with Neural-Network-Based Controllers Figure 1
arXiv preprint2025-10-28

Contributions to Semialgebraic-Set-Based Stability Verification of Dynamical Systems with Neural-Network-Based Controllers

PAGE 1

6D位姿估计

针对神经网络控制器闭环系统难以验证稳定性的问题,本文改进基于半代数集合的 Lyapunov/SDP 验证框架:设计近似 softplus 与 tanh 性质的半代数激活函数,将方法扩展到 REN 等更广网络,并用更丰富的 Lyapunov 参数化与直接优化 RoA 的 SDP 序列降低保守性。两个数值例子显示可分析系统类别扩大、局部吸引域内估计更好,但效果主要限于仿真验证。

Global-State-Free Obstacle Avoidance for Quadrotor Control in Air-Ground Cooperation Figure 1
IEEE Robotics and Automation Letters2025-10-28

Global-State-Free Obstacle Avoidance for Quadrotor Control in Air-Ground Cooperation

Baozhe Zhang2, Xinwei Chen2, Qingcheng Chen, Chao Xu, Fei Gao, Yanjun Cao

Huzhou University, Zhejiang University, State Key Laboratory of Industrial Control Technology, Zhejiang University of Technology, Shandong Special Equipment Inspection Institute, Shanghai Institute of Quality Inspection and Technical Research

6D位姿估计

针对CoNi-MPC在空地协同中依赖相对状态但缺少环境感知、难以保证无人机避障安全的问题,论文提出CoNi-OA:在UGV非惯性坐标系内用单帧机载LiDAR点云构造速度调制矩阵,无需全局状态、建图或障碍预测即可生成局部无碰轨迹。实机覆盖跟随、绕飞和定向降落,约4000点下轨迹生成平均4.91 ms,并在仿真中相较Ego-Planner、VO/AVO获得更高成功率。

Beyond Objects: Contextual Synthetic Data Generation for Fine-Grained Classification Figure 1
arXiv preprint2025-10-28

Beyond Objects: Contextual Synthetic Data Generation for Fine-Grained Classification

William Yang : 2, Xindi Wu : 2, Zhiwei Deng : 3, Esin Tureci : 2, Google DeepMind : 3 williamyang@cs.princeton.edu

Princeton University 2 2 footnotemark, Google DeepMind 3 3 footnotemark

6D位姿估计仿真到现实

本文针对少样本细粒度分类中 T2I 合成数据易因少量实图微调而过拟合、样本多样性下降的问题,提出 BOB:用 caption 模型抽取背景、姿态等类无关上下文,微调时显式条件化,生成时跨类采样并边缘化,以削弱伪相关并保留生成先验。实验覆盖多模型、骨干和数据集,BOB 在 24 个设置中 18 个优于既有方法,Aircraft 上较 DataDream 提升 7.4%。

A least squares finite element method for backward parabolic problems Figure 1
arXiv preprint2025-10-27

A least squares finite element method for backward parabolic problems

Harald Monsuur

6D位姿估计

尽管仓库归为6D Pose,论文实际聚焦反向抛物方程这类病态数值问题:解可能不存在且对数据极敏感。作者在弱形式和较低正则假设下建立非齐次问题的条件稳定性,并据此设计带Tikhonov正则的最小二乘有限元法;通过构造测试空间处理对偶范数,给出先验误差界,数值实验验证了理论收敛行为。

Benchmarking VQE Configurations: Architectures, Initializations, and Optimizers for Silicon Ground State Energy Figure 1
arXiv preprint2025-10-27

Benchmarking VQE Configurations: Architectures, Initializations, and Optimizers for Silicon Ground State Energy

Z. Boutakka, N. Innan, M. Shafique, M. Bennai, Z. Sakhi

6D位姿估计数据集/基准

针对硅原子基态能量计算中经典精确方法开销高、VQE 对线路与优化配置敏感的问题,本文系统比较多种 ansatz、初始化和优化器组合,形成面向量子化学模拟的配置基准。结果显示初始化对收敛稳定性影响最大,零初始化更快更稳;UCCSD 等化学启发 ansatz 结合 ADAM 可获得更可靠、更精确的能量估计。

DeepSalt: Bridging Laboratory and Satellite Spectra through Domain Adaptation and Knowledge Distillation for Large-Scale Soil Salinity Estimation Figure 1
arXiv preprint2025-10-27

DeepSalt: Bridging Laboratory and Satellite Spectra through Domain Adaptation and Knowledge Distillation for Large-Scale Soil Salinity Estimation

Rupasree Dey, Abdul Matin, Everett Lewark, Tanjim Bin Faruk, Andrei Bachinin, Sam Leuthold, M. Francesca Cotrufo, Shrideep Pallickara, Sangmi Lee Pallickara

Colorado State University

6D位姿估计仿真到现实航天器

针对实验室土壤光谱精确但难以规模化、卫星高光谱覆盖广却噪声大且盐分信号微弱的问题,DeepSalt用Transformer学生模型融合EnMAP光谱、土壤与气象变量,并通过知识蒸馏和Spectral Adaptation Unit把FTIR教师模型的盐分表征迁移到卫星域。实验显示其较无显式域适应和传统方法预测更准,并能推广到未见地区,但具体增益幅度文中片段未充分说明。

Policies over Poses: Reinforcement Learning based Distributed Pose-Graph Optimization for Multi-Robot SLAM Figure 1
arXiv preprint2025-10-26

Policies over Poses: Reinforcement Learning based Distributed Pose-Graph Optimization for Multi-Robot SLAM

Sai Krishna Ghanta, Ramviyas Parasuraman

University of Georgia

6D位姿估计相机位姿机器人操作

针对多机器人 SLAM 中分布式位姿图优化易受非凸性、初值和外点影响的问题,论文将 PGO 建模为局部可观测多智能体强化学习任务,用边条件 GNN 与自适应门控做约束去噪,并以混合策略逐边修正平面位姿、再经共识对齐全局图。实验显示其相较现有分布式 PGO 平均多降低 37.5% 全局目标,推理至少快 6 倍,且策略复制可扩展到更大机器人团队。

LVD-GS: Gaussian Splatting SLAM for Dynamic Scenes via Hierarchical Explicit-Implicit Representation Collaboration Rendering Figure 1
arXiv preprint2025-10-26

LVD-GS: Gaussian Splatting SLAM for Dynamic Scenes via Hierarchical Explicit-Implicit Representation Collaboration Rendering

Wenkai Zhu, Xu Li, Qimin Xu, Benwu Wang, Kun Wei, Yiming Peng, Zihang Wang

Southeast University

6D位姿估计相机位姿三维重建高斯泼溅

面向动态室外场景中3DGS-SLAM易受单一表示、尺度漂移和动态物体干扰影响的问题,LVD-GS融合LiDAR与视觉,引入几何、语义和DINO特征的层级协同渲染,并用开放世界分割结合DINO-Depth不确定性残差生成细粒度动态掩码。在KITTI、nuScenes和自采数据上,论文报告其在位姿估计与新视角合成上优于现有3DGS-SLAM方法。

Cross-Species Transfer Learning in Agricultural AI: Evaluating ZebraPose Adaptation for Dairy Cattle Pose Estimation Figure 1
arXiv preprint2025-10-26

Cross-Species Transfer Learning in Agricultural AI: Evaluating ZebraPose Adaptation for Dairy Cattle Pose Estimation

PAGE 1, 1 of 20

Neethirajan 1,2, Faculty of Computer Science, Dalhousie University, University Avenue, Halifax

6D位姿估计

针对奶牛关键点标注稀缺、真实牛舍部署困难的问题,本文将合成斑马图像训练的 ZebraPose 迁移到奶牛 27 关键点估计,并比较自采 375 张牛舍图、APT-36K 子集及合并训练。结果显示合并模型在同分布测试上可达 AP 0.86、AR 0.87、PCK@0.5 0.869,但在未见牛舍和牛群上明显失效,核心洞察是形态相似不足以弥合合成到真实与环境域差距。

SABlock: Semantic-Aware KV Cache Eviction with Adaptive Compression Block Size Figure 1
arXiv preprint2025-10-26

SABlock: Semantic-Aware KV Cache Eviction with Adaptive Compression Block Size

Jinhan Chen, Jianchun Liu, Hongli Xu, Xianjun Gao, Shilong Wang

6D位姿估计

长上下文 LLM 推理中 KV cache 随序列线性增长,成为显存与吞吐瓶颈;SABlock 的核心洞察是淘汰边界应贴合语义结构,而非固定 token/块/句子粒度,因此结合语义分段、段引导 token 重要性评分和预算驱动的自适应块大小搜索。在长上下文基准上,它以 96 个 KV 条目达 99.9% NIAH 检索准确率,并在 128K 上降低 46.28% 峰值显存、最高加速 9.5×。

DynaPose4D: High-Quality 4D Dynamic Content Generation via Pose Alignment Loss Figure 1
arXiv preprint2025-10-26

DynaPose4D: High-Quality 4D Dynamic Content Generation via Pose Alignment Loss

Jing Yang

6D位姿估计

针对单图或视频生成4D动态内容时易受视角变化影响、时序依赖和动态几何不一致的问题,DynaPose4D将4D Gaussian Splatting与类别无关姿态估计CAPE结合,先由单图构建3D高斯,再用多视角关键点与姿态对齐损失监督形变轨迹,以提升运动一致性。实验报告其在动态物体生成中获得更连贯、稳定和流畅的结果,但具体量化增益与消融细节文中未充分说明。

EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model Figure 1
Lecture notes in computer science2025-10-25

EndoSfM3D: Learning to 3D Reconstruct Any Endoscopic Surgery Scene using Self-supervised Foundation Model

Changhao Zhang, Matthew J. Clarkson, Mobarak I. Hoque

University College London, The London College, University of Manchester

6D位姿估计医学/手术

内窥镜手术三维重建常受无菌约束、连续变焦和斜视镜旋转影响,难以可靠标定内参。EndoSfM3D将内参预测并入基于重投影一致性的自监督单目深度框架,利用DA2基础模型、DoRA高效微调和注意力位姿网络联合估计深度、位姿与内参。在SCARED和C3VD上取得AbsRel 0.050/0.058,并将焦距误差控制在2%以内、主点误差低于10%。

Breaking the Static Assumption: A Dynamic-Aware LIO Framework Via Spatio-Temporal Normal Analysis Figure 1
IEEE Robotics and Automation Letters2025-10-25

Breaking the Static Assumption: A Dynamic-Aware LIO Framework Via Spatio-Temporal Normal Analysis

Zhiqiang Chen, Cedric Le Gentil, Fuling Lin, Minghao Lu, Qiyuan Qiao, Bowen Xu, Yuhua Qi, Peng Lu

University of Hong Kong, University of Toronto, Institute for Christian Studies, Sun Yat-sen University

6D位姿估计

面向动态物体占主导、静态几何稀疏时传统 LIO 因静态世界假设而失效的问题,论文将动态感知嵌入 ICP 配准本身,用时空法向分析打破“先有准确位姿才能判动态、先剔动态才能定位”的循环,并以空间一致性验证构建更干净的静态地图。实验表明其在高动态、几何退化场景中较现有 LIO 更稳健,代码和数据集已开源。

Sharp restrictions of analytic function spaces of several variables Figure 1
arXiv preprint2025-10-25

Sharp restrictions of analytic function spaces of several variables

R. F. Shamoyan, N. M. Makhina

6D位姿估计

该文并非6D位姿估计论文,而是围绕多复变量解析函数空间的迹问题:动机是为Rudin提出的多圆盘Hardy空间迹估计寻找更精确的推广。核心在于系统整理并扩展管状域、强拟凸光滑有界域中迹算子与Bergman型投影的关系,给出多类Hardy、Bergman及混合范数空间的尖锐迹描述、估计和若干开放问题。

GSAlign: Geometric and Semantic Alignment Network for Aerial-Ground Person Re-Identification Figure 1
arXiv preprint2025-10-25

GSAlign: Geometric and Semantic Alignment Network for Aerial-Ground Person Re-Identification

Qiao Li, Jie Li, Yukang Zhang, Lei Tan, Jing Chen, Trusted Computing, Ministry of Education, School of Cyber Science, Engineering, lei.tan@nus.edu.sg

Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University, Xiamen University, National University of Singapore

6D位姿估计航天器

针对无人机俯视与地面监控视角差异导致的行人重识别几何畸变、遮挡和语义错位,GSAlign在ViT框架中联合建模两类对齐:用可学习薄板样条基于关键点逐层弯曲特征,并用动态可见性掩码突出可见身体区域。在CARGO四种协议上,相比既有SOTA取得mAP +18.8%、Rank-1 +16.8%的提升。

Partially Retargeted Balancing Weights for Causal Effect Estimation Under Positivity Violations Figure 1
arXiv preprint2025-10-24

Partially Retargeted Balancing Weights for Causal Effect Estimation Under Positivity Violations

Introduction

6D位姿估计

本文针对观测研究中倾向得分重叠不足/正性违背导致 IPW 高方差、直接平衡权重无解的问题,提出“部分重定向”平衡权重:有选择地放松部分协变量平衡约束,在尽量保持原 ATE 目标的同时改善可解性与方差。理论上给出一致性条件、放宽正性假设和渐近方差降低结果,并在合成数据、EHR 研究及 RCT 外推任务中验证其作为直接平衡与 overlap weights 之间折中方案的效果。

Training data membership inference via Gaussian process meta-modeling: a post-hoc analysis approach Figure 1
arXiv preprint2025-10-22

Training data membership inference via Gaussian process meta-modeling: a post-hoc analysis approach

Yongchao Huang 1 yongchao.huang@abdn.ac.uk, Pengfei Zhang 2 pf.zhang@binance.com, Shahzad Mumtaz 3 shahzad.mumtaz@abdn.ac.uk

6D位姿估计高斯泼溅

针对成员推断攻击依赖影子模型、频繁查询或内部梯度而难以落地的问题,本文提出 GP-MIA:用单个已训练模型的后验指标(准确率、熵、数据统计及可选梯度/NTK敏感性)训练高斯过程元分类器,并输出校准不确定性。实验覆盖合成数据、欺诈检测、CIFAR-10 与 WikiText-2,显示其在不同域上保持较高准确率和泛化性;但与6D位姿/高斯泼溅关联不明显。

Multi-Agent Pose Uncertainty: A Differentiable Rendering Cramér-Rao Bound Figure 1
arXiv preprint2025-10-18

Multi-Agent Pose Uncertainty: A Differentiable Rendering Cramér-Rao Bound

Arun Muthukkumar Illinois Mathematics, Science Academy amuthukkumar@imsa.edu

Illinois Mathematics and Science Academy

6D位姿估计

针对神经渲染用于6D位姿估计时缺少严格不确定性刻画的问题,本文把可微渲染器视为稠密光度观测模型,在SE(3)切空间线性化并由像素雅可比构造Fisher信息,得到渲染感知CRB;其特征值可解释纹理、视差和对称性导致的可观性差异,并可通过相机间信息相加扩展到多智能体。实验称该界与扰动重配准误差及BA协方差接近,高纹理场景精度更高,退化场景给出大方差。

Group Inertial Poser: Multi-Person Pose and Global Translation from Sparse Inertial Sensors and Ultra-Wideband Ranging Figure 1
arXiv preprint2025-10-24

Group Inertial Poser: Multi-Person Pose and Global Translation from Sparse Inertial Sensors and Ultra-Wideband Ranging

Ying Xue, Jiaxi Jiang, Rayan Armani, Dominik Hollidt, Yi-Chi Liao, ETH Zürich

Department of Computer Science, ETH Zürich, Switzerland

6D位姿估计

针对纯 IMU 多人动捕缺少外部空间参照、全局平移和相对位置易漂移的问题,GIP 将稀疏 IMU 与同人/跨人 UWB 测距融合,用结构化状态空间模型估计姿态,并通过两步优化对齐共享世界坐标和轨迹。论文还发布 14 人、200 分钟的 GIP-DB,实验显示其在合成与真实数据上较既有方法提升姿态、平移精度与鲁棒性。

Uniform Convergence Beyond Glivenko-Cantelli Figure 1
arXiv preprint2025-10-24

Uniform Convergence Beyond Glivenko-Cantelli

Tanmay Devale, Pramith Devulapalli, Steve Hanneke

Pramith Devulapalli, Purdue University

6D位姿估计

本文动机是解释在经验均值失效、甚至不满足传统 Glivenko-Cantelli 条件时,哪些分布族仍可对可数二值坐标的均值做一致估计。核心创新是把问题转向任意估计器下的 UME 可学习性,并在均值向量空间中刻画条件。主要结果证明均值向量可分足以保证可学习、可数个 UME 可学习族的并仍可学习,并构造了非可分但仍可学习的反例,说明可分性并非必要条件。

Gaussian Processes for Inferring Parton Distributions Figure 1
Journal of High Energy Physics2025-11-03

Gaussian Processes for Inferring Parton Distributions

Yamil Cahuana Medrano, Hervé Dutrieux, Joseph Karpie, Kostas Orginos, Savvas Zafeiropoulos, on behalf of the HadStruc Collaboration

Centre de Physique Théorique

6D位姿估计高斯泼溅

该文针对从有限且含噪的格点 QCD 矩阵元反推出部分子分布函数这一病态逆问题,提出用贝叶斯高斯过程作为非参数先验来统一处理正则化、相关性与物理约束,并系统比较核函数、均值函数和超参数处理。合成数据实验显示该方法能稳定重建分布、给出受控不确定性,并通过 KL 散度量化数据带来的信息增益,但低 x 区域仍受 Ioffe 时间覆盖限制。

BioDet: Boosting Industrial Object Detection with Image Preprocessing Strategies Figure 1
arXiv preprint2025-10-23

BioDet: Boosting Industrial Object Detection with Image Preprocessing Strategies

Jiaqi Hu, Hongli Xu, Junwen Huang, Peter KT Yu Slobodan Ilic, XYZ Robotics @tum.de, peter.yu@xyzrobotics.com github.com/jacky-hjqq/BioDet

Technical University of Munich, XYZ Robotics

6D位姿估计

面向工业抓取中的6D位姿估计,论文指出瓶颈常在前端检测:弱光、反光、堆叠和复杂背景会让SAM/DINO类未见物体检测产生大量误匹配。BioDet将低光增强、Grounding-DINO提示式背景过滤与DINOv2模板匹配串成可插拔预处理管线,以缩小渲染模板与真实图像域差并压制背景候选;在BOP工业bin-picking基准上显著提升检测精度,且推理开销很小。

ROPES: Robotic Pose Estimation via Score-Based Causal Representation Learning Figure 1
arXiv preprint2025-10-23

ROPES: Robotic Pose Estimation via Score-Based Causal Representation Learning

Pranamya Kulkarni, Puranjay Datta, Burak Varıcı, Emre Acartürk, Karthikeyan Shanmugam, Ali Tajer

Google DeepMind, Carnegie Mellon University, Rensselaer Polytechnic Institute

6D位姿估计机器人操作

本文针对机器人位姿估计对标注和物理模型依赖强的问题,将关节角视为可被执行器干预的因果生成因子,提出基于 score 差分稀疏性的无监督 CRL 框架 ROPES,从不同控制分布下的图像中恢复可控潜变量。半合成机械臂实验显示,其能较高保真地解耦关节相关因素,并优于所比较的半监督基线;但验证仍主要停留在半合成设置,真实机器人泛化文中未充分说明。

CUPID: Generative 3D Reconstruction via Joint Object and Pose Modeling Figure 1
arXiv preprint2025-11-24

CUPID: Generative 3D Reconstruction via Joint Object and Pose Modeling

Binbin Huang, Haobin Duan, Yiqun Zhao, Zibo Zhao, Yi Ma, Transcengram

The University of Hong Kong, Tencent

6D位姿估计三维重建

针对单图三维重建中生成模型缺少相机位姿、重建模型又难补全遮挡的问题,Cupid 将规范物体与相机位姿作为联合后验建模:先用流模型生成粗三维结构和密集 2D-3D 对应用 PnP 求位姿,再按位姿注入像素对齐特征细化形状与纹理。结果显示其在保真度上较现有方法提升超过 3 dB PSNR、Chamfer Distance 改善约 10%,并可前向扩展到多视图和组件对齐场景重建。

Resounding Acoustic Fields with Reciprocity Figure 1
arXiv preprint2025-10-23

Resounding Acoustic Fields with Reciprocity

Zitong Lan, Yiduo Hao, Mingmin Zhao

University of Pennsylvania

6D位姿估计

本文面向 AR/VR 中声源可移动但扬声器难以密集布设的问题,提出“resounding”任务:由少量发声点估计任意位置的房间脉冲响应。核心洞察是利用声传播互易性,将发声器与听者位置交换生成物理有效的虚拟训练样本,并用自监督一致性处理设备方向增益不对称。实验在仿真和真实数据上提升 C50、STFT 等指标,用户研究也显示空间听感更真实。

Addressing Mark Imbalance in Integration-free Neural Marked Temporal Point Processes Figure 1
arXiv preprint2025-10-24

Addressing Mark Imbalance in Integration-free Neural Marked Temporal Point Processes

Victoria 3000 xiuzhen.zhang@rmit.edu.au

RMIT University, Macquarie University

6D位姿估计

本文关注标记时间点过程在真实事件流中常见的标记长尾问题:稀有标记虽重要却易被高频标记淹没。作者的关键思路是先预测标记再预测时间,并用按先验归一化后的可学习阈值校准标记概率;同时提出 IFNMTPP,将两个不适定积分统一并用无积分神经模型近似,以降低时间采样和标记概率估计成本。真实数据实验显示其在下一事件标记与时间预测上优于多种基线,但与6D位姿估计关联不明显。

Tri-Modal Severity Fused Diagnosis across Depression and Post-traumatic Stress Disorders Figure 1
arXiv preprint2025-10-23

Tri-Modal Severity Fused Diagnosis across Depression and Post-traumatic Stress Disorders

Filippo Cenacchi, Deborah Richards, Longbing Cao

Manuscript submitted to IEEE Transactions on Affective Computing

6D位姿估计

针对抑郁与PTSD常共病、传统自动评估多为单病种二分类且缺少严重度解释的问题,本文将访谈文本、语音声学和面部行为三模态同步后做校准后期融合,同时输出PHQ-8五级和PTSD三级严重度及特征归因。在DAIC衍生数据的分层交叉验证中,融合模型相对单模态/消融基线提升了决策曲线效用、缺失或噪声模态下的鲁棒性,并在PTSD上降低回归误差、改善类别一致性;抑郁主要依赖文本,PTSD更依赖音频和面部线索。

Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists Figure 1
arXiv preprint2025-10-23

Monocular Visual 8D Pose Estimation for Articulated Bicycles and Cyclists

Eduardo R. Corral-Soto, Yang Liu, Yuan Ren, Bai Dongfeng, Liu Bingbing

6D位姿估计

面向自动驾驶中骑行者意图预测与避碰,论文指出刚体6D位姿难以表达车把、脚踏转动导致的包围盒和真实行进方向偏差。其提出单目RGB类别级8D估计,将车身6D与车把/脚踏角、3D关键点联合回归,并用参数化自行车模型和2D投影监督结合合成/真实数据训练。实验显示其8D参数估计有一定可行性,和类别级6D方法相比取得有竞争力结果,但单目平移误差与小部件遮挡仍是主要限制。

AI Pose Analysis and Kinematic Profiling of Range-of-Motion Variations in Resistance Training Figure 1
arXiv preprint2025-10-22

AI Pose Analysis and Kinematic Profiling of Range-of-Motion Variations in Resistance Training

1 Introduction

6D位姿估计人体姿态

针对力量训练中“全程/拉长位半程”动作缺少可量化关节角定义、难以形成教练建议的问题,本文用五种深度姿态估计模型和统一信号处理,从303段上肢训练视频提取逐次ROM与时长,并用交叉随机效应模型分析差异。结果显示,pROM显著缩小活动范围但不缩短重复时间,平均约为fROM的56%,且不同动作和个体差异更大,说明拉长位半程并非固定比例动作,需要更明确的执行提示。

PoseCrafter: Extreme Pose Estimation with Hybrid Video Synthesis Figure 1
arXiv preprint2025-10-22

PoseCrafter: Extreme Pose Estimation with Hybrid Video Synthesis

Qing Mao ​​, Tianxin Huang ​​, Yu Zhu ​​, Jinqiu Sun ​​, Yanning Zhang ​​, Data Science, ynzhang@nwpu.edu.cn

School of Computer Science, Northwestern Polytechnical University, School of Computing, National University of Singapore, School of Computing and Data Science, The University of Hong Kong, School of Astronautics, Northwestern Polytechnical University

6D位姿估计

针对小重叠甚至无重叠图像对中可靠匹配稀缺、现有插帧方法中间帧模糊且选帧与位姿目标脱节的问题,PoseCrafter提出免训练的混合视频生成:用DynamiCrafter找近端中继帧,再以ViewCrafter生成更清晰的受位姿约束视图,并用RANSAC内点数驱动的特征匹配选择器挑帧。其在Cambridge、ScanNet、DL3DV-10K和NAVI上提升极端相对位姿估计,尤其改善小/无重叠场景。

PRGCN: A Graph Memory Network for Cross-Sequence Pattern Reuse in 3D Human Pose Estimation Figure 1
arXiv preprint2025-10-22

PRGCN: A Graph Memory Network for Cross-Sequence Pattern Reuse in 3D Human Pose Estimation

Zhuoyang Xie, Yibo Zhao, Hui Huang

6D位姿估计人体姿态

针对单目 2D 到 3D 人体姿态提升中的深度歧义,以及现有视频方法只在单序列内建模、难以复用跨序列重复动作模式的问题,PRGCN 将姿态估计改写为模式检索与适配:用图记忆库存储姿态原型,经注意力检索后与解剖约束融合,并结合 Mamba 与自注意力提取时空特征。在 Human3.6M 和 MPI-INF-3DHP 上分别达到 37.1mm、13.4mm MPJPE,报告为新的 SOTA,并显示更好的跨域泛化。

A New Targeted-Federated Learning Framework for Estimating Heterogeneity of Treatment Effects: A Robust Framework with Applications in Aging Cohorts Figure 1
arXiv preprint2025-10-22

A New Targeted-Federated Learning Framework for Estimating Heterogeneity of Treatment Effects: A Robust Framework with Applications in Aging Cohorts

Rong Zhao, Jason Falvey, Xu Shi, Vernon M. Chinchilli, Chixiang Chen

Department of Public Health Sciences, Penn State College of Medicine, Department of Physical Therapy and Rehabilitation Science, University of Maryland School of Medicine, Department of Biostatistics, University of Michigan, Ann Arbor, Department of Epidemiology and Public Health

6D位姿估计

针对多机构医疗数据中个体级数据难共享、目标人群与外部来源存在分布差异且需估计治疗效应异质性的问题,论文提出基于投影估计量的 targeted-federated HTE 框架,引入双重稳健估计、密度比校准和单轮通信的 bootstrap 来源筛选以避免负迁移;仿真显示其较现有方法更高效且偏差更小,并在 Medicare 髋部骨折队列中验证了实用性。

Kinematic Analysis and Integration of Vision Algorithms for a Mobile Manipulator Employed Inside a Self-Driving Laboratory Figure 1
International Journal of Intelligent Robotics and Applications2025-10-21

Kinematic Analysis and Integration of Vision Algorithms for a Mobile Manipulator Employed Inside a Self-Driving Laboratory

Tobias Busk Jensen, Stefan Hein Bengtson, Simon Bøgh

Aalborg University

6D位姿估计人体姿态

面向自驱动化学实验室中光照、遮挡和杂乱导致的抓取不稳定问题,论文将移动机械臂的 DH 运动学/逆解与 RGB-D 视觉管线结合,用特征匹配、单应性位姿估计和深度信息把纹理物体定位到三维空间以指导跟随与抓取。系统在仿真和真实实验中验证了位姿误差与抓取成功率等指标,但具体数值与相对增益在给定文本中未充分说明。

UniHPR: Unified Human Pose Representation via Singular Value Contrastive Learning Figure 1
arXiv preprint2025-10-21

UniHPR: Unified Human Pose Representation via Singular Value Contrastive Learning

Zhongyu Jiang, Wenhao Chai, Lei Li, Zhuoran Zhou, Cheng-Yen Yang, lilei@di.ku.dk

University of Washington, University of Copenhagen

6D位姿估计人体姿态

UniHPR针对图像、2D关键点与3D骨架等人体姿态表征长期割裂、难以在统一空间中互用的问题,提出同时对齐三种模态的统一表示框架,并用基于奇异值的监督对比损失扩展多模态InfoNCE。结合简单姿态解码器后,文中在Human3.6M上达到49.9 mm MPJPE,在3DPW跨域评测中达到51.6 mm PA-MPJPE,并支持2D/3D姿态检索。

$B$ -sure I: Minkowski functionals as robustness test for tensor-to-scalar ratio detection from CMB observations Figure 1
arXiv preprint2025-10-21

$B$ -sure I: Minkowski functionals as robustness test for tensor-to-scalar ratio detection from CMB observations

Claudio Ranucci, Alessandro Carones, Léo Vacher, Nicoletta Krachmalnicoff, Carlo Baccigalupi

6D位姿估计

面向未来 CMB 任务中原初 B 模偏振与张量标量比 r 的可靠探测,论文检验 Minkowski 泛函能否作为前景残留导致偏差的非高斯鲁棒性空检验。作者用 LiteBIRD 类模拟、盲成分分离和受污染图与高斯实现的 MF 对比,核心洞察是该经典形态统计量灵敏度不足:最现实设置仅约 26% 情况能报警,约 74% 的偏置 r 不会被发现,提示需更强的高阶统计方法。

PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splatting Figure 1
arXiv preprint2025-10-21

PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splatting

Changkun Liu, Bin Tan : 1, Zeran Ke, Shangzhan Zhang, Jiachen Liu, Ming Qian, Nan Xue, Yujun Shen, Technology

The Hong Kong University of Science and Technology Ant Group, Wuhan University Zhejiang University The Pennsylvania State University

6D位姿估计三维重建

面向室内数字孪生中相机位姿难获取、点云表示冗余且平面标注昂贵的问题,Plana3R将未定姿双目图像直接映射为具度量尺度的稀疏3D平面基元和相对位姿,并用可微平面splatting从深度/法线监督学习,避免显式平面标注。实验显示其在跨数据集的表面重建、深度、相对位姿和实例级平面分割上具备较强零样泛化,但增益可能部分来自大规模室内数据训练。

Distributional regression for seasonal data: an application to river flows Figure 1
arXiv preprint2025-10-21

Distributional regression for seasonal data: an application to river flows

Samuel Perreault, Silvana M. Pesenti, Daniyal Shahzad

6D位姿估计

针对洪水保险风险评估只关注极端值、难以刻画日常与中等流量变化的问题,本文提出面向季节数据的分布回归框架:以 GAMLSS 思路让广义伽马分布参数随年内周期和长期趋势平滑变化,并在忽略显式时间依赖时修正推断。作者在加拿大 Fraser River 三个水文站日流量上验证,模型能较好拟合季节形态及趋势,并用于分析 2021 年初冬洪水。

Privacy-Preserving Healthcare Data in IoT: A Synergistic Approach with Deep Learning and Blockchain Figure 1
The Journal of Supercomputing2025-10-21

Privacy-Preserving Healthcare Data in IoT: A Synergistic Approach with Deep Learning and Blockchain

Behnam Rezaei Bezanjani, Seyyed Hamid Ghafouri, Reza Gholamrezaei

Islamic Azad University Kerman

6D位姿估计

面向医疗物联网中敏感数据易受攻击、设备异构且资源受限的问题,论文提出三阶段安全框架:基于声誉的设备信任评估、结合链下存储的轻量级区块链 PoW,以及轻量 LSTM 异常检测。仿真在两个数据集上覆盖十余类攻击,相比近作精度、准确率和召回率约提升 2%,检测率提升 5%,误报率降低 3%;但增益来源与实际部署开销文中未充分说明。

RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimation Figure 1
arXiv preprint2025-10-21

RayPose: Ray Bundling Diffusion for Template Views in Unseen 6D Object Pose Estimation

Junwen Huang, Shishir Reddy Vutukur, Peter KT Yu, Nassir Navab, Slobodan Ilic, Benjamin Busam

Technical University of Munich, Munich Center for Machine Learning, XYZ Robotics

6D位姿估计物体位姿

RayPose针对模板式未见物体6D位姿估计中过度依赖“最近模板检索”、一旦检索错误即传导到位姿的问题,将多模板与查询图像的关系改写为物体中心射线束对齐。方法把旋转表示为图像网格上的物体中心相机射线,并将尺度不变平移扩展为稠密偏移,在扩散Transformer中联合推理,再用窄化模板采样做粗到细训练。实验显示其在多个BOP相关基准上相对现有未见物体方法具有竞争力,但仍依赖CAD渲染模板和较准的检测输入。

Biomechanically consistent real-time action recognition for human-robot interaction Figure 1
arXiv preprint2025-10-21

Biomechanically consistent real-time action recognition for human-robot interaction

Wanchen Li, Kahina Chalabi, Sabbah Maxime, Thomas Bousquet, Robin Passama, Sofiane Ramdani, Andrea Cherubini, Vincent Bonnet

Centre National de la Recherche Scientifique

6D位姿估计机器人操作医学/手术

面向工业人机协作中连续动作需在线识别、且2D关键点受噪声和视角影响的问题,论文将双相机RTMPose、三角化/LSTM增强与符合生物力学约束的逆运动学结合,用22维关节角替代全局关节点坐标输入带因果时间平滑的Transformer。其在自建HUMAR-2024连续数据集上优于JCP基线,准确率约88%,并能在模拟机器人控制实验中实时触发交互;但数据规模仅11人,泛化结论仍受限制。

Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Models Figure 1
arXiv preprint2025-10-21

Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Models

CA 92093 vvinod@ucsd.edu

Department of Computer Science

6D位姿估计

针对3D感知人脸生成中属性编辑依赖大规模标注、体渲染训练昂贵且易破坏多视角一致性的问题,本文直接在StyleGANv2/MPI模型潜空间中用不超过10组合成属性样本估计可解耦编辑方向,并结合顺序编辑与PTI反演。实验显示其在眼镜、表情、老化等编辑上能较好保持身份和3D视角一致性,定量结果优于所比较基线,但增益对合成样本构造与预训练GAN先验的依赖仍需进一步验证。

Adapting Stereo Vision From Objects To 3D Lunar Surface Reconstruction with the StereoLunar Dataset Figure 1
arXiv preprint2025-10-20

Adapting Stereo Vision From Objects To 3D Lunar Surface Reconstruction with the StereoLunar Dataset

Clémentine Grethen, Simone Gasparini, Géraldine Morin IRIT, Toulouse INP, Université de Toulouse, France @irit.fr, Jérémy Lebreton, Lucas Marti Airbus Defence, Space @airbus.com

Clémentine Grethen, Simone Gasparini, Géraldine Morin

6D位姿估计数据集/基准多视角三维重建

月面低纹理、强光照变化和近天底轨迹使传统 SfM/MVS 及地面数据训练的深度模型难以可靠重建。论文构建基于 DEM、BRDF 与光线追踪的 LunarStereo 月球双目数据集,并用其微调 MASt3R 以适配月面域。在合成与真实月球数据上,微调模型相较零样本基线显著改善三维地形与相对位姿估计,坡度误差平均降低超 70%,相对精度约提升 50%。

Raindrop GS: A Benchmark for 3D Gaussian Splatting under Raindrop Conditions Figure 1
arXiv preprint2025-10-20

Raindrop GS: A Benchmark for 3D Gaussian Splatting under Raindrop Conditions

Zhiqiang Teng, Tingting Chen, Beibei Lin, Zifeng Yuan, Xuanyi Li, Xuanyu Zhang, tinting.c@u.nus.edu beibei.lin@u.nus.edu, zyuan@u.nus.edu 24110477@bjtu.edu.cn, 24115169@bjtu.edu.cn, slzhang@bjtu.edu.cn

Beijing Jiaotong University, National University of Singapore

6D位姿估计数据集/基准三维重建高斯泼溅

真实雨滴会遮挡并扭曲镜头成像,破坏3DGS依赖的位姿估计和点云初始化,而既有评测多用合成雨滴和已知位姿,难以反映端到端误差。RaindropGS构建含雨滴对焦、背景对焦、无雨真值的真实配对场景,并把COLMAP/VGGT、去雨模型与多种3DGS纳入统一流程。实验主要揭示现有方法在无约束真实雨滴下明显受前处理和对焦设置限制,而非给出单一算法增益。

Quantum Synthetic Data Generation for Industrial Bioprocess Monitoring Figure 1
arXiv preprint2025-10-20

Quantum Synthetic Data Generation for Industrial Bioprocess Monitoring

1 Introduction

6D位姿估计仿真到现实

针对生物制造实验昂贵、在线质量指标难测导致的数据稀缺问题,本文将带梯度惩罚的量子 Wasserstein GAN用于工业生物过程时间序列合成,并以参数化量子线路作为生成器。实验聚焦用于干生物量估计的光密度数据,合成序列能较好复现实验历史数据的时间动态和统计特征;但相对经典GAN或机理模型的明确增益来源文中未充分说明。

PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception Figure 1
arXiv preprint2025-10-21

PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception

PAGE 1, Kaichen Zhou1

Harvard AI and Robotics Lab, Harvard University, Media Lab and Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Department of Computing, Imperial College London

6D位姿估计

PAGE-4D针对VGGT等前馈3D模型在动态场景中因运动物体破坏静态几何假设而位姿退化的问题,将动态信息按任务解耦:通过动态感知掩码与交叉注意力,在位姿估计中抑制运动区域、在深度和点云重建中强化其几何线索,并仅微调对动态敏感的层。实验显示其在动态基准上优于VGGT,如Sintel位姿ATE由0.214降至0.143,视频深度Abs Rel由0.484降至0.357,且额外开销很小。

Eliciting Truthful Feedback for Preference-Based Learning via the VCG Mechanism Figure 1
arXiv preprint2025-10-20

Eliciting Truthful Feedback for Preference-Based Learning via the VCG Mechanism

1 INTRODUCTION

6D位姿估计

针对资源分配中个体成本难以显式报告且可能策略性撒谎的问题,论文将偏好学习与 VCG 支付结合,用 D-optimal 设计选择成对偏好查询、MLE 估计线性成本,并据此分配与定价。理论上给出一次性场景约 O~(K^-1/2) 的近似诚实、个体理性和效率保证,在线场景获得 O~(T^2/3) 次线性遗憾,并在本地电力需求响应案例中验证。

Capturing Head Avatar with Hand Contacts from a Monocular Video Figure 1
arXiv preprint2025-10-20

Capturing Head Avatar with Hand Contacts from a Monocular Video

Haonan He, Yufeng Zheng, Technology ETH Zürich, Switzerland, Tübingen, Germany

The Hong Kong University of Science and Technology (Guangzhou), The Hong Kong University of Science and Technology, ETH Zürich, Switzerland, Max Planck Institute for Intelligent Systems, Tübingen, Germany

6D位姿估计手部姿态

这篇工作针对现有头部 Avatar 重建忽略手触脸导致相对位姿和接触形变不可信的问题,从单目 iPhone 视频联合建模头部、手部与接触形变。核心做法是在跟踪阶段引入深度顺序损失和接触正则,并用手致面部形变的 PCA 先验加物理启发接触损失约束非刚性形变。实验在真实 RGB(D) 与合成数据上显示,其外观保真度和面部变形几何优于现有重建方法。

KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation Figure 1
arXiv preprint2025-10-20

KineDiff3D: Kinematic-Aware Diffusion for Category-Level Articulated Object Shape Reconstruction and Generation

WenBo Xu, Liu Liu, Li Zhang, Ran Zhang, Hao Wu, Dan Guo, Technology of China

Hefei University of Technology, University of Science and Technology of China

6D位姿估计类别级位姿人体姿态三维重建

KineDiff3D面向笔记本、抽屉等关节物体,解决单视角下遮挡、关节状态多样导致的完整形状与6D/关节位姿耦合估计难题。其核心是用KA-VAE联合编码SDF、关节角和部件分割,并以两个条件扩散模型分别估计SE(3)/关节参数和生成运动学感知潜变量,再通过保持关节约束的Chamfer迭代优化双向细化。实验覆盖合成、半合成和真实数据,显示其在类别级重建与运动学参数估计上优于已有方法。

Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes Using Sparse Inertial Sensors Figure 1
arXiv preprint2025-10-20

Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes Using Sparse Inertial Sensors

Lu Yin, Ziying Shi, Yinghao Wu, Xinyu Yi, Feng Xu, Shihui Guo

Xiamen University, School of Informatics, Tsinghua University, School of Software and BNRist

6D位姿估计

该文针对稀疏 IMU 动捕长期默认成人模板、在儿童等不同体型上误差显著的问题,提出 SAIP 将体型相关的加速度/速度信号与姿态估计解耦:先把真实体型 IMU 信号重定向到成人模板,再估计动作并映射回真实体型,同时用稀疏 IMU 和身高估计体型。作者还采集含儿童与成人的 MID 数据集,实验显示其在多体型实时动捕上优于现有方法。

How Universal Are SAM2 Features? Figure 1
arXiv preprint2025-10-19

How Universal Are SAM2 Features?

Masoud Khairi Atani1, Alon Harell1, Hyomin Choi2, Runyu Yang1, Fabien Racapé2, USA @interdigital.com

Simon Fraser University, InterDigital AI Lab

6D位姿估计

本文关注通用视觉编码器被专门化为 SAM2 后,特征是否仍适合多任务/机器特征编码。作者冻结 Hiera 与 SAM2,仅训练轻量 Transformer neck,并提出 cross-neck 分析来度量连续适配造成的信息瓶颈。结果显示,SAM2 在深度等空间相关任务上受益,但在人/物体姿态估计与图像描述等语义距离更远任务上弱于 Hiera;蒸馏和更大 neck 可部分缓解损失。

Functional principal component analysis for functional data with detection limits Figure 1
arXiv preprint2025-10-19

Functional principal component analysis for functional data with detection limits

Haiyan Liu, Nijmegen, The Netherlands

Department of Statistics, University of Leeds, United Kingdom, Department of Mathematics, Radboud University, Nijmegen, The Netherlands

6D位姿估计

该文针对纵向/函数型数据中低于检测限导致的 MNAR 缺失问题,指出直接用阈值填补会偏置 FPCA 的特征函数与得分估计。作者基于检测限下的均值、协方差局部常数似然近似,进一步构造 FPC 与个体得分估计并给出渐近性质。仿真和生物标志物数据表明,相比标准填补法估计更准确;与仓库的 6D 位姿分类关联不清。

Sparse variational regularization with oversmoothing penalty term in the scale of sequence spaces Figure 1
arXiv preprint2025-10-19

Sparse variational regularization with oversmoothing penalty term in the scale of sequence spaces

Robert Plato, Bernd Hofmann

Department of Mathematics, University of Siegen, Chemnitz University of Technology, Faculty of Mathematics, Chemnitz, Germany

6D位姿估计

本文面向含确定性噪声的线性病态反问题,关注序列空间中稀疏先验与过平滑惩罚不匹配时的正则化可靠性。核心在于把ℓp范数惩罚与ℓ0计数惩罚统一到变分框架,并用硬阈值构造辅助元处理真解不在惩罚定义域的情形。主要结果给出稳定性证明、先验参数选择下的收敛速率,以及可作为后处理的稀疏化机制;与6D位姿估计的直接关系文中未充分说明。

GS2POSE: Marry Gaussian Splatting to 6D Object Pose Estimation Figure 1
arXiv preprint2025-10-19

GS2POSE: Marry Gaussian Splatting to 6D Object Pose Estimation

Junbo Li, Weimin Yuan, Yinuo Wang, Yue Zeng, Shihao Shu, Cai Meng, Xiangzhi Bai

University, Beijing 100191, China

6D位姿估计物体位姿三维重建高斯泼溅

GS2POSE面向基于重建模型的6D位姿估计在无纹理物体、深度模糊和光照变化下易失效的问题,将3D Gaussian Splatting引入位姿优化:先用NOCS给出粗位姿,再通过可微渲染与李代数更新做GS-Refiner,并结合射线投影点云配准和3DGS颜色参数自适应。实验在T-LESS、LineMod-Occlusion和LineMod上分别带来1.4%、2.8%、2.5%的精度提升。

Dictionary-Based Deblurring for Unpaired Data Figure 1
arXiv preprint2025-10-18

Dictionary-Based Deblurring for Unpaired Data

Alok Panigrahi, Jayaprakash Katual, Satish Mulleti, Member, IEEE

the Department of Electrical Engineering, Indian Institute of Technology Bombay, Mumbai, India

6D位姿估计

针对真实场景中模糊/清晰图像难以精确配对、深度去模糊方法依赖大规模数据且可解释性弱的问题,本文提出基于字典学习的线性去模糊框架,联合估计结构化模糊矩阵与高分辨率字典,并扩展到非配对甚至无对应数据。实验在合成 iCoseg 与真实 FocusPath 上显示,其在少量训练样本下优于传统耦合字典学习方法,但与现代深度模型的直接差距文中未充分说明。

SPLite Hand: Sparsity-Aware Lightweight 3D Hand Pose Estimation Figure 1
arXiv preprint2025-10-18

SPLite Hand: Sparsity-Aware Lightweight 3D Hand Pose Estimation

Yeh Keng Hao, Hsu Tzu Wei, Sun Min

National Tsing Hua University

6D位姿估计手部姿态

面向 AR/VR 与机器人中边缘设备实时、低功耗的 3D 手部姿态估计,SPLite Hand 将手部图像转为边缘稀疏表示,在 ResNet-18 编码器中使用稀疏卷积,并设计硬件友好的图解码器与量化感知训练。实验称在 Raspberry Pi 5 上整体加速 2.98×,编码提速 42%,解码提速 3.1×,模型由 72MB 压到 18MB,FreiHAND PA-MPJPE 仅从 9.0mm 升至 9.1mm。

Proactive Scene Decomposition and Reconstruction Figure 1
arXiv preprint2025-10-17

Proactive Scene Decomposition and Reconstruction

Baicheng Li, Zike Yan, Dong Wu, Hongbin Zha School of Intelligence Science, Technology, AIR, yanzike@air.tsinghua.edu.cn, riserwu@stu.pku.edu.cn, zha@cis.pku.edu.cn

School of Intelligence Science and Technology, Peking University, National Key Laboratory of General Artificial Intelligence, AIR, Tsinghua University

6D位姿估计三维重建

静态物体级重建常因遮挡和分解粒度不确定而失效,本文把人—物交互作为主动线索,提出“主动场景分解与重建”任务,并构建在线动态 SLAM 系统,将相机/物体 6D 位姿跟踪、实例分解、增量建图与 Gaussian Splatting 结合。实验在真实场景、HOI4D 等评估中显示其在姿态估计、物体分解和渲染重建质量上优于离线或被动方法,效率也更适合在线反馈。

Performance Comparison of Joint Delay-Doppler Estimation Algorithms Figure 1
arXiv preprint2025-10-17

Performance Comparison of Joint Delay-Doppler Estimation Algorithms

Lorenz Mohr, Michael Döbereiner, Steffen Schieler, Robert, Joerg, Christian Schneider, Sebastian Semper, Reiner S. Thomä

Technische Universit¨at Ilmenau, Institute of Information Technology, Ilmenau, Germany, Fraunhofer Institute for Integrated Circuits IIS, Ilmenau, Germany

6D位姿估计

面向6G ISAC/雷达中实时且高精度的目标感知需求,本文用可解析真值的双球双基地测量数据,对RIMAX最大似然、DeepEst卷积网络和OS-CFAR三类联合时延-多普勒估计算法做实测对比。核心洞察是速度与分辨率存在明显权衡:OS-CFAR计算效率最高,但在强LoS/静态路径遮挡下检测率和精度受限;ML与CNN方法凭借高分辨率和迭代消除取得更高检测率与更准估计。

The Probability of Vacuum Metastability and Artificial Vacuum Decay: Expert Survey Results Figure 1
arXiv preprint2025-10-16

The Probability of Vacuum Metastability and Artificial Vacuum Decay: Expert Survey Results

Jordan Stone, Youssef Saleh, Darryl Wright, Jess Riedel

Department of Earth Science and Engineering, Imperial College London, UK, Department of Physics and Astronomy, University of Cairo, Egypt, Physics & Informatics Laboratories, NTT Research, Inc., USA

6D位姿估计综述

这篇论文关注真空亚稳态及未来技术是否可能诱发真空衰变这一存在风险问题,核心做法不是提出物理模型,而是首次对20名相关物理专家进行结构化调查,梳理分歧来源。结果显示,专家平均认为真空亚稳概率为45.6%,若亚稳则任意先进技术可诱发衰变的条件概率为18.8%,但意见高度分散,关键不确定性在于超越标准模型的新物理;文中也强调该结果不涉及现有或计划中高能物理设施的安全性。

Tail-Safe Stochastic-Control SPX-VIX Hedging: A White-Box Bridge Between AI Sensitivities and Arbitrage-Free Market Dynamics Figure 1
arXiv preprint2025-10-09

Tail-Safe Stochastic-Control SPX-VIX Hedging: A White-Box Bridge Between AI Sensitivities and Arbitrage-Free Market Dynamics

ZhangJian’an Guanghua School of Management, China 2501111059@stu.pku.edu.cn

Guanghua School of Management, Peking University, Peking University

6D位姿估计

本文关注SPX–VIX对冲在到期临近、波动率—流动性切换和交易成本下易失效的问题,提出FR–LUX/尾部安全控制框架,将微观结构成本、交易空间信任域、状态分 regime 条件化及CBF-QP安全约束纳入白盒策略。实验在20个 regime×成本场景中相对PPO、均值方差和风险平价取得更高平均Sharpe、更低换手敏感性,并给出若干最优性与稳健性保证;但其与仓库“6D位姿估计”分类不符。

Incorporating estimands into meta-analyses of clinical trials Figure 1
arXiv preprint2025-10-17

Incorporating estimands into meta-analyses of clinical trials

Antonio Remiro-Azócar, Pepa Polavieja, Emmanuelle Boutmy, Alessandro Ghiretti, Lise Lotte Nystrup Husemoen, Khadija Rerhou Rantell, Tatsiana Vaitsiakhovich, David M. Phillippo, Jay J. H. Park, Helle Lynggaard, Robert Bauer, Antonia Morga

External Collaboration and Experimentation, \orgname, Department of Statistical Science, \orgname, University College London, \orgaddress, Bristol Medical School (Population Health Sciences), \orgname, University of Bristol, \orgaddress, Core Clinical Sciences Inc., \orgaddress, Department of Health Research Methodology, Evidence, and Impact, \orgname, McMaster University, \orgaddress, Biostatistics Methods, \orgname, Astellas Pharma Europe Ltd, \orgaddress

6D位姿估计

本文针对临床试验荟萃分析中仅用 PICO 难以刻画中途事件策略、导致异质性和外部适用性不清的问题,提出在试验层与“元分析层”引入 estimand 的实用框架。通过司美格鲁肽与度拉糖肽的糖尿病网络荟萃分析,作者显示不同停药/救援用药处理策略会改变合并效应解释,并能更明确定位异质性来源;但缺少个体级数据时实施仍受限。

Valeo Near-Field: a novel dataset for pedestrian intent detection Figure 1
arXiv preprint2025-10-17

Valeo Near-Field: a novel dataset for pedestrian intent detection

Antonyo Musabini, Rachid Benmokhtar, Xavier Perrotton Valeo, Jagdish Bhanushali Valeo, BRAIN Division 2100 South El Camino Real, suite D100 San Mateo - CA 94403, United States jagdish.bhanushali@valeo.com, Victor Galizzi, Bertrand Luvison Universite Paris-Saclay, CEA, List, F-91120, Palaiseau, France, bertrand.luvison@cea.fr

6D位姿估计数据集/基准

面向车辆近场行人靠近、开门等 ADAS 场景,现有数据集缺少同步多模态与真实意图交互。VNF 采集鱼眼相机、LiDAR、超声和动捕 3D 骨架,提供 300 段序列及 51 段公开测试集,并配套检测、3D 姿态、轨迹/意图预测基准与嵌入式评估指标;结果主要是建立基线和可复现实验平台,动态车辆与天气多样性仍不足。

Freehand 3D Ultrasound Imaging: Sim-in-the-Loop Probe Pose Optimization via Visual Servoing Figure 1
arXiv preprint2025-10-17

Freehand 3D Ultrasound Imaging: Sim-in-the-Loop Probe Pose Optimization via Visual Servoing

Yameng Zhang, Dianye Huang, Max Q.-H. Meng, Nassir Navab, Zhongliang Jiang

6D位姿估计手部姿态

针对自由手持 2D 超声重建 3D 时依赖昂贵跟踪器、学习法易受噪声和漂移影响的问题,论文将双轻量相机固定在探头上,观察带纹理平面,并在仿真中用视觉伺服迭代对齐真实/虚拟视图来估计全局 6D 位姿,同时加入遮挡纹理修复与仿真到真实标定。软血管模型、3D 打印圆锥和人体手臂实验的 Hausdorff 距离分别为 0.359、1.171、0.858 mm。

MRASfM: Multi-Camera Reconstruction and Aggregation through Structure-from-Motion in Driving Scenes Figure 1
arXiv preprint2025-10-17

MRASfM: Multi-Camera Reconstruction and Aggregation through Structure-from-Motion in Driving Scenes

Lingfeng Xuan, Chang Nie Yiqing Xu, Zhe Liu, Yanzi Miao, Hesheng Wang

Department of Automation, Education, Key Laboratory of Marine Intelligent Equipment and System of, Ministry of Education, Shanghai Engineering Research Center of Intelligent, Control and Management, Shanghai Jiao Tong University, Shanghai

6D位姿估计多视角三维重建

面向自动驾驶多相机采集场景中传统 SfM 位姿不稳、路面点云外点多且 BA 低效的问题,MRASfM 将固定相机组关系前置到注册与优化中,把多相机作为统一单元做 BA,并用路面平面模型滤除错误三角化点;同时通过粗到细的场景关联与拼接聚合碎片重建。实车与公开数据验证显示其在复杂条件下更稳健,nuScenes 上绝对位姿误差达到 0.124,报告为当前最优水平。

PFGS: Pose-Fused 3D Gaussian Splatting for Complete Multi-Pose Object Reconstruction Figure 1
arXiv preprint2025-10-17

PFGS: Pose-Fused 3D Gaussian Splatting for Complete Multi-Pose Object Reconstruction

Technology

National Tsing Hua University, King Abdullah University of Science and Technology

6D位姿估计三维重建高斯泼溅

PFGS瞄准单一静态姿态3DGS难以重建遮挡/自遮挡区域的问题,将主姿态与多个辅助姿态图像增量融合到同一坐标系。其关键在于用背景特征做各姿态相机估计、用3D基础模型辅助跨姿态配准,并通过全局注册、局部细化和轮廓一致性融合减少重影与重复高斯。实验显示其在合成与真实多姿态采集上优于基线,得到更完整的物体重建和更高质量的新视角渲染。

Neural Posterior Estimation for Cataloging Astronomical Images from the Legacy Survey of Space and Time Figure 1
arXiv preprint2025-11-05

Neural Posterior Estimation for Cataloging Astronomical Images from the Legacy Survey of Space and Time

Yicun Duan, Xinyue Li, Camille Avestruz, Jeffrey Regier, LSST Dark Energy Science Collaboration

Department of Statistics, University of Michigan, Department of Physics, University of Michigan, LSST Dark Energy Science Collaboration

6D位姿估计综述

本文面向 LSST 即将产生的海量多波段合成天文图像,针对传统星表构建在源混叠、低信噪比和不确定性表达上的不足,引入神经后验估计进行摊销式贝叶斯推断,隐式边缘化合成图像中的大量 nuisance 变量。在 DC2 仿真数据上,该方法在光源检测、流量测量、星系/恒星分类和星系形状估计上优于 LSST 标准管线,并给出校准较好的后验;但真实数据中的模型失配仍是主要风险。

CuSfM: CUDA-Accelerated Structure-from-Motion Figure 1
arXiv preprint2025-10-17

CuSfM: CUDA-Accelerated Structure-from-Motion

Jingrui Yu, Jun Liu, Kefei Ren, Joydeep Biswas, Rurui Ye, Keqiang Wu, Chirag Majithia, Di Zeng NVIDIA Project Lead {jingruiy, junli, kefeir, jbiswas, ruruiye, keqiangw, cmajithia, dizeng}@nvidia.com

NVIDIA

6D位姿估计

面向机器人感知、导航与仿真中对高精度相机/6D位姿和全局一致建图的需求,cuSfM将传统SfM的特征、匹配、三角化与BA保留下来,并用CUDA并行化结合ALIKED/LightGlue、位姿图视图选择、回环、先验地图定位和外参优化,避免冗余关联。实验显示其相较COLMAP在多场景下同时提升精度与速度,运行时间达到数量级改善,并已开源PyCuSfM。

LVI-Q: Robust LiDAR-Visual-Inertial-Kinematic Odometry for Quadruped Robots Using Tightly-Coupled and Efficient Alternating Optimization Figure 1
IEEE Robotics and Automation Letters2025-10-17

LVI-Q: Robust LiDAR-Visual-Inertial-Kinematic Odometry for Quadruped Robots Using Tightly-Coupled and Efficient Alternating Optimization

Kevin Christiansen Marsim, Minho Oh, Byeongho Yu, Seungjae Lee, I Made Aswin Nahrendra, Hyungtae Lim, Member, IEEE, and Hyun Myung, Senior Member

Korea Advanced Institute of Science and Technology

6D位姿估计人体姿态相机位姿点云机器人操作

面向四足机器人在光照剧变、快速运动或走廊等退化场景中的定位漂移问题,LVI-Q 将 LiDAR、视觉、IMU 与关节运动学紧耦合,并在 VIKO 滑窗优化与 LIKO 的 ESIKF 滤波之间按测量可用性交替估计;其关键在于足端预积分约束和基于超像素点云分布的深度一致性因子。实验覆盖公开与长时数据集,显示相较多传感器 SLAM 基线具有更稳健的里程计表现。

Autonomous Reactive Masonry Construction using Collaborative Heterogeneous Aerial Robots with Experimental Demonstration Figure 1
arXiv preprint2025-10-16

Autonomous Reactive Masonry Construction using Collaborative Heterogeneous Aerial Robots with Experimental Demonstration

Marios-Nektarios Stamatopoulos, Elias Small, Shridhar Velhal, Avijit Banerjee, George Nikolakopoulos

6D位姿估计机器人操作航天器

针对地面建造机器人受场地可达性和部署限制、现有无人机砌筑又缺少自主粘结流程的问题,论文构建了异构双无人机系统:一机基于视觉6D位姿估计和球铰机构搬砖,另一机自主挤出粘结剂,并用依赖/冲突图、层级状态机和动态分配协调任务。实验演示验证了全自主空中砌筑与粘结协作的可行性,但规模和定量性能提升文中说明较有限。

C4D: 4D Made from 3D through Dual Correspondences Figure 1
arXiv preprint2025-10-16

C4D: 4D Made from 3D through Dual Correspondences

Shizun Wang, Zhenxiang Jiang, Xingyi Yang, xingyi.yang@polyu.edu.hk, xinchao@nus.edu.sg

National University of Singapore The Hong Kong Polytechnic University

6D位姿估计

C4D针对单目视频中运动物体破坏多视几何、导致DUSt3R类点图重建难以直接用于动态场景的问题,提出用短期光流与长期点跟踪两类时间对应把3D重建扩展到4D。其DynPT同时预测点轨迹与世界坐标下的动态性,用于生成运动掩码,并通过对应约束优化相机、几何和3D轨迹平滑性。实验显示其在4D恢复、深度估计、相机位姿估计和点跟踪上均具竞争力。

Spatially anchored Tactile Awareness for Robust Dexterous Manipulation Figure 1
arXiv preprint2025-10-16

Spatially anchored Tactile Awareness for Robust Dexterous Manipulation

Jialei Huang, Yang Ye, Yuanqing Gong, Xuezhou Zhu, Yang Gao, Kaifeng Zhang Sharpa, Equal Advising

Sharpa Tsinghua University Wuhan University Shanghai Qi Zhi Institute

6D位姿估计机器人操作

面向遮挡和接触丰富场景中视觉难以提供亚毫米几何精度的问题,SaTA将指尖触觉图像通过正向运动学锚定到手部URDF/腕部坐标系,并用傅里叶位姿编码与FiLM融合保留触觉细节,使端到端策略可在手坐标中推理接触几何而非显式估计物体位姿。论文在双手USB-C对接、灯泡安装和卡片滑动上验证,相比强视触觉基线成功率最高提升30%,完成时间减少27%。

TED++: Submanifold-Aware Backdoor Detection via Layerwise Tubular-Neighbourhood Screening Figure 1
arXiv preprint2025-10-16

TED++: Submanifold-Aware Backdoor Detection via Layerwise Tubular-Neighbourhood Screening

Nam Le, Leo Yu Zhang, Kewen Liao, Shirui Pan, Wei Luo

School of Information Technology, Deakin University, Australia, School of Information and Communication Technology, Griffith University, Australia

6D位姿估计

针对现有输入级后门检测在高维特征空间依赖最近邻排名、遇到离流形但仍“近邻”的投毒样本及少量干净样本时失效的问题,TED++将各类隐藏激活建模为低维子流形,并逐层估计管状邻域厚度,用局部自适应排名惩罚越界激活。实验在CIFAR-10、GTSRB和TinyImageNet等设置下覆盖自适应攻击与少数据场景;即每类仅5个验证样本仍接近完美检测,AUROC较次优方法最高提升14%。

LiFMCR: Dataset and Benchmark for Light Field Multi-Camera Registration Figure 1
arXiv preprint2025-10-15

LiFMCR: Dataset and Benchmark for Light Field Multi-Camera Registration

Aymeric Fleith, Julian Zirbel, Daniel Cremers, Niclas Zeller

These authors contributed equally.Technical University of Munich, Munich, Germany, Karlsruhe University of Applied Sciences, Karlsruhe, Germany, Technical University of Munich, Munich, Germany

6D位姿估计数据集/基准多视角

针对现有光场相机数据多为单机、缺少同步多视角与外部6D真值,LiFMCR构建了双 Raytrix R32 阵列光场相机数据集,并用 Vicon 提供高精度位姿标注;同时给出融合 plenoptic 模型的 RANSAC 点云配准与单帧光场 PnP 基线。实验显示两类方法与真值对齐良好,为多光场相机外参标定和6D注册提供了可复现实验基准。

OmniGaze: Reward-inspired Generalizable Gaze Estimation In The Wild Figure 1
arXiv preprint2025-10-16

OmniGaze: Reward-inspired Generalizable Gaze Estimation In The Wild

Hongyu Qu, Jianan Wei, Xiangbo Shu, Yazhou Yao, Wenguan Wang, Technology

Nanjing University of Science and Technology Zhejiang University Nanjing Forestry University

6D位姿估计

OmniGaze针对3D视线估计在跨数据域、真实场景中因标注稀缺和数据多样性不足而泛化差的问题,提出半监督伪标签框架:用奖励模型结合3D视线几何、视觉编码特征与多模态大模型生成的语义线索评估伪标签置信度,并据此筛选和加权训练样本。实验显示其在5个数据集的域内与跨域设置达到SOTA,并在4个未见数据集上表现出较强零样本泛化,但增益可能主要来自scaling/data与伪标签筛选共同作用。

Rebalancing with Calibrated Sub-classes (RCS): A Statistical Fusion-based Framework for Robust Imbalanced Classification across Modalities Figure 1
Information Fusion2025-10-10

Rebalancing with Calibrated Sub-classes (RCS): A Statistical Fusion-based Framework for Robust Imbalanced Classification across Modalities

Priyobrata Mondal, Faizanuddin Ansari, Swagatam Das

Indian Statistical Institute

6D位姿估计

针对少数类样本不足导致分类器偏向多数类的问题,RCS先用自编码器学习更可分的潜表示,再以子类级GMM加权融合多数类与中间类的邻域统计来校准少数类分布并生成样本,避免只借用多数类统计造成过泛化。实验覆盖图像、文本和表格数据,整体优于多种重采样/生成基线;但与6D位姿估计的直接关系文中未充分说明。

Active Tactile Exploration for Rigid Body Pose and Shape Estimation Figure 1
arXiv preprint2025-10-15

Active Tactile Exploration for Rigid Body Pose and Shape Estimation

Ethan K. Gordon, Bruke Baraki, Hien Bui, Michael Posa

Ethan K. Gordon, Bruke Baraki, Hien Bui, Michael Posa, the General Robotics, Automation, Sensing, and Perception (GRASP) Laboratory, University of Pennsylvania, Philadelphia, PA, USA, {ethankg, bbaraki, xuanhien

6D位姿估计人体姿态

针对未知物体操作中视觉易受遮挡、触觉又稀疏且会扰动物体的问题,本文用纯触觉同时估计刚体形状与6D位姿轨迹。核心是将接触约束违背隐式写入损失以避免刚体接触数值刚性,并用期望信息增益选择下一次触碰而非维护完整信念分布。实验显示在仿真和真实机器人中,5–8秒接触数据即可学习凸体/长方体近似,主动探索比随机采样收敛更快、更稳定。

DAMM-LOAM: Degeneracy Aware Multi-Metric LiDAR Odometry and Mapping Figure 1
arXiv preprint2025-10-15

DAMM-LOAM: Degeneracy Aware Multi-Metric LiDAR Odometry and Mapping

Nishant Chandna, Akshat Kaushal

Unmanned Aerial Systems-Delhi Technological University

6D位姿估计相机位姿点云

针对纯 LiDAR SLAM 在长走廊、隧道等几何约束不足或重复场景中 ICP 位姿估计退化的问题,DAMM-LOAM 用法向图和邻域信息将点云划分为地面、墙面、屋顶、边缘与非平面点,并结合多度量匹配与退化感知的逐点加权最小二乘 ICP,后端加入 Scan Context 闭环。实验显示其在多类数据集上绝对位姿误差优于对比方法,室内退化场景收益尤其明显。

Convergence, design and training of continuous-time dropout as a random batch method Figure 1
arXiv preprint2025-10-15

Convergence, design and training of continuous-time dropout as a random batch method

Antonio Álvarez-López, Martín Hernández

6D位姿估计

针对连续时间模型中直接套用 dropout 可能破坏 ODE 求解稳定性且缺少误差设计准则的问题,本文将神经元随机失活重写为随机批方法,用无偏加权采样统一解释 Bernoulli dropout 与多种批采样。理论给出轨迹误差随步长 h 线性收敛、分布层面总变差约 h√h 稳定,并用伴随分析约束训练偏差;在单层 neural ODE 分类和 flow matching 中验证了收敛率及运行、内存收益。

True Self-Supervised Novel View Synthesis is Transferable Figure 1
arXiv preprint2025-10-15

True Self-Supervised Novel View Synthesis is Transferable

Thomas W. Mitchel Adobe

Thomas W. Mitchel, MIT CSAIL, PlayStation, MIT CSAIL

6D位姿估计

本文针对自监督新视角合成中“预测位姿是否真正可跨场景复用”的问题,提出以可迁移性而非SE(3)参数化作为判据,并构建XFactor:通过成对位姿估计、输入/输出增强和可迁移训练目标,迫使潜在位姿与场景内容解耦。实验在RE10K、DL3DV、MVImgNet、CO3Dv2等数据集上显示,其True Pose Similarity和生成效果显著优于RayZer、RUST,且潜在位姿与真实相机运动高度相关。

PET Head Motion Estimation Using Supervised Deep Learning with Attention Figure 1
IEEE Transactions on Medical Imaging2025-10-14

PET Head Motion Estimation Using Supervised Deep Learning with Attention

Zhuotong Cai, Student Member, IEEE, Tianyi Zeng, Member, Jiazhen Zhang, Eléonore V. Lieffrig, Kathryn Fontaine, Chenyu You, Enette Mae Revilla, James S. Duncan, Life Fellow, Jingmin Xin, Senior Member, Yihuan Lu, John A. Onofrey

Xi'an Jiaotong University, Yale University

6D位姿估计

针对脑 PET 长时间扫描中头动导致伪影和定量偏差、而外部硬件跟踪临床部署受限的问题,论文提出 DL-HMC++:用一秒 3D PET 原始云图监督回归 6D 刚体头部运动,并通过参考帧与运动帧的交叉注意力强化头部区域对应关系。其在两类扫描仪、四种示踪剂和大队列上优于现有数据驱动方法,校正图像接近硬件跟踪金标准,ROI SUV 差异约为 HRRT 1.2%、mCT 0.5%。

E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit Regularization Figure 1
arXiv preprint2025-10-24

E-MoFlow: Learning Egomotion and Optical Flow from Event Data via Implicit Regularization

Wenpu Li, Bangyan Liao, Yi Zhou, Qi Xu, Pian Wan, Peidong Liu

Westlake University Zhejiang University, Hunan University Wuhan University Georgia Institute of Technology

6D位姿估计事件相机

E-MoFlow针对事件相机中光流与6DoF自运动因缺少可靠关联而难以无监督分开估计的问题,将相机运动表示为连续样条、光流表示为隐式神经场,并用微分几何约束引入无需显式深度的结构-运动先验。其核心洞察是用表示本身提供时空与几何正则,减少手工正则偏置和深度参数化局部最优。实验显示其在一般6DoF场景中优于现有无监督方法,并接近部分监督方法表现。

SPORTS: Simultaneous Panoptic Odometry, Rendering, Tracking and Segmentation for Urban Scenes Understanding Figure 1
arXiv preprint2025-10-14

SPORTS: Simultaneous Panoptic Odometry, Rendering, Tracking and Segmentation for Urban Scenes Understanding

Zhiliu Yang, Jinyu Dai, Jianyuan Zhang, Zhu Yang

6D位姿估计相机位姿

面向自动驾驶/具身智能中的城市场景理解,SPORTS针对动态物体干扰、分割不足和稀疏视角导致的定位与渲染困难,将视频全景分割、视觉里程计和点式神经渲染闭环统一。核心是用位姿、深度、光流做注意力几何融合,并以全景结果反哺动态置信度和相机位姿估计。三套公开数据实验显示其在里程计、跟踪、分割和新视角合成上优于多数对比方法。

Autonomous Legged Mobile Manipulation for Lunar Surface Operations via Constrained Reinforcement Learning Figure 1
arXiv preprint2025-10-14

Autonomous Legged Mobile Manipulation for Lunar Surface Operations via Constrained Reinforcement Learning

Alvaro Belmonte-Baeza, Miguel Cazorla, Gabriel J. García, Carlos J. Pérez-Del-Pulgar, Jorge Pomares

University of Alicante, Artificial Intelligence Research Institute, Laboratoire d'Automatique, Génie Informatique et Signal

6D位姿估计机器人操作

面向月面崎岖地形、低重力和通信受限下轮式车难以兼顾移动与操作的问题,本文将约束强化学习用于四足移动机械臂的全身协同控制,把碰撞规避、稳定性、力矩/速度与功耗等软硬约束嵌入训练,并通过域随机化适配月面条件。实验显示末端6D任务空间跟踪达到约4 cm位置误差和8.1°姿态误差,且约束基本被遵守。

On the Use of Hierarchical Vision Foundation Models for Low-Cost Human Mesh Recovery and Pose Estimation Figure 1
arXiv preprint2025-11-15

On the Use of Hierarchical Vision Foundation Models for Low-Cost Human Mesh Recovery and Pose Estimation

Shuhei Tarashima tarashima@acm.org, Yushan Wang yushanwang218@gmail.com, Norio Tagawa tagawa@tmu.ac.jp, NTT DOCOMO Business

Tokyo Metropolitan University

6D位姿估计

针对 HMR2.0/ViTPose 依赖大型非层级 ViT、难以部署到实时或边缘场景的问题,论文提出将 Swin、GroupMixFormer、VMamba 等层级视觉基础模型截断到前两三阶段作为编码器,利用其中间特征仍具足够分辨率与语义的洞察。对 27 个 HMR/HPE 变体评测显示,截断模型精度可接近甚至超过全四阶段模型,并较小型 ViT 基线取得更好的精度—计算量折中。

An Empirical Study of Reducing AV1 Decoder Complexity and Energy Consumption via Encoder Parameter Tuning Figure 1
arXiv preprint2025-10-14

An Empirical Study of Reducing AV1 Decoder Complexity and Energy Consumption via Encoder Parameter Tuning

Vibhoothi Vibhoothi, Julien Zouein, Shanker Shreejith, Jean-Baptiste Kempf, Anil Kokaram

6D位姿估计

面向移动端等电池受限设备中 AV1 软件解码能耗过高的问题,论文从编码端参数入手,系统做“tool-off”实验,结合 perf、RAPL 与 Intel SoC Watch 衡量解码周期、能耗和压缩质量的权衡。核心洞察是部分 AV1 工具可在编码时关闭以生成更易解码码流:libaom-av1 关闭 CDEF 平均减少约 10% 解码周期,SVT-AV1 的 fast-decode=2 可减少约 24%,且感知质量损失较小。

A Deep Multi-Task Learning Approach to Impulsive Noise Parameter Estimation Figure 1
arXiv preprint2025-10-14

A Deep Multi-Task Learning Approach to Impulsive Noise Parameter Estimation

Abdullahi Mohammad, Bdah Eya, Bassant Selim, e-mail: abdullahi.mohammad@etmtl.ca, eya.bdah.1@ens.etsmtl.ca, bassant.selim@etmtl.ca

6D位姿估计

面向6G等无线系统中突发、非高斯且具时间相关性的脉冲噪声,论文将参数估计从多个单任务模型改为共享 CNN-LSTM+注意力的多任务学习,同时回归发生概率与功率比并分类记忆长度。实验显示加权损失下收敛更平滑,部分指标优于STL;总参数少于三套STL,训练最高快47%,顺序推理快56.5%,但单次推理较单个STL慢28%。

Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View Figure 1
arXiv preprint2025-10-13

Beyond 'Templates': Category-Agnostic Object Pose, Size, and Shape Estimation from a Single View

Jinyu Zhang

Fudan University & Shanghai Innovation Institute, Fudan University

6D位姿估计物体位姿类别级位姿

面向机器人在开放场景中缺少CAD、模板或类别标签时仍需估计物体6D位姿、尺寸与形状的问题,本文将RGB-D单视图的基础视觉2D特征与局部点云融合,用带MoE的Transformer和并行解码器一次性完成位姿/尺寸回归与形状重建。模型仅用SOPE合成数据训练,在SOPE、ROPE、ObjaversePose、HANDAL等300+类别上达到SOTA,并以28 FPS展示较强零样本真实物体泛化。

PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Image Figure 1
arXiv preprint2025-10-13

PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Image

Pradyumna Yalandur Muralidhar, Yuxuan Xue, Xianghui Xie, Margaret Kostyrko, Gerard Pons-Moll

University of Tübingen, Zuse School ELIZA, University of Tübingen, Tübingen AI Center

6D位姿估计

针对单张图像中人体与场景重建常受尺度/深度歧义、遮挡和接触不物理影响的问题,PhySIC将SMPL-X人体、稠密场景和顶点级接触放到同一度量坐标系,通过遮挡感知补全、支撑面合成与置信加权联合优化,同时约束深度、接触、防穿插和2D重投影。实验显示其场景顶点误差由641mm降至227mm,PA-MPJPE约42mm,接触F1由0.09提升到0.51,端到端约27秒。

ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Training Figure 1
arXiv preprint2025-10-13

ACE-G: Improving Generalization of Scene Coordinate Regression Through Query Pre-Training

Leonard Bruns, Axel Barroso-Laguna, Tommaso Cavallari, Áron Monszpart, Sowmya Munukutla, Victor Adrian Prisacariu, Eric Brachmann

KTH Royal Institute of Technology

6D位姿估计

ACE-G针对传统场景坐标回归将地图信息写入单场景回归器、因而在光照和视角变化下易过拟合的问题,将坐标回归器与场景地图码解耦,用DINO特征和Transformer在大量场景的mapping/query划分上预训练,并在query阶段冻结地图码以迫使模型学习跨条件泛化。实验显示其在长期变化的室内重定位数据集上明显强于ACE等SCR方法,同时保持分钟级建图和小地图存储,部分增益可能来自更大规模预训练数据与特征scaling。

High-Resolution Spatiotemporal Modeling with Global-Local State Space Models for Video-Based Human Pose Estimation Figure 1
arXiv preprint2025-10-13

High-Resolution Spatiotemporal Modeling with Global-Local State Space Models for Video-Based Human Pose Estimation

Runyang Feng, Hyung Jin Chang, Tze Ho Elden Tse, Boeun Kim, Yi Chang, Yixing Gao School of Artificial Intelligence, Ministry of Education, China, School of Computer Science

School of Artificial Intelligence, Jilin University, Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, School of Computer Science, University of Birmingham, National University of Singapore, Dankook University

6D位姿估计人体姿态

针对视频人体姿态估计中高分辨率序列难以同时建模全局运动趋势与局部关键点细节、且注意力代价高的问题,论文提出纯 Mamba 框架 GLSMamba,将全局与局部时空建模解耦:GSM 通过 6D 选择性时空扫描和自适应合并获取全局上下文,LRM 用窗口化扫描强化局部高频运动。其在 PoseTrack2017/2018/21 与 Sub-JHMDB 上超过现有方法,并表现出更好的计算权衡。

DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects Figure 1
arXiv preprint2025-10-13

DKPMV: Dense Keypoints Fusion from Multi-View RGB Frames for 6D Pose Estimation of Textureless Objects

Jiahong Chen, Jinghao Wang, Zi Wang, Ziwen Wang, Banglei Guan, Qifeng Yu

College of Aerospace Science and Engineering, National University of Defense Technology, Changsha 410073, China, Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation, Changsha 410073, China

6D位姿估计多视角

面向工业中无纹理物体在深度缺失、遮挡和对称性下的6D位姿估计难题,DKPMV放弃深度输入,仅用多视角RGB做稠密关键点级融合;其关键在注意力聚合提升关键点一致性、对称感知训练缓解歧义,并通过三阶段渐进优化利用多视角几何。ROBI实验显示其优于现有多视角RGB方法,且多数情况下超过RGB-D方法。

Aegis: A Correlation-Based Data Masking Advisor for Data Sharing Ecosystems Figure 1
arXiv preprint2025-11-04

Aegis: A Correlation-Based Data Masking Advisor for Data Sharing Ecosystems

Omar Islam Laskar, Fatemeh Ramezani Khozestani, Ishika Nankani, Sohrab Namazi Nia, Senjuti Basu Roy, Kaustubh Beedkar

Indian Institute of Technology Delhi, New Jersey Institute of Technology

6D位姿估计

这篇论文关注数据共享中“满足隐私阈值后如何保留机器学习效用”的选择难题,而非仓库标注的6D位姿估计。Aegis的核心是用特征—标签相关性变化近似预测效用损失,并在仅有一维直方图甚至无原始数据时通过迭代比例拟合估计联合分布,支持MI、卡方、g3等度量。实验显示其选择合规掩码配置速度提升一个数量级以上,下游预测性能接近穷举基线。

WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting Figure 1
arXiv preprint2025-10-12

WorldMirror: Universal 3D World Reconstruction with Any-Prior Prompting

Yifan Liu, Zhiyuan Min, Zhenwei Wang, Junta Wu, Tengfei Wang, Yixuan Yuan, Yawei Luo, Chunchao Guo

Zhejiang University, Chinese University of Hong Kong, Tencent Hunyuan

6D位姿估计三维重建

针对现有前馈三维重建模型多只吃图像、且输出任务割裂的问题,WorldMirror 将相机内参/位姿/深度等几何先验编码为可选提示,并用统一 Transformer 与解码头同时预测点云、深度、相机、法线和 3D Gaussian。动态先验注入与课程训练使其能适配有无先验场景;实验显示其在相机/点图估计、法线预测和新视角合成上超过 VGGT、π3、StableNormal、AnySplat 等基线。

Identification and Estimation of Heterogeneous Interference Effects under Unknown Network Figure 1
arXiv preprint2025-10-12

Identification and Estimation of Heterogeneous Interference Effects under Unknown Network

Yuhua Zhang, Jukka-Pekka Onnela, Shuo Sun, Ruoyu Wang

Department of Population Health Sciences, Weill Cornell Medicine

6D位姿估计

针对网络干预中真实干扰关系常不可观测、仅有带噪观测网络的问题,本文提出基于共享潜在社区结构的 CINet 框架,在无需已知干扰网络下识别和估计异质的组级间接效应。核心洞察是组级干扰效应的异质性正是可识别条件;作者给出 MLE 一致性和渐近正态性,并用贝叶斯实现近似难解似然。仿真优于对比方法,并在加州卒中医院转诊数据上估计 EVT 相关跨医院干扰效应。

CAPSim: A Fast CPU Performance Simulator Using Attention-based Predictor Figure 1
arXiv preprint2025-10-12

CAPSim: A Fast CPU Performance Simulator Using Attention-based Predictor

Buqing Xu, Jianfeng Zhu, Yichi Zhang, Qinyi Cai, Guanhua Li, Shaojun Wei, Leibo Liu School of Integrated Circuits, BNRist, Beijing, @tsinghua.edu.cn

School of Integrated Circuits, BNRist, Tsinghua University, Beijing, China

6D位姿估计

现代乱序、多核 CPU 的周期级仿真在完整基准上过慢,且既有学习方法多停留在基本块吞吐预测。CAPSim 将快速功能仿真得到的指令轨迹切成细粒度片段,引入带上下文寄存器信息的注意力性能预测器,以捕捉长程指令依赖并累加全程序时间。在 Intel Xeon 与 gem5 O3 对比中实现约 2.2–8.3× 加速,最高单基准约 7.78×,但精度细节与增益来源仍需看完整实验。

Anchor-based Maximum Discrepancy for Relative Similarity Testing Figure 1
arXiv preprint2025-10-12

Anchor-based Maximum Discrepancy for Relative Similarity Testing

Zhijian Zhou, Liuhua Peng, Xunye Tian, Australia @gmail.com liuhua.peng@unimelb.edu.au

The University of Melbourne, Australia

6D位姿估计

针对相对相似性检验中先手工指定假设再选核会导致检验偏置甚至问题不适定的动机,论文提出 Anchor-based Maximum Discrepancy,在深度核空间中同时学习能最大区分锚分布与两候选分布距离差的核和潜在假设,再统一计算显著性阈值。作者给出一类理论保证,并在多个基准与应用实验中显示较高检验功效;但其与6D位姿估计的直接关联文中未充分说明。

Data-driven simulator of multi-animal behavior with unknown dynamics via offline and online reinforcement learning Figure 1
arXiv preprint2025-10-12

Data-driven simulator of multi-animal behavior with unknown dynamics via offline and online reinforcement learning

Keisuke Fujii, Kazushi Tsutsui, Yu Teshima, Makoto Itoh, Naoya Takeishi, Nozomi Nishiumi, Ryoya Tanaka, Shunsuke Shigaki, Yoshinobu Kawahara

Graduate School of Informatics, Nagoya University, Japan, Graduate School of Arts and Sciences, The University of Tokyo, Japan, Faculty of Education, Shitennoji University, Japan, Graduate School of Engineering, The University of Tokyo, Japan, Graduate School of Science and Technology, Niigata University, Japan, Graduate School of Science, Nagoya University, Japan, Principles of Informatics Research Division, National Institute of Informatics, Japan, Graduate School of Information Science, The University of Osaka, Japan

6D位姿估计

针对多动物真实运动动力学未知、规则模型难以复现急停急启和群体交互的问题,论文提出 AnimaRL:先从轨迹估计可解释的阻尼与控制幅度,再结合离线/在线深度强化学习和基于距离的伪奖励对齐真实与仿真状态。实验覆盖合成智能体、果蝇、蝾螈和蚕蛾,整体提升轨迹相似度与奖励获取,并可做部分反事实场景预测,但在果蝇等数据少或速度分布复杂场景增益有限。

MonoSE(3)-Diffusion: A Monocular SE(3) Diffusion Framework for Robust Camera-to-Robot Pose Estimation Figure 1
arXiv preprint2025-10-12

MonoSE(3)-Diffusion: A Monocular SE(3) Diffusion Framework for Robust Camera-to-Robot Pose Estimation

Kangjian Zhu, Haobo Jiang, Yigong Zhang, Jianjun Qian, Jian Yang, Jin Xie

Yigong Zhang is with College of Computer Science, Nankai University, China

6D位姿估计机器人操作

针对单目无标记相机到机器人6D位姿估计在遮挡、低可见度和分布外姿态下不稳的问题,论文将SE(3)位姿细化建模为条件扩散过程:训练时加入视锥约束生成多样且仍在视野内的扰动姿态,推理时用带时间步条件的反向过程由粗到细迭代去噪。该方法在DREAM和RoboKeyGen上优于既有方法,最难数据集AUC达66.75,相对SOTA提升32.3%。

Hierarchical Planning for Long-Horizon Multi-Target Tracking Under Target Motion Uncertainty Figure 1
IEEE Robotics and Automation Letters2025-10-20

Hierarchical Planning for Long-Horizon Multi-Target Tracking Under Target Motion Uncertainty

Junbin Yuan, Brady Moon, Muqing Cao, Sebastian Scherer

Carnegie Mellon University

6D位姿估计

针对单架无人机在大范围开放环境中因视野受限而易丢失多个运动目标的问题,本文将长时域跟踪分解为单目标搜索子任务:低层用移位螺旋覆盖不断扩张的目标置信椭圆,并估计搜索成功率与耗时;高层将任务序列建模为 MDP,用 MCTS 选择访问顺序。仿真中最终不确定性较现有方法降低 11–70%,并通过真实飞行验证可部署性。

Finite element analysis of a nonlinear heat Equation with damping and pumping effects Figure 1
arXiv preprint2025-10-11

Finite element analysis of a nonlinear heat Equation with damping and pumping effects

Rishabh Shukla, Wasim Akram, Manil T. Mohan

6D位姿估计

这篇论文并非6D位姿估计工作,而是面向带阻尼与泵浦项的非线性热/反应扩散方程,动机是为多类物理模型建立统一的适定性与数值离散理论。核心在于改进Faedo-Galerkin构造并引入自伴算子控制初值,同时比较协调、非协调和DG有限元。主要结果给出弱解唯一性、维度相关正则性,以及半离散和全离散先验误差估计并以数值实验验证。

HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimation Figure 1
arXiv preprint2025-10-11

HccePose(BF): Predicting Front & Back Surfaces to Construct Ultra-Dense 2D-3D Correspondences for Pose Estimation

Yulin Wang, Mengting Hu, Hongli Li, Chen Luo

Southeast University, Purdue University

6D位姿估计

针对现有PnP式6D位姿方法多只预测可见前表面、未利用背面与物体内部几何的问题,HccePose(BF)同时预测前/后表面坐标,并在两者间密集采样构造超密2D-3D对应;同时提出HCCE分层连续坐标编码和基于多直方图的层级学习来提升坐标精度与训练稳定性。在7个经典BOP数据集上,其BOP分数较RGB SOTA提升2.4%,RGB训练、RGB-D测试时较SOTA提升4.7%。

Gesplat: Robust Pose-Free 3D Reconstruction via Geometry-Guided Gaussian Splatting Figure 1
arXiv preprint2025-10-27

Gesplat: Robust Pose-Free 3D Reconstruction via Geometry-Guided Gaussian Splatting

Jiahui Lu, Haihong Xiao, Xueyan Zhao, Wenxiong Kang

6D位姿估计三维重建高斯泼溅

Gesplat面向稀疏且无位姿图像下3DGS依赖准确相机位姿、COLMAP易失效的问题,用VGGT提供初始位姿和稠密点云,并结合普通/射线高斯的混合表示、位置-形状双优化、图引导属性细化与基于光流的深度正则来约束几何一致性。实验在LLFF和Tanks and Temples上显示,其在无位姿新视角合成和三维重建中较现有方法更稳健。

FORM: Fixed-Lag Odometry with Reparative Mapping utilizing Rotating LiDAR Sensors Figure 1
arXiv preprint2025-10-11

FORM: Fixed-Lag Odometry with Reparative Mapping utilizing Rotating LiDAR Sensors

Easton R. Potokar, Taylor Pool, Daniel McGann, Michael Kaess

6D位姿估计相机位姿点云

针对传统 LiDAR 里程计多采用固定子图、易把位姿误差写入局部地图并造成轨迹抖动,而平滑式方法又常因多扫描匹配难以实时的问题,FORM 在固定滞后窗口内用稠密因子图联合优化位姿,同时只对单一迭代地图匹配,并用平滑后的位姿持续修复地图。实验覆盖 7 个数据集、60 余序列,显示其在保持实时性的同时提升鲁棒性与轨迹平滑度,长期漂移精度具备竞争力。

An uncertainty-aware framework for data-efficient multi-view animal pose estimation Figure 1
arXiv preprint2025-10-10

An uncertainty-aware framework for data-efficient multi-view animal pose estimation

Lenny Aharon, Keemin Lee, Karan Sikka, Selmaan Chettih, Cole Hurwitz, Liam Paninski, Matthew R Whiteway

Columbia University

6D位姿估计多视角

针对多视角动物姿态估计中标注稀缺、遮挡和不确定性校准差的问题,本文将多视角 Transformer、输入 patch masking、相机标定下的 3D 增强与三角化损失结合,并扩展带方差膨胀的非线性 mvEKS 生成可靠伪标签做蒸馏。在果蝇、小鼠和山雀数据上,各组件互补提升精度与重投影一致性,蒸馏单模型在效率和性能间取得更实用的折中。

Observer-Based Source Localization in Tree Infection Networks via Laplace Transforms Figure 1
Bulletin of Mathematical Biology2025-10-10

Observer-Based Source Localization in Tree Infection Networks via Laplace Transforms

Kesler O'Connor, Julia M. Jess, Devlin Costello, Manuel E. Lladser

University of Colorado Boulder

6D位姿估计

针对树状传播网络中仅少量节点可观测时的感染源定位问题,本文从可辨识性而非仅构造估计器入手,指出部分观测者在统计上是冗余的,并用观测感染时间的联合拉普拉斯变换刻画源是否可区分。在此基础上构造尺度不变的最小二乘估计,在合成树和河网实验中对多种边延迟模型保持较准确定位;同时强调含环网络中简单化为生成树可能并不可靠。

Cross-Sensor Touch Generation Figure 1
arXiv preprint2025-10-10

Cross-Sensor Touch Generation

Samanta Rodriguez, Yiming Dou, Miquel Oller, Andrew Owens, Nima Fazeli

University of Michigan Cornell University

6D位姿估计

针对视觉触觉传感器形态差异大、下游模型常被绑定到特定硬件的问题,论文把跨传感器触觉迁移显式建模为原始触觉图像生成:Touch2Touch用配对数据训练条件扩散模型,T2D2则以深度作为中间表示以减少配对需求。实验覆盖Soft Bubble、GelSlim、DIGIT,并在图像质量、手内位姿估计和行为克隆中验证可把一个传感器上的模型迁移到另一传感器;但T2D2在高频几何和精密位姿任务上有退化。

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters Figure 1
arXiv preprint2025-10-10

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

Michelle Ntampaka, A. Ćiprijanović, Ana Maria Delgado, John Soltis, John F. Wu, Mikaeel Yunus, John ZuHone

Space Telescope Science Institute, Baltimore, MD 21218, USA, Department of Physics & Astronomy, Johns Hopkins University, Baltimore, MD 21218, USA, Fermi National Accelerator Laboratory, Batavia, IL, Department of Astronomy and Astrophysics, University of Chicago, Chicago, IL, NSF-Simons AI Institute for the Sky (SkAI), Chicago, IL 60611, USA, Department of Computer Science, Johns Hopkins University, Baltimore, MD 21218, USA, Center for Astrophysics | | Harvard & Smithsonian, Cambridge, MA 02138, USA

6D位姿估计仿真到现实

本文关注仿真训练模型在真实/异域数据上失效的风险,以星系团 X 射线剖面质量估计为例,对比 Magneticum 训练与 IllustrisTNG 测试下的域偏移。核心洞察是,细微且难察觉的仿真差异足以引入偏差;普通 NN 虽在训练域提升约17%,到异域反而差40%,散射增强无明显改善,DRRN虽对齐潜空间但仍不如简单 Y_X scaling 关系。

Performance of Machine Learning Methods for Gravity Inversion: Successes and Challenges Figure 1
arXiv preprint2025-09-28

Performance of Machine Learning Methods for Gravity Inversion: Successes and Challenges

Vahid Negahdari, Shirin Samadi Bahrami, Seyed Reza Moghadasi, Mohammad Reza Razvan

Department of Mathematical Sciences, Sharif University of Technology, Tehran, 11155-9415, Iran

6D位姿估计数据集/基准

针对二维重力反演中由一维观测恢复地下密度场的严重欠定与非唯一问题,论文系统比较机器学习与传统迭代求解器。其核心做法是用定制数据结构训练 CNN 直接映射重力异常到密度场,并将 VAE/GAN 反演表述为受正演算子约束的潜空间优化,同时测试 GD、GMRES、LGMRES、ICG 对 CNN 初值的细化作用。结果显示 CNN 最稳定且显著优于既有方法,生成模型仍不稳定,迭代法仅带来有限增益。

Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation Figure 1
arXiv preprint2025-10-10

Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation

Wenyao Zhang, Hongsi Liu, Bohan Li, Jiawei He, Zekun Qi Yunnan Wang, Shengyang Zhao, Xinqiang Yu, Wenjun Zeng, Ningbo, Digital Derivative, Technology of China, CASIA

MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University, Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo, China, Ningbo Key Laboratory of Spatial Intelligence and Digital Derivative, Ningbo, China, University of Science and Technology of China CASIA Tsinghua University

6D位姿估计彩色深度

针对自监督单目深度估计难以同时获得语义上下文与局部几何细节的问题,Hybrid-depth 将 CLIP 的全局语义和 DINO 的局部空间特征用粗到细语言引导对齐:先以远近图像块文本提示学习粗深度感知,再结合相机位姿和像素级深度提示细化预测,并可作为 Monodepth2、ManyDepth 等管线的即插即用编码器。KITTI 实验显示其在各项深度指标上超过现有方法,并对 BEV 感知有下游收益。

Neural Codecs as Biosignal Tokenizers Figure 1
arXiv preprint2025-10-10

Neural Codecs as Biosignal Tokenizers

Kleanthis Avramidis

University of Southern California

6D位姿估计

针对 EEG/EMG 等生物信号高维、噪声大且缺少天然语义 token,传统手工特征和直接套用掩码/对比学习迁移性有限的问题,本文将预训练重构视为神经 codec 压缩任务,提出 BioCodec:用卷积编码器和残差向量量化把连续波形离散化,并采用通道无关设计。模型在多项临床异常、睡眠分期、事件/ERP、运动想象与语音解码任务上达到或接近 SOTA,低资源下较稳健,且以更少参数扩展到 EMG。

Robust and Efficient Semiparametric Inference for the Stepped Wedge Design Figure 1
arXiv preprint2025-10-10

Robust and Efficient Semiparametric Inference for the Stepped Wedge Design

Fan Xia, K. C. Gary Chan, Emily Voldal, Avi Kenny, Patrick J. Heagerty, James P. Hughes

University of California, San Francisco, University of Washington, Fred Hutchinson Cancer Center, Duke University

6D位姿估计

针对阶梯楔形设计中干预效应与时间趋势混杂、簇内相关复杂、簇数少和基线不平衡导致推断不稳的问题,本文提出仅要求处理效应对比模型正确的半参数估计框架,并结合置换结构与留一校正估计小样本标准误。理论上在均值趋势和协方差误设下仍一致且渐近正态,正确设定时达效率界;仿真和公共卫生试验显示相较线性混合模型更稳健且效率更好。

mmJoints: Expanding Joint Representations Beyond (x,y,z) in mmWave-Based 3D Pose Estimation Figure 1
arXiv preprint2025-10-10

mmJoints: Expanding Joint Representations Beyond (x,y,z) in mmWave-Based 3D Pose Estimation

Zhenyu Wang, Mahathir Monjur, Shahriar Nirjon

University of North Carolina at

6D位姿估计

本文针对毫米波3D姿态估计中雷达回波稀疏、模型过度依赖人体先验的问题,提出不消除而是显式刻画偏差:为每个关节在(x,y,z)外增加感知分数和可靠性分数,并通过黑盒预训练模型输出与信号分布反演估计。实验覆盖11.5万帧、13种设置,描述符误差低于4.2%,关节定位最高提升12.5%,活动识别最高提升16%。

ARTDECO: Towards Efficient and High-Fidelity On-the-Fly 3D Reconstruction with Structured Scene Representation Figure 1
arXiv preprint2025-10-09

ARTDECO: Towards Efficient and High-Fidelity On-the-Fly 3D Reconstruction with Structured Scene Representation

Guanghao Li, Kerui Ren : 1, Linning Xu, Zhewen Zheng, Changjian Jiang, Xin Gao, Bo Dai, Jian Pu, Mulin Yu : 2, Jiangmiao Pang

Shanghai Artificial Intelligence Laboratory, Fudan University, Shanghai Innovation Institute, Shanghai Jiao Tong University, The Chinese University of Hong Kong, Carnegie Mellon University, Zhejiang University, The University of Hong Kong

6D位姿估计三维重建

ARTDECO面向单目序列在线三维重建中速度、精度与鲁棒性难兼顾的问题,将前馈3D基础模型用于位姿、回环和稠密点预测,并结合轻量BA、Gaussian解码器与层次化LoD高斯表示,减少大场景冗余。八个室内外基准显示其效率接近SLAM、鲁棒性接近前馈方法,重建质量接近逐场景优化。

DexMan: Learning Bimanual Dexterous Manipulation from Human and Generated Videos Figure 1
arXiv preprint2025-10-09

DexMan: Learning Bimanual Dexterous Manipulation from Human and Generated Videos

Jhen Hsieh, Kuan-Hsun Tu, Kuo-Han Hung, Tsung-Wei Ke

National Taiwan University, Stanford University thanks, Work done at National Taiwan University

6D位姿估计机器人操作

DexMan针对双臂灵巧手示教数据昂贵、单目人类视频缺少标定与物体真值位姿的问题,提出从第三视角RGB视频自动重建场景、估计手物运动并训练全人形机器人残差RL策略的流程;其关键在于用3D点轨迹增强6D物体跟踪、稳定化低质网格,并以接触奖励缓解噪声位姿下的抓取学习。实验中TACO位姿估计ADD-S/VSD分别提升0.08/0.12,OakInk-v2成功率较前作高19%,还可从真实与Veo3合成视频恢复部分技能。

Validation of collision-free spheres of Stewart-Gough platforms for constant orientations using the Application Programming Interface of a CAD software Figure 1
arXiv preprint2025-10-20

Validation of collision-free spheres of Stewart-Gough platforms for constant orientations using the Application Programming Interface of a CAD software

Bibekananda Patra, Rajeevlochana G. Chittawadigi, and Sandipan Bandyopadhyay

6D位姿估计

针对并联机构连杆多、实际几何复杂导致解析无碰撞工作空间易出错的问题,本文把 Stewart-Gough 平台支腿用胶囊近似,并通过 Autodesk Inventor API 自动采样移动平台位置、调用 CAD 碰撞检测验证固定姿态下的无碰撞球。结果表明该工具可独立检查预计算 CFS 的安全性,并可用于估计其他空间并联机构的 CFS;但文中未充分说明相对解析法的定量精度或速度增益。

SViM3D: Stable Video Material Diffusion for Single Image 3D Generation Figure 1
arXiv preprint2025-11-01

SViM3D: Stable Video Material Diffusion for Single Image 3D Generation

Mark Boss, Vikram Voleti, Chun-Han Yao, Hendrik P. A. Lensch, Varun Jampani Stability AI

Stability AI University of Tübingen

6D位姿估计

本文针对单图生成3D资产时材质与光照难以解耦、导致重打光和外观编辑不可靠的问题,提出SViM3D:在可控相机轨迹的视频扩散模型中联合生成多视角一致的RGB、法线和空间变化PBR材质,并用多光照合成数据、统一材质潜空间及改造UNet训练,再配合视角加权、单应校正和快速环境光可微渲染完成3D优化。实验显示其在新视角合成、材质预测和重打光上达到SOTA;但目前主要面向物体中心图像,透明等复杂材质仍受限。

Efficient Fidelity Estimation with Few Local Pauli Measurements Figure 1
arXiv preprint2025-10-09

Efficient Fidelity Estimation with Few Local Pauli Measurements

Mingyu Sun, Gabriel Waite, Michael J. Bremner, Christopher Ferrie

Centre for Quantum Software and Information, School of Computer Science, Faculty of Engineering & Information Technology, University of Technology Sydney, NSW 2007, Australia, Centre for Quantum Computation and Communication Technology

6D位姿估计

量子设备规模扩大使目标态与实验态的保真度评估面临全层析代价过高的问题。本文将少量非自适应、单拷贝局域 Pauli 测量的 shadow overlap 认证流程改造为定量保真度估计器,核心洞察是把偏差与目标态诱导马尔可夫链的混合时间联系起来,并用 k-GLEP 判定何时高效。结果给出样本复杂度随混合时间平方缩放,覆盖 t-design、低深随机线路、能隙局域哈密顿量基态及部分混合态,并提供经验适用性检验。

GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Network Figure 1
arXiv preprint2025-10-09

GraphEnet: Event-driven Human Pose Estimation with a Graph Neural Network

Gaurvi Goyal, Pham Cong Thuong, Arren Glover, Masayoshi Mizuno, Chiara Bartolozzi

Maastricht University &, maastrichtuniversity.nl, Sony Interactive Entertainment Inc

6D位姿估计人体姿态事件相机

针对高速人体运动或移动机器人场景中RGB相机易受运动模糊、事件相机算法又常因建图开销失去低延迟优势的问题,GraphEnet将事件流先转为稀疏线段表示再构图,用GNN结合置信度池化的偏移向量学习估计单人2D姿态。其在event-Human3.6M上达到74% PCKt@0.4,并以4 ms延迟、250 Hz输出运行,精度低于SOTA但显著提升频率。

MMHOI: Modeling Complex 3D Multi-Human Multi-Object Interactions Figure 1
arXiv preprint2025-10-11

MMHOI: Modeling Complex 3D Multi-Human Multi-Object Interactions

Kaen Kogashi Mitsubishi Electric Japan

Mitsubishi Electric, Mitsubishi Electric Research Labs, Nara Women’s University

6D位姿估计物体位姿

针对现有3D HOI数据集多停留在单人单物或弱协作场景、难以评估真实多主体交互的问题,论文构建MMHOI,提供约60万帧、多人物多物体的3D形状/6D位姿、动作与交互身体部位标注,并提出基于ViT的MMHOI-Net,用双patch物体表示和动作/身体部位一致性约束联合重建人与物及交互。在MMHOI和CORE4D上优于改造后的基线,显示复杂多HOI建模与重建质量提升。

SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction Figure 1
arXiv preprint2025-10-13

SyncHuman: Synchronizing 2D and 3D Generative Models for Single-view Human Reconstruction

Wenyue Chen, Peng Li 2 Corresponding authors, Wangguandong Zheng, Chengfeng Zhao Mengfei Li, Yaolong Zhu, Zhiyang Dou, Ronggang Wang, Yuan Liu 2 Corresponding authors PKU, HKUST, SEU

HKUST

6D位姿估计三维重建

针对单图穿衣人体重建在遮挡、复杂姿态下依赖不准 SMPL 先验、细节与结构难兼顾的问题,SyncHuman 将2D多视图生成与原生3D生成联合训练,通过像素对齐的2D-3D同步注意力建立跨空间对应,并用多视图特征注入解码器补充纹理和几何细节。实验显示其在多数据集上较 ECON、SiTH、PSHuman 等基线取得更好的几何精度、视图一致性和视觉保真度。

WristWorld: Generating Wrist-Views via 4D World Models for Robotic Manipulation Figure 1
arXiv preprint2025-10-08

WristWorld: Generating Wrist-Views via 4D World Models for Robotic Manipulation

Zezhong Qian, Xiaowei Chi, Yuming Li, Shizun Wang, Zhiyuan Qin Xiaozhu Ju, Sirui Han, School of Computer Science

State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, Hong Kong University of Science and Technology, National University of Singapore, Beijing Innovation Center of Humanoid Robotics

6D位姿估计机器人操作

本文针对机器人数据中腕部视角稀缺、第三人称视角难以支撑精细操作的问题,提出 WristWorld:先扩展 VGGT 重建腕部相机位姿与 4D 点云,并用 SPC 损失约束投影一致性,再以条件视频生成合成时序稳定的腕视角。实验在 Droid、Calvin 和 Franka Panda 上显示其生成质量和空间一致性优于基线,并在 Calvin 上将 VLA 平均任务完成长度提升 3.81%,弥合 42.4% 的 anchor-wrist 性能差距。

TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics Figure 1
arXiv preprint2025-10-09

TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics

Yi Han, Enshen Zhou, Shanyu Rong, Jingkun An, Pengwei Wang, Zhongyuan Wang, Cheng Chi, Lu Sheng, Shanghang Zhang

Beihang University, Beijing Academy of Artificial Intelligence, State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University

6D位姿估计机器人操作

面向机器人操作中厘米级6D位姿、轨迹和约束计算需求,TIGeR指出现有VLM多停留在定性空间判断,难以利用深度与相机标定。其核心做法是让VLM识别几何问题、生成并执行代码调用外部几何工具,并用TIGeR-300K及SFT到RFT训练强化工具链。论文报告在几何推理基准达到SOTA,并在真实操作中实现厘米级精度。

Mobility-Aware Localization in mmWave Channel: Adaptive Hybrid Filtering Approach Figure 1
arXiv preprint2025-10-08

Mobility-Aware Localization in mmWave Channel: Adaptive Hybrid Filtering Approach

Abidemi Orimogunje12, Kyeong-Ju Cha2, Hyunwoo Park2, Abdulahi A. Badrudeen2, Sunwoo Kim2, Dejan Vukobratovic3

6D位姿估计

面向高速移动场景中毫米波定位易受速度变化、噪声失配和数据关联错误影响的问题,论文提出按里程计速度在低速 EKF 与高速 UKF 间切换的自适应混合滤波框架,并结合 Q/R 缩放、χ² 门控、虚拟锚点与 RTS 平滑。在 DeepMIMO 仿真中,行人 ATE 低于 0.25 m、车辆约 2 m,ATE/RPE/NEES/RMSE 相对基线提升约 30–60%。

Distributed 3D Source Seeking via SO(3) Geometric Control of Robot Swarms Figure 1
arXiv preprint2025-10-08

Distributed 3D Source Seeking via SO(3) Geometric Control of Robot Swarms

Jesús Bautista, Héctor García de Marina

Institute of Mathematics (IMAG) of University of Granada, Granada

6D位姿估计机器人操作

面向水下热泉、气体羽流、辐射源等未知三维标量场寻源任务,论文将分布式蜂群寻源从2D扩展到具一阶姿态动力学和恒定前进速度的3D机器人。核心是在SO(3)上直接设计比例前馈几何控制器,避免欧拉角奇异和四元数二义性,并证明机器人可指数对齐估计的上升方向、适应有界未知变化,同时保持非退化队形;数值仿真显示10机群能向源点收敛,代码开源。

The Framework That Survives Bad Models: Human-AI Collaboration For Clinical Trials Figure 1
arXiv preprint2025-10-08

The Framework That Survives Bad Models: Human-AI Collaboration For Clinical Trials

Yao Chen, David Ohlssen, Aimee Readie, Gregory Ligozio, Ruvie Martin, USA Corresponding author: thibaud.coroller@novartis.com

Novartis Pharmaceuticals Corporation

6D位姿估计

针对临床试验中直接用 AI 读片可能因模型退化而改变终点结论的风险,论文将 AI 作为辅助阅片者而非独立裁判,并用随机、朴素等“坏模型”压力测试框架。在两项脊柱 X 光三期试验中,AI-SR 在降低人工成本的同时,仍能保持疾病评分、治疗效应估计和试验结论稳定,并在不同患者人群上表现出较好泛化;但该工作与6D位姿估计关联不明显。

Terrain-Aided Navigation Using a Point Cloud Measurement Sensor Figure 1
arXiv preprint2025-10-07

Terrain-Aided Navigation Using a Point Cloud Measurement Sensor

Abdülbaki Şanlan, Fatih Erol, Murad Abu-Khalaf, Emre Koyuncu

6D位姿估计点云

这篇论文面向 GPS 受限场景下 INS 漂移难以约束的问题,研究如何用小规模地形点云与 DEM 生成有效量测残差来辅助非线性导航估计。核心在于比较逐粒子射线投影与更省算力的滑动网格两类点云量测模型,并分析高度可观性。实验显示,点云量测相较雷达高度计能提升导航精度;射线法更灵活但计算更重,模型选择取决于机载算力与地形复杂度。

RGBD Gaze Tracking Using Transformer for Feature Fusion Figure 1
arXiv preprint2025-10-07

RGBD Gaze Tracking Using Transformer for Feature Fusion

Tobias J. Bauer

6D位姿估计点云彩色深度

本文针对现有凝视估计数据集缺少深度信息或角度标签的问题,探索RGBD输入与Transformer特征融合,并自建OTH-Gaze-Estimation数据集及实时管线。关键洞察是Transformer融合并未带来收益:在ShanghaiTechGaze+上为55.3 mm,去掉预训练GAN降至30.1 mm,MLP融合进一步到26.9 mm;ETH-XGaze和自建集上无Transformer也更好,说明增益主要来自RGBD深度信息而非Transformer。

Human3R: Everyone Everywhere All at Once Figure 1
arXiv preprint2025-10-07

Human3R: Everyone Everywhere All at Once

Yue Chen, Xingyu Chen, Yuxuan Xue, Anpei Chen, Yuliang Xiu, Gerard Pons-Moll

Zhejiang University, Westlake University, University of T¨ubingen, T¨ubingen AI Center, Max Planck Institute for Informatics

6D位姿估计

针对单目随手拍视频中多人运动必须放到三维场景里理解、而现有方法依赖检测/跟踪/深度/SLAM与多阶段优化导致难以在线部署的问题,Human3R将CUT3R的时空先验冻结,通过视觉提示调优和以头部为锚的多人SMPL-X查询,在一次前向中联合估计世界坐标下的人体、稠密场景和相机。仅用BEDLAM训练一天即达到15 FPS、约8GB显存,并在全局人体运动、局部网格、视频深度和相机位姿上取得SOTA或竞争结果。

Safe Landing on Small Celestial Bodies with Gravitational Uncertainty Using Disturbance Estimation and Control Barrier Functions Figure 1
arXiv preprint2025-10-07

Safe Landing on Small Celestial Bodies with Gravitational Uncertainty Using Disturbance Estimation and Control Barrier Functions

Felipe Arenas-Uribe, T. Michael Seigler, Jesse B. Hoagg

6D位姿估计

面向小天体软着陆中质量与高阶引力场难以精确建模、传统鲁棒跟踪缺少安全约束保证的问题,论文将非线性扩展高增益观测器、反馈线性化跟踪控制与基于控制障碍函数的最小干预二次规划串联,在在线估计引力扰动的同时约束状态和推力。数值仿真表明,该方法可在不规则小天体场景下完成较激进轨迹的安全软着陆,但结果主要限于仿真验证。

DeLTa: Demonstration and Language-Guided Novel Transparent Object Manipulation Figure 1
arXiv preprint2025-10-07

DeLTa: Demonstration and Language-Guided Novel Transparent Object Manipulation

Taeyeop Lee 1∗, Gyuree Kang 1∗, Bowen Wen 2, Youngho Kim 1, Seunghyeok Back 3, In So Kweon 1, David Hyunchul Shim 1, Kuk-Jin Yoon 1

KAIST, NVIDIA

6D位姿估计机器人操作

透明物体因折射/反射导致深度感知和位姿估计不可靠,现有方法多停留在抓取或类别级泛化,难以支撑精细长程操作。DeLTa将深度补全、透明物体6D位姿、单次人类示教轨迹重定向与VLM任务规划结合,并用约束校验适配单臂眼在手机器人。实验显示其在需精确放置、倒取等长程任务中优于既有透明物体操作方法。

Generative AI-Driven Hierarchical Multi-Agent Framework for Zero-Touch Optical Networks Figure 1
IEEE Communications Magazine2025-10-07

Generative AI-Driven Hierarchical Multi-Agent Framework for Zero-Touch Optical Networks

Yao Zhang, Yuchen Song, Shengnan Li, Yan Shi, Shikui Shen, Xiongyan Tang, Min Zhang, Danshi Wang

Beijing University of Posts and Telecommunications, China United Network Communications Group (China)

6D位姿估计

面向光网络规模和带宽增长下的零接触运维,论文指出单一 LLM Agent 难以覆盖全生命周期的跨层、多任务协同。其核心是构建分层多智能体框架,以 Network Director 统筹任务分解,并通过光层、数字孪生、控制与支撑等专业 Agent 共享状态、调用工具和执行配置。在实地光网案例中,框架完成规划、动态信道删减和容量升级流程,QoT/GSNR 预测误差约低于 0.22–0.40 dB,展示了自动分配、执行与评估能力。

Correlation-Aware Dual-View Pose and Velocity Estimation for Dynamic Robotic Manipulation Figure 1
arXiv preprint2025-10-07

Correlation-Aware Dual-View Pose and Velocity Estimation for Dynamic Robotic Manipulation

Mahboubeh Zarei, Robin Chhabra, Farrokh Janabi-Sharifi

the Department of Mechanical, Industrial and Mechatronics Engineering, Toronto Metropolitan University, Toronto, Canada

6D位姿估计机器人操作

面向动态机器人操作中PBVS依赖稳定目标位姿、单一视角易受遮挡和噪声影响的问题,论文提出眼在手与眼到手双视角的去中心化估计框架:两路自适应李群EKF分别在SE(3)×R³×R³上联合预测位姿与速度,再用考虑相关性的李群融合规则合成状态。实机xArm 850与RealSense跟踪实验显示,该方法较现有融合或切换策略在精度和鲁棒性上有持续改进。

Quantum Filtering at Finite Temperature Figure 1
arXiv preprint2025-10-06

Quantum Filtering at Finite Temperature

John Gough

Aberystwyth University, SY23 BZ, Wales, United Kingdom

6D位姿估计

本文关注热态玻色环境下连续同宿测量的量子滤波问题,动机是标准真空/Fock情形无法刻画有限温度测量代数的更丰富对易结构。核心洞察是结合 Araki-Woods 双 Fock 表示与 Tomita-Takesaki 模理论,显式描述测量代数的对易子并推导相应滤波/量子轨迹构造;结果应用到 Davies-Fulling-Unruh 模型,将两套表示解释为左右 Rindler 楔场,但文中未给出实验验证。

MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts Figure 1
arXiv preprint2025-10-07

MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts

Andy Cǎtrunǎ, Adrian Cosma, Computer Science @upb.ro

University Politehnica of Bucharest

6D位姿估计人体姿态

本文关注步态除身份与生物力学外是否也能反映心理特质这一少研究问题,提出多阶段运动专家混合 MoME,将2D姿态步行序列按运动复杂度分层建模,并用任务特定门控在17个心理属性间选择共享或专门专家。在 PsyMo 上,方法取得 run-level 37.47%、subject-level 44.6% 加权 F1,且加入身份、性别和 BMI 等辅助任务可进一步提升表现。

Challenger-Based Combinatorial Bandits for Subcarrier Selection in OFDM Systems Figure 1
arXiv preprint2025-10-06

Challenger-Based Combinatorial Bandits for Subcarrier Selection in OFDM Systems

Mohsen Amiri, Venktesh V, Sindri Magnússon

6D位姿估计数据集/基准

面向OFDM下行中需在大量子载波组合里快速找出top-m调度集合的问题,论文将其建模为随机线性组合纯探索,避免全空间扫描。核心是CCS冠军—挑战者短名单与gap-index比较,只测量最可能改变排序的候选,并可调速度/精度。仿真显示在接近满准确率下,相比LinGapE、LinUGapE、LinGIFA显著减少比较和运行时间,最高报告约100×、15×、300×加速。

AgentTypo: Adaptive Typographic Prompt Injection Attacks against Black-box Multimodal Agents Figure 1
arXiv preprint2025-10-05

AgentTypo: Adaptive Typographic Prompt Injection Attacks against Black-box Multimodal Agents

Yanjie Li, Yiming Cao, Dong Wang, Bin Xiao, Fellow, IEEE

University, Hong Kong. (

6D位姿估计

针对LVLM网页代理依赖截图、易受视觉提示注入且黑盒攻击更贴近真实部署的问题,本文提出AgentTypo,将恶意文本以优化排版嵌入网页图像,并用贝叶斯优化位置、字号和颜色以兼顾可读重构与隐蔽性;AgentTypo-pro进一步通过多LLM反馈和策略库迭代改写注入提示。在VWA-Adv上,GPT-4o图像攻击ASR由23%升至45%,图文设置达68%,显示视觉排版注入是实际威胁。

Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation Figure 1
arXiv preprint2025-10-05

Joint Learning of Pose Regression and Denoising Diffusion with Score Scaling Sampling for Category-level 6D Pose Estimation

Seunghyun Lee, Tae-Kyun Kim KAIST @kaist.ac.kr

KAIST

6D位姿估计类别级位姿

面向类别级6D位姿中扩散方法训练收敛慢、采样候选需额外评分网络过滤的问题,本文将直接位姿回归用于编码器预训练并与扩散去噪联合学习,同时提出随时间变化的score scaling采样,在早期保留对称物体多模态、后期收敛到高质量位姿。REAL275、HouseCat6D和ROPE实验显示其单样本推理即可达到SOTA,并降低训练与推理开销。

Wrist2Finger: Sensing Fingertip Force for Force-Aware Hand Interaction with a Ring-Watch Wearable Figure 1
arXiv preprint2025-10-05

Wrist2Finger: Sensing Fingertip Force for Force-Aware Hand Interaction with a Ring-Watch Wearable

Yingjing Xiao, Zhichao Huang, Junbin Ren, Yuting Bai, Haichuan Song, Zhanpeng Jin, Yang Gao

East China Normal University, Shanghai, South China University of Technology

6D位姿估计手部姿态

针对视觉手势跟踪受遮挡/场地限制、手套或多环方案不便日常佩戴且缺少指尖力感知的问题,Wrist2Finger用单个IMU戒指加手表端单通道EMG,将局部运动与前臂肌肉激活通过双分支Transformer和跨模态注意力融合,同时估计3D手姿态与各指受力。20名用户日常交互实验中,MPJPE为0.57 cm,指尖力估计RMSE为0.213、相关系数r=0.76,并展示了实时Unity力感知交互。

TCB-VIO: Tightly-Coupled Focal-Plane Binary-Enhanced Visual Inertial Odometry Figure 1
arXiv preprint2025-10-04

TCB-VIO: Tightly-Coupled Focal-Plane Binary-Enhanced Visual Inertial Odometry

Matthew Lisondra, Junseo Kim, Glenn Takashi Shimoda, Kourosh Zareinia, Sajad Saeedi

University of Toronto, Delft University of Technology, Toronto Metropolitan University

6D位姿估计相机位姿

面向受算力、功耗和延迟限制的机器人位姿估计,TCB-VIO将焦平面传感器的片上并行视觉处理与IMU紧耦合,利用二值边缘/特征和改进KLT跟踪,在MSCKF框架下实现6DoF VIO。系统以250 FPS视觉和400 Hz IMU运行,实测优于ROVIO、VINS-Mono和ORB-SLAM3。

Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization Figure 1
Pattern Recognition2025-10-04

Adaptively Sampling-Reusing-Mixing Decomposed Gradients to Speed Up Sharpness Aware Minimization

Jiaxin Deng, Junbiao Pang Affiliation email@example.com

Beijing University of Technology, Nanchang Institute of Technology, Beijing Academy of Artificial Intelligence, Beihang University

6D位姿估计

针对 SAM 每步需两次前后向、训练成本约翻倍的问题,论文提出 ARSAM:将 SAM 梯度分解为 SGD 梯度与二阶梯度在一阶方向上的投影 PSF,并依据 PSF/SGD 范数比用自回归策略自适应采样、复用和混合 PSF。实验显示其在 CIFAR-10/100 等任务上基本保持 SAM 泛化性能,同时约加速 40%,在人姿估计和量化中也未明显损失性能。

Efficient Surgical Robotic Instrument Pose Reconstruction in Real World Conditions Using Unified Feature Detection Figure 1
arXiv preprint2025-10-03

Efficient Surgical Robotic Instrument Pose Reconstruction in Real World Conditions Using Unified Feature Detection

Zekai Liang, Kazuya Miyata, Xiao Liang, Florian Richter, Michael C. Yip

6D位姿估计机器人操作三维重建医学/手术

面向微创手术中长链、柔性器械在窄视野和遮挡下难以稳定相机到机器人标定的问题,论文将关键点与器械杆边缘统一为可学习几何特征,在单次网络推理中检测并结合投影几何与运动学先验求6D位姿;通过 Isaac Sim 合成随机化数据训练。实验显示其在特征检测和位姿重建上较既有关键点或渲染式方法更快且精度达到SOTA,但代码需论文接收后发布。

Geometry Meets Vision: Revisiting Pretrained Semantics in Distilled Fields Figure 1
arXiv preprint2025-10-03

Geometry Meets Vision: Revisiting Pretrained Semantics in Distilled Fields

Zhiting Mei, Ola Shorinwa, Anirudha Majumdar

Princeton University

6D位姿估计

本文针对蒸馏辐射场中“几何接地”语义是否优于纯视觉语义这一问题,比较 DINOv2/v3 与 VGGT,并提出无需初始位姿的 SPINE:先用蒸馏语义做粗位姿反演,再用光度优化细化。结果显示,VGGT 特征虽保留更清晰的结构细节,但在语义目标定位上无显著优势,且在辐射场反演/6D 位姿估计中反而低于纯视觉特征,提示当前几何接地并未稳定转化为机器人空间任务收益。

Deconstruction of the anisotropic magnetic interactions from spin-entangled optical excitations in van der Waals antiferromagnets Figure 1
arXiv preprint2025-10-03

Deconstruction of the anisotropic magnetic interactions from spin-entangled optical excitations in van der Waals antiferromagnets

Dipankar Jana, Swagata Acharya, Milan Orlita, Clement Faugeras, Dimitar Pashov, Mark van Schilfgaarde, Marek Potemski, Maciej Koperski

Institute for Functional Intelligent Materials, National University of Singapore, 117544, Singapore, National Renewable Energy Laboratory, Golden, CO, USA, Institute of Physics, Charles University, Ke Karlovu 5, Prague, 121 16, Czech Republic, King’s College London, Theory and Simulation of Condensed Matter, The Strand, WC2R LS London, UK, CENTERA, CEZAMAT, Warsaw University of Technology, 02-Warsaw, Poland, Institute of High Pressure Physics, PAS, 01-Warsaw, Poland, Department of Materials Science and Engineering, National University of Singapore, 117575, Singapore, Dimitar Pashov

6D位姿估计

针对范德华反铁磁体中磁有序与亚带隙光学跃迁机制难以区分的问题,本文结合高精度第一性原理、MBPT/DMFT与强磁场光谱,解析MnPS3和NiPS3的能带及自旋翻转激发来源。核心洞察是窄线宽发光/吸收共振主要来自局域在Mn或Ni原子的在位d-d自旋翻转,其磁场演化可反推出交换耦合、各向异性和g因子,为微米尺度样品的全光反铁磁探测提供依据。

VERNIER: an open-source software pushing marker pose estimation down to the micrometer and nanometer scales Figure 1
arXiv preprint2025-10-03

VERNIER: an open-source software pushing marker pose estimation down to the micrometer and nanometer scales

Patrick Sandoz, Antoine N. André, Guillaume J. Laurent

6D位姿估计

面向微纳机器人和显微操作中传统标记受视场、离焦与低对比限制、难以在大范围内获得6D高精度位姿的问题,VERNIER将伪周期标记的相位测量与粗绝对定位结合,并开源为C++库;其相位局部阈值流程提升了对噪声、离焦和遮挡的鲁棒性,可用HP/Stamp小标记或Megarena大图案覆盖不同场景,实现微米/纳米级分辨率与厘米级量程的高范围-分辨率比。

PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction Figure 1
arXiv preprint2025-10-02

PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction

Qiao Feng, Yiming Huang, Yufu Wang, Jiatao Gu, Lingjie Liu

University of Pennsylvania

6D位姿估计三维重建

针对单目人体运动重建常见的脚滑、穿地和接触不一致问题,PhysHMR不再先做运动估计再物理修正,而是在物理仿真中直接学习视觉到人形控制动作的统一策略。其关键是用2D关键点提升为3D空间射线提供软全局约束,并通过动捕专家蒸馏稳定视觉策略训练,再用强化学习细化。实验表明其在Human3.6M、AIST++、EMDB2上保持接近SOTA的运动精度,同时显著提升物理合理性。

A Bilevel Optimization Framework for Adversarial Control of Gas Pipeline Operations Figure 1
Actuators 2025, 14(10), 4802025-10-02

A Bilevel Optimization Framework for Adversarial Control of Gas Pipeline Operations

Tejaswini Sanjay Katale, Lu Gao, Yunpeng Zhang, Alaa Senouci

Department of Computer Science, University of Houston, Department of Civil and Environmental Engineering, University of Houston, Department of Information Science Technology, University of Houston

6D位姿估计

针对油气管网数字化后 SCADA/OT 易受隐蔽数据攻击、传统方法难以同时刻画水力动态与控制响应的问题,论文构建了物理约束的图模型,将扩展卡尔曼滤波、MPC 与双层 FDI 攻击优化结合,并用 KKT 转为 MIQP 求解。15 节点和 24 节点案例显示,攻击可在坏数据检测阈值内持续降低吞吐量,提示防护需把检测与控制联合设计。

Paving the Way Towards Kinematic Assessment Using Monocular Video: A Preclinical Benchmark of State-of-the-Art Deep-Learning-Based 3D Human Pose Estimators Against Inertial Sensors in Daily Living Activities Figure 1
Artificial Intelligence Review2025-10-02

Paving the Way Towards Kinematic Assessment Using Monocular Video: A Preclinical Benchmark of State-of-the-Art Deep-Learning-Based 3D Human Pose Estimators Against Inertial Sensors in Daily Living Activities

Mario Medrano-Paredes, Carmen Fernández-González, Francisco Javier Díaz Pernas, Hichem Saoudi, Javier González-Alonso, Mario Martínez‐Zarzuela

6D位姿估计人体姿态数据集/基准

面向远程康复和日常环境中的低成本运动学评估,本文用VIDIMU数据集将单目视频3D人体姿态模型与5个IMU经OpenSim得到的关节角进行系统对比,覆盖13类临床相关日常活动。核心洞察是现成视频模型已具备一定临床可用性,但在精度、成本与易用性上与传感器方案存在权衡;其中MotionAGFormer最佳,RMSE为9.27°±4.80°、MAE为7.86°±4.18°,Pearson相关达0.86。

Zero-shot Human Pose Estimation using Diffusion-based Inverse solvers Figure 1
arXiv preprint2025-10-02

Zero-shot Human Pose Estimation using Diffusion-based Inverse solvers

Sahil Bhandary Karnoor, IL 61820, USA @illinois.edu

Sahil Bhandary Karnoor & Romit Roy Choudhury, University of Illinois at Urbana-Champaign

6D位姿估计人体姿态

针对少量身体传感器下的人体全身姿态估计难以跨体型泛化的问题,InPose 将姿态拆分为与尺度无关的关节旋转先验和依赖体型的关节位置约束,把任务表述为扩散逆问题:先用仅条件于旋转测量的预训练扩散模型生成先验,再用由位置测量和用户骨长构成的似然引导去噪。实验在 AMASS 上显示其对不同体型具备较好的零样本泛化,但默认体型下未能稳定超过基线,且下肢误差和需已知骨长仍是限制。

A Copula-based variational autoencoder for uncertainty quantification in inverse problems: application to damage identification in an offshore wind turbine Figure 1
arXiv preprint2025-11-04

A Copula-based variational autoencoder for uncertainty quantification in inverse problems: application to damage identification in an offshore wind turbine

Ana Fernandez-Navamuel, Martin A. Díaz Viera, Matteo Croci

Basque Center for Applied Mathematics (BCAM), Bilbao, Spain Bilbao, Spain

6D位姿估计

面向浮式海上风机系泊损伤诊断,有限运动传感数据会导致反问题多解且不确定性难以量化。论文将VAE的编码器/解码器分别对应逆/正算子,并用Copula解耦边缘分布与依赖结构以表达复杂后验。在高保真合成数据上,Gaussian Copula VAE达到与高斯混合相近的识别与不确定性效果,但参数更少、在高维潜空间更可扩展。

An Efficient Deep Template Matching and In-Plane Pose Estimation Method via Template-Aware Dynamic Convolution Figure 1
Expert Systems with Applications2025-10-02

An Efficient Deep Template Matching and In-Plane Pose Estimation Method via Template-Aware Dynamic Convolution

Ke Jia : 1, Ji Zhou : 2, Hanxin Li, Zhigan Zhou, Haojie Chu, Xiaojie Li

Chengdu University of Information Technology, Ningbo University

6D位姿估计

面向工业检测与装配中需同时定位并估计平面旋转、非等比缩放的模板匹配问题,论文将匹配改写为中心点与几何参数的端到端回归,并用模板感知动态卷积在推理时注入模板特征,配合伪标签自监督增强和局部细化提升姿态精度。实验显示3.07M模型在复合变换下约14ms推理,并在小模板、多目标场景保持较好鲁棒性。

Pose Estimation of a Thruster-Driven Bioinspired Multi-Link Robot Figure 1
arXiv preprint2025-10-01

Pose Estimation of a Thruster-Driven Bioinspired Multi-Link Robot

Nicholas B. Andrews, Yanhao Yang, Sofya Akhetova, Kristi A. Morgansen, Ross L. Hatton

Department of Aeronautics and Astronautics, University of Washington, Seattle, WA, USA, Collaborative Robotics and Intelligent Systems (CoRIS) Institute, Oregon State University, Corvallis, OR, USA [ yangyanh , ross.hatton

6D位姿估计机器人操作

面向受海鞘启发的自由漂浮多连杆机器人,论文关注无关节编码器、每节仅陀螺仪且由推进器欠驱动时的6D位姿与形状估计。其核心是用UKF结合高斯过程残差补偿非高斯、非零均值噪声,并从可观测Gramian提出步态激励与关节角估计质量的联系。硬件离线实验显示关节形状可稳定估计,但绝对位姿因纯陀螺积分仍漂移;多步态GP与单前进步态训练效果接近,提示可复用输入空间以减少逐步态数据需求。

A Stochastic Framework for Continuous-Time State Estimation of Continuum Robots Figure 1
arXiv preprint2025-10-01

A Stochastic Framework for Continuous-Time State Estimation of Continuum Robots

Spencer Teetaert, Sven Lilge, Jessica Burgner-Kahrs, Timothy D. Barfoot

6D位姿估计机器人操作

针对连续体机器人在未知接触、外力扰动和高频异步传感下难以用精确动力学实时估计状态的问题,论文将连续时间运动学与白噪声高斯过程先验嵌入因子图,在时空上联合估计位姿、速度与应变及其协方差,并支持常数时间插值。实验在带陀螺仪和位姿传感的连续体机器人上验证了其对动态效应、数据丢失和多传感融合的适应性,且线性求解复杂度随时间增长。

Is It Thinking or Cheating? Detecting Implicit Reward Hacking by Measuring Reasoning Effort Figure 1
arXiv preprint2025-10-07

Is It Thinking or Cheating? Detecting Implicit Reward Hacking by Measuring Reasoning Effort

Xinpeng Wang, Nitish Joshi, Barbara Plank, Rico Angell, He He LMU Munich, MCML

New York University

6D位姿估计

针对链式思维看似正常却借奖励漏洞得分的隐式 reward hacking,论文提出 TRACE:不判读完整 CoT,而是逐段截断推理并测量多早即可获得奖励,用奖励-长度曲线 AUC 表征“过低推理努力”。在数学和代码的模拟上下文/奖励模型漏洞中,TRACE 相比强 CoT 监控器分别取得约 65% 和 30% 以上检测增益,并可通过分数聚类发现被利用的漏洞;但真实复杂漏洞下效果仍文中未充分说明。

Efficient Uncertainty Estimation for LLM-based Entity Linking in Tabular Data Figure 1
arXiv preprint2025-09-24

Efficient Uncertainty Estimation for LLM-based Entity Linking in Tabular Data

Carlo Alberto Bono, Federico Belotti, Matteo Palmonari

6D位姿估计

该文关注表格实体链接中LLM虽准确但缺少低成本置信度的问题,尤其多次采样估计不确定性在大规模数据上代价过高。核心做法是用一次生成中的token概率、熵及可选中间层信号,自监督回归逼近多次生成得到的“不确定性”。实验显示,该估计与多采样不确定性相关性较强,能有效筛出低准确输出,并以较小warm-up成本支持人工复核优先级;与仓库的6D位姿标签关联不清。

Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Models Figure 1
arXiv preprint2025-10-01

Temporal Score Rescaling for Temperature Sampling in Diffusion and Flow Models

Yanbo Xu, Yu Wu : 1, Sungjae Park, Zhizhou Zhou

Carnegie Mellon University Stanford University

6D位姿估计

本文针对扩散/flow模型推理时难以在“更可信”和“更多样”样本间调温的问题,提出Temporal Score Rescaling:按时间重缩放噪声分布的score,以近似控制局部采样温度,无需微调且兼容确定性/随机采样。实验覆盖图像、6D位姿、深度、机器人操作和蛋白设计,显示可收紧位姿/深度预测分布并提升精度,也能在图像生成中适度增大多样性;但其主要改变局部方差而非全局模态权重。

A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Features Figure 1
arXiv preprint2025-10-01

A Scene is Worth a Thousand Features: Feed-Forward Camera Localization from a Collection of Image Features

Axel Barroso-Laguna, Tommaso Cavallari, Victor Adrian Prisacariu, Eric Brachmann

University of Oxford

6D位姿估计

本文针对视觉定位中建图耗时从分钟到小时的问题,提出 FastForward:用少量带 3D 锚点的多视图图像特征作为场景表示,并在一次前向传播中预测查询图像的场景坐标,再求解 6D 相机位姿。其关键洞察是无需完整 SfM 点云或逐场景训练,数百个映射特征已可支撑有效定位;结合图像检索后,方法在极低建图开销下达到或接近现有最佳精度,并在未见域和大规模户外场景中表现出较强泛化。

Enabling High-Frequency Cross-Modality Visual Positioning Service for Accurate Drone Landing Figure 1
arXiv preprint2025-10-01

Enabling High-Frequency Cross-Modality Visual Positioning Service for Accurate Drone Landing

Haoyang Wang, Xinyu Luo, Wenhua Ding, Jingao Xu, Xuecheng Chen, Ruiyang Duan, Jialong Chen, Haitao Zhang, Yunhao Liu, Xinlei Chen

Haoyang Wang, Xinyu Luo, Wenhua Ding, and Xuecheng Chen are with Shenzhen International Graduate School, Tsinghua University, China

6D位姿估计

面向城市无人机降落中 GPS 不可靠、RGB-VPS 易受运动模糊和低帧率限制的问题,论文提出基于事件相机的 EV-Pose。其关键在于用时空特征构建 temporal distance field 以匹配 3D 点图,并结合运动感知的事件过滤与层级融合优化提升效率和精度。实验报告旋转误差 1.34°、平移误差 6.9 mm、延迟 10.08 ms,相比基线提升超过 50%。

Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation Figure 1
arXiv preprint2025-10-01

Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation

Taeyun Woo KAIST taeyun.woo@kaist.ac.kr, Jinah Park KAIST jinahpark@kaist.ac.kr, Tae-Kyun Kim KAIST kimtaekyun@kaist.ac.kr

KAIST

6D位姿估计手部姿态

针对单阶段或确定性级联手部重建难以处理自遮挡、复杂关节带来的多解不确定性,本文把扩散模型引入粗到细流程:先采样多样3D关节假设,再以关节样本和图像特征条件化Mesh LDM在潜空间生成手网格,从而学习分布感知的关节—网格关系。实验在FreiHAND和HO3Dv2上报告达到SOTA,并能输出姿态分布。

Affordance-Guided Diffusion Prior for 3D Hand Reconstruction Figure 1
arXiv preprint2025-10-01

Affordance-Guided Diffusion Prior for 3D Hand Reconstruction

Naru Suzuki, Takehiko Ohkawa, Tatsuro Banno, Jihyun Lee, Ryosuke Furuta, Yoichi Sato

The University of Tokyo, KAIST

6D位姿估计手部姿态三维重建

面向单目手物交互中自遮挡和物体遮挡导致的3D手姿态歧义,论文将物体形状、尺寸、动作意图和抓握类型等可供性扩展为文本描述,并用VLM生成、CLIP编码后条件化扩散先验,从HaMeR初值出发重点细化被遮挡关节。在HOGraspNet上,该方法优于HaMeR等回归模型和无语义条件的扩散细化,生成的抓握也更符合功能语境。

Numerical analysis of 2D Navier--Stokes equations with nonsmooth initial value in the critical space Figure 1
arXiv preprint2025-10-01

Numerical analysis of 2D Navier--Stokes equations with nonsmooth initial value in the critical space

Buyang Li, Qiqi Rao, Hui Zhang, Zhi Zhou

6D位姿估计

本文针对二维 Navier–Stokes 方程在临界 L2 非光滑初值下数值解正则性不足、既有理论只能证明一阶收敛的问题,构造 Taylor–Hood/Stokes-MINI 有限元与 IMEX Runge–Kutta 分级时间步的全离散格式,并借助离散半群、负范数估计及 Raviart–Thomas 无散投影证明时空近二阶误差界;数值实验支持该结论,且显示空间收敛即使用高阶元也至多二阶。

Complexity and hardness of random peaked circuits Figure 1
arXiv preprint2025-09-30

Complexity and hardness of random peaked circuits

Yuxuan Zhang

Vector Institute for Artificial Intelligence, W1140-College Street, Schwartz Reisman Innovation Campus, Toronto, Ontario M5G 0C6, Canada

6D位姿估计

本文面向量子优势中“可实现、难经典模拟、可验证”难以兼得的问题,研究随机 peaked circuits。核心洞察是用后选择/变分搜索构造局部仍像随机电路、但在指定输出串上有高概率峰值的电路,并证明其通常不可压缩、复杂度为 Ω~(nk)。进一步给出峰值估计的平均情形 #P-hard 结果,讨论 BQP-complete 精度区间,并以电路拼接扩展到更大规模的可验证量子优势实例。

Eccentric binary black holes: A new framework for numerical relativity waveform surrogates Figure 1
Physical Review Research2025-10-02

Eccentric binary black holes: A new framework for numerical relativity waveform surrogates

Peter James Nee, Adhrit Ravichandran, Scott E. Field, Tousif Islam, Harald P. Pfeiffer, Vijay Varma, Michael Boyle, Andrea Ceja, Noora Ghadiri, Lawrence E. Kidder, Prayush Kumar, Akash Maurya, Marlo Morales, Antoni Ramos-Buades, Abhishek Ravishankar, Katie Rink, Hannes R. Rüter, Mark A. Scheel, Md Arif Shaikh, Daniel Tellez

6D位姿估计

针对偏心双黑洞引力波在常规替代模型中因偏心退相干而难以压缩、且计算成本阻碍参数估计的问题,论文将吸积旋近阶段重参数化到径向相位域,并与时域并合—铃降替代模型及径向准周期扩展训练结合。在156个非自旋NR模拟的(2,2)模上,NRSurE_q4NoSpin_22最大失配约5×10^-4、中位数约2×10^-5。

Enhancing Safety in Diabetic Retinopathy Detection: Uncertainty-Aware Deep Learning Models with Rejection Capabilities Figure 1
arXiv preprint2025-09-26

Enhancing Safety in Diabetic Retinopathy Detection: Uncertainty-Aware Deep Learning Models with Rejection Capabilities

Madhushan Ramalingam, Yaish Riaz, Priyanthi Rajamanoharan, Piyumi Dasanayaka

6D位姿估计

针对糖尿病视网膜病变自动筛查中深度模型“高置信误判”带来的临床风险,论文在CNN末端引入变分贝叶斯线性层以估计不确定性,并用低置信拒判模拟转诊复核。结果显示模型在覆盖率与可靠性间存在明确权衡:更保守的贝叶斯模型会拒绝不确定样本,提高已接收预测的可信度,并以ECE等指标评估校准,但具体数据集细节和增益来源文中未充分说明。

TTT3R: 3D Reconstruction as Test-Time Training Figure 1
arXiv preprint2025-10-16

TTT3R: 3D Reconstruction as Test-Time Training

Xingyu Chen, Yue Chen, Yuliang Xiu, Andreas Geiger, Uni of Tübingen, Tübingen AI Center

Zhejiang University, Westlake University, Uni of Tübingen, Tübingen AI Center

6D位姿估计三维重建

针对Transformer式三维重建难以长序列扩展、RNN式CUT3R虽省显存却在超出训练长度后遗忘严重的问题,TTT3R将循环状态更新解释为测试时在线学习,把状态视作fast weights,并用状态与新观测的对齐置信度推导闭式自适应学习率,在不训练、不加参数的前向过程中抑制低质量更新。实验显示其显著改善长序列长度泛化,全球位姿估计约达基线2倍,同时可用约6GB显存、20FPS处理上千张图像。

Radio-based Multi-Robot Odometry and Relative Localization Figure 1
arXiv preprint2025-09-30

Radio-based Multi-Robot Odometry and Relative Localization

Andrés Martínez-Silva, David Alejo, Luis Merino, Fernando Caballero

6D位姿估计相机位姿机器人操作

针对雾尘、弱光等场景中视觉/LiDAR易失效且多机器人需统一定位的问题,本文将车载/机载UWB测距与雷达里程计结合,用非线性最小二乘估计UGV-UAV相对变换,并作为跨机器人因子加入位姿图优化,同时提供贴近实测噪声的Gazebo UWB插件。SITL与真实数据验证表明,相对定位模块较闭式方法更抗噪,系统可实时运行并具备扩展到SLAM的潜力。

Computationally and statistically efficient estimation of time-smoothed counterfactual curves Figure 1
arXiv preprint2025-09-30

Computationally and statistically efficient estimation of time-smoothed counterfactual curves

Herbert P. Susmann, Nicholas T. Williams, Richard Liu, Jessica G. Young, Iván Díaz

Division of Biostatistics, Department of Population, Health, New York University Grossman School of Medicine, New York, USA, Department of Epidemiology, Mailman School of Public Health, Columbia University, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, USA

6D位姿估计

针对纵向观察研究中多时间点结局缺失严重、逐时点估计反事实效应曲线精度低的问题,论文提出一种面向LMTP干预的时间平滑、多重稳健广义g公式估计器,并用等距回归约束伪回归、将计算量由O(τ²)降至O(τ)。模拟显示其在高缺失和强混杂下方差更低、运行更快,并用于估计工会成员身份对工资的长期影响。

Side Scan Sonar-based SLAM for Autonomous Algae Farm Monitoring Figure 1
arXiv preprint2025-09-30

Side Scan Sonar-based SLAM for Autonomous Algae Farm Monitoring

Julian Valdez, Ignacio Torroba, John Folkesson, Ivan Stenius

KTH Royal Institute of Technology

6D位姿估计相机位姿

面向海藻养殖场中低成本 AUV 因声学信标昂贵、视觉易受水质影响而难以安全导航的问题,论文提出基于侧扫声呐的图 SLAM:不在前端强行匹配绳索段,而将每次 ping 的绳索检测建模为独立地标,并用沿绳方向高不确定的“滑动”先验约束横向漂移。真实养殖场数据的 HIL 实验显示,该稀疏图可实时增量优化,在线轨迹与结构建图优于对比方法,但结果主要基于单一数据集。

A Multi-purpose Tracking Framework for Salmon Welfare Monitoring in Challenging Environments Figure 1
arXiv preprint2025-09-30

A Multi-purpose Tracking Framework for Salmon Welfare Monitoring in Challenging Environments

Espen Uri Høgstedt, Christian Schellewald, Annette Stahl, Technology, Norway SINTEF Ocean, Norway espen.b.hogstedt@ntnu.no, christian.schellewald@sintef.no, annette.stahl@ntnu.no, rudolf.mester@ntnu.no

Norwegian University of Science and Technology, Norway

6D位姿估计

面向工业网箱中遮挡、外观相似和转身导致的三文鱼身份混淆,论文提出 BoostCompTrack:先用自顶向下姿态网络同时定位整鱼与身体部位,再分别跟踪并融合多尺度关联,以部位轨迹支撑福利指标计算。在 CrowdedSalmon、TurningSalmon 上优于 BoostTrack,并可估计尾拍波长;但长期个体重识别效果仍文中未充分说明。

Network Consensus in the Wasserstein Space of Probability Measures Defined on Multi-Dimensional Euclidean Spaces Figure 1
arXiv preprint2025-09-30

Network Consensus in the Wasserstein Space of Probability Measures Defined on Multi-Dimensional Euclidean Spaces

Pilgyu Jung, Yoon Mo Jung

Department of Mathematics, Sungkyunkwan University

6D位姿估计

本文关注多智能体状态为概率分布时的共识问题,动机是将传统欧氏平均推广到高维 Wasserstein 空间,但该空间正曲率导致既有一维收敛证明失效。论文以 Wasserstein 重心作为更新规则,引入 Wasserstein 版 Jensen 不等式和相应凸泛函来获得可用的凸性估计,并在时变网络连通性与交互权重条件下证明高维概率测度共识动力学收敛到共同分布。

Ingress Cryogenic Receivers Toward Scalable Quantum Information Processing: Theory and System Analysis Figure 1
arXiv preprint2025-09-30

Ingress Cryogenic Receivers Toward Scalable Quantum Information Processing: Theory and System Analysis

Malek Succar, Mohamed I. Ibrahim

of Electrical and Computer Engineering, Cornell University, Ithaca

6D位姿估计

为突破同轴线在低温量子比特控制中的热负载、体积和成本瓶颈,论文提出多路复用的全被动低温高频直接检测接口 cryo-HFDD,用光纤或 140–220GHz 子太赫兹介质波导传输调制 RF 脉冲,并在低温端直接检波。其核心洞察是把主要约束转化为满足量子比特 SNR 所需的主动热负载,系统分析显示 4K 光子接收机有望扩展到数千量子比特控制;但结果主要来自理论 scaling,缺少实验验证。

LaTo: Landmark-tokenized Diffusion Transformer for Fine-grained Human Face Editing Figure 1
arXiv preprint2025-09-30

LaTo: Landmark-tokenized Diffusion Transformer for Fine-grained Human Face Editing

Zhenghao Zhang, Ziying Zhang, Junchao Liao, Xiangyu Meng, Qiang Hu Siyu Zhu, Xiaoyun Zhang, Long Qin

Alibaba Cloud Computing Shanghai Jiao Tong University Fudan University

6D位姿估计

针对指令式人脸编辑中语义可控但细粒度属性难控、姿态/表情变化时身份易漂移的问题,LaTo不再把关键点渲染成稠密图像,而是将原始坐标离散为landmark tokens,并用位置映射编码与关键点感知CFG在DiT中解耦几何、外观和文本;同时构建HFL-150K并用VLM预测目标关键点。实验报告身份保持提升7.8%、语义一致性提升4.6%,但增益可能部分来自数据规模。

Physics-Informed Learning for Human Whole-Body Kinematics Prediction via Sparse IMUs Figure 1
arXiv preprint2025-09-30

Physics-Informed Learning for Human Whole-Body Kinematics Prediction via Sparse IMUs

Cheng Guo, Giuseppe L’Erario, Giulio Romualdi, Mattia Leonori, Marta Lorenzini, Arash Ajoudani, Daniele Pucci

Artificial and Mechanical Intelligence, Italian Institute of Technology, Genoa, Italy, Department of Computer Science, The University of Manchester, Manchester, United Kingdom, Human-Robot Interfaces and Interaction, Italian Institute of Technology, Genoa, Italy

6D位姿估计人体姿态

面向人机协作中仅有稀疏可穿戴传感、且需要提前预测而非事后重建的场景,论文用5个IMU预测人体全身关节运动。核心做法是在网络训练中加入URDF人体模型的正运动学与微分运动学损失,并在推理时用上一帧预测维护关节状态缓冲,以约束物理可行性和运动连续性。实验显示该方法在仿真与真实数据上精度较高、动作切换更平滑,并能泛化到未见受试者。

Hyperbolic Monge-Ampère Equation on a Cylinder: Well-Posedness and Stability Figure 1
arXiv preprint2025-09-29

Hyperbolic Monge-Ampère Equation on a Cylinder: Well-Posedness and Stability

Maria Deliyianni, Shankar C. Venkataramani

6D位姿估计

本文并非6D位姿估计工作,而是为薄弹性片褶皱所对应的柱面双曲 Monge–Ampère 方程建立刚性解理论。其核心洞察是用“部分凸性”替代高光滑性刻画刚性,并通过 hodograph 变换把非线性方程化为线性阻尼波方程;针对 Cauchy–Goursat 边界交汇处的角奇性,提出 parametrix-corrector 分解并化为奇异 Volterra 方程。主要结果是证明 hodograph 弱解的存在唯一性,并给出曲率扰动下的能量稳定估计。

Robust Visual Localization in Compute-Constrained Environments by Salient Edge Rendering and Weighted Hamming Similarity Figure 1
arXiv preprint2025-09-29

Robust Visual Localization in Compute-Constrained Environments by Salient Edge Rendering and Weighted Hamming Similarity

Tu-Hoa Pham, Philip Bailey, Daniel Posada, Georgios Georgakis, Jorge Enriquez, Surya Suresh, Marco Dolci, Philip Twu

J. Enriquez is with Amazon, 400 9th Ave N, Seattle, WA 98109, USA, S. Suresh is with Ohio State University, 281 W Lane Ave, Columbus, OH 43210, USA

6D位姿估计相机位姿

面向火星样本返回中机械臂需在单目、200MHz/10MB级算力下完成高精度6D定位的需求,论文提出基于显著边缘渲染的迭代render-and-compare流程,并用面向边缘域的加权汉明相似度弥合低保真无纹理模型与真实图像差异。实验覆盖合成、地面试验台和火星实拍图像,报告在时限内达到100%定位成功率,精度和鲁棒性优于受限算力下的基线,但仍对较大平面内旋转误差敏感。

VGGT-X: When VGGT Meets Dense Novel View Synthesis Figure 1
arXiv preprint2025-10-08

VGGT-X: When VGGT Meets Dense Novel View Synthesis

Yang Liu, Chuanchen Luo, Zimo Tang, Junran Peng, Zhaoxiang Zhang NLPR, MAIS, Technology Beijing, Linketic @ia.ac.cn, u202315173@hust.edu.cn chuanchen.luo@sdu.edu.cn, jrpeng4ever@126.com

NLPR, MAIS, Institute of Automation, Chinese Academy of Sciences, University of Chinese Academy of Sciences, Huazhong University of Science and Technology, Shandong University University of Science and Technology Beijing Linketic

6D位姿估计

本文关注将 VGGT 等 3D 基础模型用于密集新视角合成时的瓶颈:显存随视图数暴涨,且预测噪声会破坏对初始化敏感的 3DGS 训练。VGGT-X 通过省显存推理扩展到千张图、基于极线约束的自适应全局对齐,以及更鲁棒的 3DGS/位姿联合优化来替代 COLMAP 初始化。实验显示其在无 COLMAP 的密集 NVS 与位姿估计上达到 SOTA,并显著缩小与 COLMAP 管线的渲染差距。

PAD3R: Pose-Aware Dynamic 3D Reconstruction from Casual Videos Figure 1
arXiv preprint2025-09-29

PAD3R: Pose-Aware Dynamic 3D Reconstruction from Casual Videos

Ting-Hsuan Liao, Haowen Liu, Yiran Xu, Songwei Ge, Gengshan Yang, Jia-Bin Huang

University of Maryland College Park

6D位姿估计三维重建

PAD3R针对随手拍、无位姿单目长视频中相机大幅运动、物体非刚性形变和视角覆盖不足导致的动态三维重建困难,先用图像到3D先验生成规范模型并训练个性化物体中心6D位姿估计器,再以长程2D点跟踪和多chunk策略正则化可变形3D Gaussian优化。实验覆盖合成与真实视频,报告在重建质量、时间一致性和真实相机运动鲁棒性上优于现有方法。

YOLO26: Key Architectural Enhancements and Performance Benchmarking for Real-Time Object Detection Figure 1
arXiv preprint2025-09-30

YOLO26: Key Architectural Enhancements and Performance Benchmarking for Real-Time Object Detection

Ranjan Sapkota, Rahul Harsha Cheppally, Ajay Sharda, Biological, Environmental Engineering, Ithaca, NY 14850, USA rs2672@cornell.edu, Agricultural Engineering, Manhattan, KS 66502, USA

Cornell University, Biological & Environmental Engineering, Ithaca, NY 14850, USA, Kansas State University, Department of Biological and Agricultural Engineering, Manhattan, KS 66502, USA

6D位姿估计数据集/基准

面向机器人等边缘实时感知中精度、延迟与部署复杂度难以兼顾的问题,本文梳理并基准评测YOLO26:通过去除DFL、端到端免NMS推理、ProgLoss、STAL小目标分配和MuSGD优化器简化检测管线,并扩展到分割、关键点/姿态、旋转框等任务。结果显示其在Jetson Nano/Orin及TensorRT FP16场景下相对多代YOLO和RT-DETR类模型取得更优准确率—延迟权衡,但具体增益来源和独立复现细节文中未充分说明。

Pretraining Large Language Models with NVFP4 Figure 1
arXiv preprint2025-09-29

Pretraining Large Language Models with NVFP4

NVIDIA

NVIDIA

6D位姿估计

为降低前沿大模型预训练的算力、显存与能耗成本,论文研究将FP8进一步压到NVFP4的可行性。核心做法是结合更细粒度微缩放、二维量化、随机Hadamard变换、随机舍入及少量高精度层,以缓解4比特训练的离群值和梯度偏差问题。在12B模型、10万亿token训练中,损失与下游精度接近FP8基线,MMLU-pro为62.58%对62.62%。

Bayesian Surrogates for Risk-Aware Pre-Assessment of Aging Bridge Portfolios Figure 1
arXiv preprint2025-09-29

Bayesian Surrogates for Risk-Aware Pre-Assessment of Aging Bridge Portfolios

Sophia V. Kuhn, Rafael Bischof, Marius Weber, Antoine Binggeli Michael A. Kraus, Walter Kaufmann, ETH Zurich, Switzerland Computational Design Lab, Switzerland Design ++, Design, TU Darmstadt, Switzerland Bank for International Settlements, Switzerland *Correspondence to kuhnso@ethz.ch

Institute of Structural Engineering, ETH Zurich, Switzerland, Computational Design Lab, ETH Zurich, Switzerland, Design ++, ETH Zurich, Switzerland, Institute of Structural Mechanics and Design, TU Darmstadt, Germany, Department of Computer Science, ETH Zurich, Switzerland

6D位姿估计

面向老化桥梁组合的评估瓶颈,论文用参数化非线性有限元流水线生成约1.1万座钢筋混凝土框架桥数据,并训练带校准认知不确定性的贝叶斯神经网络替代模型,预测规范符合系数以支持风险分级。案例显示其可在输入信息有限时筛出需精细分析的结构,减少不必要仿真和加固,但收益大小依赖组合分布与人工建模成本假设。

Uncertainty-Aware Deep Learning for Wildfire Danger Forecasting Figure 1
arXiv preprint2025-09-29

Uncertainty-Aware Deep Learning for Wildfire Danger Forecasting

Spyros Kondylatos, Gustau Camps-Valls, Ioannis Papoutsis

6D位姿估计

面对深度学习火险预报易过度自信、难以用于应急决策的问题,本文将短期野火危险预测建模为带不确定性的分类任务,联合估计认知不确定性与偶然不确定性,并分析二者随预报时长的作用。最佳模型在次日预测中较确定性基线F1提升2.3%、ECE降低2.1%,还能通过不确定性阈值拒绝低置信预测;十日预测显示偶然不确定性随时长上升,而模型不确定性较稳定。

SDPose: Exploiting Diffusion Priors for Out-of-Domain and Robust Pose Estimation Figure 1
arXiv preprint2025-09-29

SDPose: Exploiting Diffusion Priors for Out-of-Domain and Robust Pose Estimation

PAGE 1, Shuang Liang1, Jing He3, Chuanmeizhi Wang1, Lejun Liao2

Rama Alpaca Technology, Boston College, HKUST (GZ), The University of Hong Kong, Research Institute of Tsinghua University in Shenzhen, HKUST

6D位姿估计

针对现有人体姿态估计在艺术风格、机器人外观和常见图像退化下泛化明显下降的问题,SDPose将预训练 Stable Diffusion U-Net 作为骨干,分析不同上采样层的跨域表征,选择更稳健的层级进行多尺度融合,并用关键点热图监督结合RGB潜变量重建来保留扩散先验。论文还构建COCO-OOD评测集;实验显示其在COCO上接近Sapiens,在COCO-WholeBody、HumanArt及COCO-OOD上取得更强跨域与鲁棒结果。

Retro: Optimizing LLMs for Reasoning-Intensive Document Retrieval Figure 1
arXiv preprint2025-09-29

Retro: Optimizing LLMs for Reasoning-Intensive Document Retrieval

Junwei Lan, Jianlyu Chen, Zheng Liu, Chaofan Li, Siqi Bao, Defu Lian

University of Science and Technology of China, Beijing Academy of Artificial Intelligence, Beijing University of Posts and Telecommunications, State Key Laboratory of Cognitive Intelligence, Hong Kong Polytechnic University, Hong Kong University of Science and Technology

6D位姿估计

本文关注 RAG/LLM agent 中“间接相关”文档难以检索的问题,动机是传统检索多依赖表层语义,难以判断设计模式、定理来源等隐含关联。Retro* 将检索改为基于 rubric 的逐文档相关性打分,并通过多条推理轨迹的分数融合实现测试时 scaling;训练上结合 SFT 与带文档内、文档间复合奖励的强化学习。实验在 BRIGHT 的科学、数学和编程任务上超过现有强基线,达到 SOTA。

Finding an Initial Probe Pose in Teleoperated Robotic Echocardiography via 2D LiDAR-Based 3D Reconstruction Figure 1
arXiv preprint2025-09-29

Finding an Initial Probe Pose in Teleoperated Robotic Echocardiography via 2D LiDAR-Based 3D Reconstruction

Mariadas Capsran Roshan, Edgar M Hidalgo, Mats Isakssson, Michelle Dunn, Jagannatha Charjee Pyaraka

6D位姿估计点云机器人操作三维重建

面向远程机器人超声中心脏探头初始放置耗时、依赖专家的问题,本文用安装在机械臂上的轻量2D LiDAR通过两次线性扫描重建胸前表面,并结合平面外参标定、非刚性模板匹配与局部法向估计给出6D初始位姿,避免RGB/深度相机对光照和外部布置的依赖。实验中标定RMS残差1.82 mm、旋转不确定性低于0.2°,假人体表重建误差2.78±0.21 mm;5名真人中初始点距临床标注约20–30 mm,同一受试者重复误差小于4 mm。

Beyond Softmax: A Natural Parameterization for Categorical Random Variables Figure 1
arXiv preprint2025-09-29

Beyond Softmax: A Natural Parameterization for Categorical Random Variables

Alessandro Manenti, Cesare Alippi Università della Svizzera italiana, IDSIA, Lugano, Switzerland. Politecnico di Milano, Milan, Italy. @usi.ch, Cesare Alippi

6D位姿估计

针对潜在类别变量在强化学习、图结构学习和生成模型中难以用梯度稳定训练的问题,论文从信息几何角度指出 softmax 会产生稠密 Fisher 信息矩阵并扭曲优化路径,提出由层级二元划分构成的 catnat 参数化,使 FIM 对角化。实验覆盖图结构学习、VAE 和强化学习,显示其相对 softmax 带来更稳定收敛和更高测试性能;与6D位姿估计的直接关系文中未充分说明。

Observability estimates for the Schrödinger equation on the equilateral triangle Figure 1
arXiv preprint2025-09-29

Observability estimates for the Schrödinger equation on the equilateral triangle

Paul Alphonse, David Lafontaine

Toulouse Mathematics Institute, Centre National de la Recherche Scientifique

6D位姿估计

本文动机是理解薛定谔方程在带边界非矩形区域上的可观测性与零可控性,尤其是否可摆脱几何控制条件。核心做法是利用 Pinsky 平铺将等边三角形问题转化到有理扭曲环面,并结合奇性传播、Zygmund 与 Strichartz 估计。主要结果是在 Dirichlet/Neumann 条件下,对非零粗糙定位函数建立可观测估计,并推出相应零可控性。

SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Robotics Figure 1
arXiv preprint2025-09-29

SCOPE: Semantic Conditioning for Sim2Real Category-Level Object Pose Estimation in Robotics

Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel, Matthias Hirschmanner, Markus Vincze

6D位姿估计物体位姿类别级位姿机器人操作仿真到现实

面向开放环境中机器人需操作未知物体而类别标签泛化不足的问题,SCOPE用DINOv2连续语义特征替代离散类别先验,并通过交叉注意力注入扩散式U-Net来预测NOCS,配合逼真合成数据和法向噪声模型缩小Sim2Real差距。实验显示其在REAL275等基准上优于合成训练SOTA,5°5cm指标相对提升31.9%,并能在YCB-V等未见实例/未知类别抓取中取得最高100%成功率。

GRS-SLAM3R: Real-Time Dense SLAM with Gated Recurrent State Figure 1
arXiv preprint2025-09-28

GRS-SLAM3R: Real-Time Dense SLAM with Gated Recurrent State

Guole Shen, Tianchen Deng, Yanbo Wang, Yongtao Chen, Yilin Shen, Jiuming Liu, Jingchuan Wang

Shanghai Jiao Tong University

6D位姿估计相机位姿

针对 DUSt3R 类稠密 SLAM 主要依赖两帧点图、缺少跨帧空间记忆与全局一致性的问题,GRS-SLAM3R 将单目 RGB 序列增量映射到世界坐标,引入带更新/重置门的 Transformer 潜状态来筛选当前观测并抑制记忆噪声,同时用子地图内局部对齐和子地图间注册控制漂移。实验显示其在多数据集上提升重建与位姿精度,并保持实时运行。

Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices Figure 1
arXiv preprint2025-09-28

Color-Pair Guided Robust Zero-Shot 6D Pose Estimation and Tracking of Cluttered Objects on Edge Devices

Xingjian Yang, Ashis G. Banerjee

6D位姿估计

面向零样本新物体在复杂光照和杂乱场景中的6D位姿初始化与实时跟踪难以兼顾精度和边缘端效率的问题,论文提出统一的颜色对特征框架:用光照不变的边缘两侧颜色关系进行RGB-D与CAD网格注册,并在跟踪中筛选时序对应,结合光流和深度回归运动。实验显示其在基准上取得有竞争力的位姿精度,并能在突发姿态变化下保持较稳定跟踪。

ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing Figure 1
arXiv preprint2025-09-28

ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing

X. Tang 0009-0004-8931-4336, R. Li 0000-0002-0882-8510, Shenzhen, China

Harbin Institute of Technology, Shenzhen, China, Pengcheng Laboratory, China, Harbin Institute of Technology, China, Harbin Institute of Technology, Suzhou Research Institute, China

6D位姿估计

针对单图生成复杂3D场景时物体质量、空间一致性和纹理多视角一致性难以兼顾的问题,ZeroScene将前景实例与背景解耦建模,利用分割、深度和点云的2D/3D投影损失优化物体位姿与场景布局,并用几何约束扩散模型、掩码渐进生成和PBR材质估计进行可控纹理编辑。实验显示其在多物体遮挡场景中能更准确恢复布局并生成细节更一致的纹理,可服务虚拟内容和机器人real-to-sim仿真。

3DPCNet: Pose Canonicalization for Robust Viewpoint-Invariant 3D Kinematic Analysis from Monocular RGB cameras Figure 1
arXiv preprint2025-09-27

3DPCNet: Pose Canonicalization for Robust Viewpoint-Invariant 3D Kinematic Analysis from Monocular RGB cameras

Thushara Ekanayake, Constantino Álvarez Casado, Miguel Bordallo López

University of Oulu

6D位姿估计人体姿态

针对单目3D人体姿态输出绑定相机坐标、导致康复和运动分析中关节轨迹不可比的问题,3DPCNet提出仅基于3D关节点的即插即用规范化模块,用GCN-Transformer混合编码和门控交叉注意力预测SO(3)全局旋转,并可加残差修正。其在MM-Fi上将旋转误差由20°以上降至3.4°、MPJPE由64mm降至47mm,TotalCapture上也显示视频加速度信号更接近IMU。

Generative Modeling of Shape-Dependent Self-Contact Human Poses Figure 1
arXiv preprint2025-09-27

Generative Modeling of Shape-Dependent Self-Contact Human Poses

Takehiko Ohkawa, Jihyun Lee, Shunsuke Saito, Jason Saragih, Fabian Prada, Yichen Xu, Shoou-I Yu, Ryosuke Furuta, Yoichi Sato, Takaaki Shiratori Codec Avatars Lab, Meta

Codec Avatars Lab, Meta, The University of Tokyo, KAIST

6D位姿估计人体姿态

论文针对自接触人体姿态受体型约束但现有数据规模小、形状配准不准的问题,构建含130人38.3万姿态的Goliath-SC,并提出按身体部位建模、带自注意力的形状条件潜扩散先验PAPoseDiff,用于生成自接触姿态并细化单目SMPL-X估计。实验显示形状条件对学习接触姿态分布很关键,在未见主体评测上优于BUDDI和SMPLer-X。

UniPose: Unified Cross-modality Pose Prior Propagation towards RGB-D data for Weakly Supervised 3D Human Pose Estimation Figure 1
Lecture notes in computer science2025-09-27

UniPose: Unified Cross-modality Pose Prior Propagation towards RGB-D data for Weakly Supervised 3D Human Pose Estimation

Jinghong Zheng, Changlong Jiang ( ✉ ) ^{( { })}, Jiaqi Li, Haohong Kuang, Hang Xu, Tingbing Yan

Huazhong University of Science and Technology

6D位姿估计人体姿态点云彩色深度

针对3D人体姿态估计依赖昂贵3D标注、多视角标定或合成数据且易有域偏移的问题,UniPose用未标注单目RGB-D序列把2D姿态先验传播到点云、深度和RGB模态:通过2D到3D射线约束、人体时空物理先验与跨模态特征增强生成点云伪3D标签,再以自适应anchor-to-joint方式提升RGB/深度分支。实验在CMU Panoptic和ITOP上接近全监督方法,引入NTU RGB+D等大规模未标注数据后在困难场景下进一步提升。

A Besov-based integration-by-parts method for the incompressible Navier-Stokes equations Figure 1
arXiv preprint2025-09-27

A Besov-based integration-by-parts method for the incompressible Navier-Stokes equations

Xinyu Cheng, Zhaonan Luo, Sheng Wang

6D位姿估计

本文并非6D位姿估计工作,而是面向不可压Navier–Stokes方程的数值分析;动机是经典Sobolev误差估计难刻画低正则、局部点态误差。作者在Besov空间中分析半隐式时间离散,并用分部积分处理B^0_{∞,2}中的非线性对流项。主要证明了格式的近似无条件稳定性及B^0_{∞,1}/B^0_{∞,2}下一阶时间误差,常数与黏性无关。

GeLoc3r: Enhancing Relative Camera Pose Regression with Geometric Consistency Regularization Figure 1
arXiv preprint2025-09-27

GeLoc3r: Enhancing Relative Camera Pose Regression with Geometric Consistency Regularization

Jingxing Li, Yongjae Lee, Deliang Fan School of Electrical, Computer, USA @asu.edu

School of Electrical, Computer and Energy Engineering, Arizona State University

6D位姿估计相机位姿

GeLoc3r针对ReLoc3R等相对相机位姿回归方法虽快但内部特征缺乏几何一致性、精度受限的问题,提出训练期几何一致性正则:利用真值深度构造密集3D-2D对应,经FusionTransformer加权并用RANSAC生成几何监督,测试时仍只走回归头。结果在CO3Dv2 AUC@5°由34.85%提升到40.45%,RealEstate10K和MegaDepth1500也有稳定但较小增益。

Good Weights: Proactive, Adaptive Dead Reckoning Fusion for Continuous and Robust Visual SLAM Figure 1
arXiv preprint2025-09-26

Good Weights: Proactive, Adaptive Dead Reckoning Fusion for Continuous and Robust Visual SLAM

Yanwei Du, Jing-Chen Peng, Patricio A. Vela

School of Electrical and Computer Engineering, and, Institute of Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta, GA 30308, USA

6D位姿估计相机位姿

针对低纹理、低光等场景中视觉 SLAM 易因特征关联不足而丢失位姿的问题,Good Weights 将轮速/IMU 等航位推算作为按需运动先验嵌入跟踪、局部建图与回环优化,并用视觉跟踪质量自适应调节权重:视觉弱时增强 DR,恢复后回到视觉主导。实验显示其在室内与真实机器人数据上提升连续性和稳定性,正常视觉条件下基本不牺牲精度。

ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Models Figure 1
arXiv preprint2025-09-26

ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Models

Yixuan Hu, Yuxuan Xue, Simon Klenk, Daniel Cremers, Tübingen AI Center, Saarland Informatics Campus, Munich Center for Machine Learning (MCML, co-first author

Max Planck Institute for Informatics, Saarland Informatics Campus, Munich Center for Machine Learning (MCML)

6D位姿估计事件相机

事件相机适合高速、低光场景,但真实带标注事件数据稀缺,传统仿真又有明显域差和资产依赖。ControlEvents 将 Stable Diffusion/ControlNet 的生成先验迁移到事件域,用少量真实事件微调,并可受文本类别、2D骨架或3D人体姿态控制生成带标签事件数据。实验显示,合成数据能提升视觉识别、2D骨架估计和3D人体姿态估计,并具备未见文本类别生成能力。

Transfer Learning under Group-Label Shift: A Semiparametric Exponential Tilting Approach Figure 1
arXiv preprint2025-09-26

Transfer Learning under Group-Label Shift: A Semiparametric Exponential Tilting Approach

Manli Cheng, Subha Maity, Qinglong Tian, Pengfei Li

6D位姿估计

针对源域与目标域同时存在协变量、标签及子群比例变化时传统 covariate/label shift 假设失效的问题,本文提出 group-label shift,并用半参数指数倾斜刻画源/目标联合分布差异,结合工具变量识别与两步似然估计完成无监督迁移。理论上给出一致性、渐近正态及 ROC/AUC 推断;仿真和 Waterbirds 半合成实验显示其在子群偏移和伪相关场景下优于既有方法。

Kernel Regression of Multi-Way Data via Tensor Trains with Hadamard Overparametrization: The Dynamic Graph Flow Case Figure 1
arXiv preprint2025-09-26

Kernel Regression of Multi-Way Data via Tensor Trains with Hadamard Overparametrization: The Dynamic Graph Flow Case

Duc Thien Nguyen, Konstantinos Slavakis, Eleftherios Kofidis, Dimitris A. Pados

6D位姿估计

针对多维数据缺失时传统张量补全难以利用拓扑等先验、且CP/Tucker在表达或规模上受限的问题,论文提出KReTTaH:把补全写成RKHS核回归,用固定TT秩黎曼流形约束参数,并通过Hadamard过参数化诱导稀疏、降低存储。动态图边流实验中其NRMSE总体优于非参数CPD和神经网络基线,低误差设置还减少超过40%参数存储;但更多张量基线比较文中留待未来工作。

An Adaptive ICP LiDAR Odometry Based on Reliable Initial Pose Figure 1
IEEE Transactions on Instrumentation and Measurement2025-09-26

An Adaptive ICP LiDAR Odometry Based on Reliable Initial Pose

Qifeng Wang, Student Member, IEEE, Weigang Li, Member, Lei Nie, Xin Xu, Senior Member, Wenping Liu, Zhe Xu

Wuhan University of Science and Technology, Hubei University Of Economics

6D位姿估计相机位姿点云

针对传统 ICP 激光里程计对初始位姿敏感、在动态场景中阈值固定而易陷入局部最优的问题,论文引入密度滤波的分布式粗配准,并与运动预测位姿比较以选择更可靠初值,再结合当前与历史误差自适应调整点到面 ICP 的匹配阈值和权重。在 KITTI 上相较主流 LiDAR 里程计取得更低定位误差,说明精度提升主要来自初值筛选与动态参数调节。

Multicollinearity-Aware Parameter-Free Strategy for Hyperspectral Band Selection: A Dependence Measures-Based Approach Figure 1
arXiv preprint2025-09-26

Multicollinearity-Aware Parameter-Free Strategy for Hyperspectral Band Selection: A Dependence Measures-Based Approach

Dibyabha Deb, Ujjwal Verma

6D位姿估计

针对高光谱波段维度高、相邻波段冗余和多重共线性会拖累分类的问题,论文提出用VIF先剪枝,再结合平均波段相关性ABC与互信息MI做聚类选带的无调参策略,核心在于同时约束冗余与判别性。四个公开数据集上的SVM分类、与已有方法的重叠分析及消融实验显示,VIF预筛能降低共线性,ABC+MI可得到较稳健的判别波段子集。

SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference Figure 1
arXiv preprint2025-09-26

SingRef6D: Monocular Novel Object Pose Estimation with a Single RGB Reference

Engineering, Agency for Science, Technology

College of Design and Engineering, National University of Singapore, SIMTech, Agency for Science, Technology and Research (A STAR)

6D位姿估计物体位姿未知物体

SingRef6D针对新物体6D位姿在缺少CAD、深度传感器或多视角模板时难以落地的问题,仅用单张RGB参考图完成估计。其核心是在Depth-Anything v2上加入token-scaler微调以获得更可靠单目深度,并将深度先验注入LoFTR匹配,改善透明、反光、弱纹理和低光场景。实验在REAL275、ClearPose和Toyota-Light上超过现有方法,平均召回提升6.1%,深度预测δ1.05在REAL275提升14.41%。

DyRo-MCTS: A Robust Monte Carlo Tree Search Approach to Dynamic Job Shop Scheduling Figure 1
arXiv preprint2025-09-26

DyRo-MCTS: A Robust Monte Carlo Tree Search Approach to Dynamic Job Shop Scheduling

Ruiqi Chen, Yi Mei, Fangfang Zhang, Mengjie Zhang

Centre for Data Science & Artificial Intelligence, School of Engineering & Computer Science, Victoria University of Wellington

6D位姿估计

本文针对动态作业车间中新工件随机到达导致离线学习调度策略易短视、在线 MCTS 又缺乏未来信息的问题,提出 DyRo-MCTS:在常规动作价值外引入基于机器利用率分布的动作鲁棒性,并用 DyRo-UCT 在收益、探索与可调整性间权衡。实验显示其几乎不增加在线规划时间,却能显著提升离线策略并稳定优于 vanilla MCTS,说明保留对未来扰动的调度弹性带来长期收益。

DeLiVR: Differential Spatiotemporal Lie Bias for Efficient Video Deraining Figure 1
arXiv preprint2025-09-26

DeLiVR: Differential Spatiotemporal Lie Bias for Efficient Video Deraining

Shuning Sun, Jialang Lu : 1, Xiang Chen, Jichao Wang Dianjie Lu, Guijuan Zhang, Guangwei Gao, Telecommunications zhengzr@njust.edu.cn

University of Chinese Academy of Sciences, Qilu University of Technology, Hubei University, Nanjing University of Science and Technology, Shandong Normal University, Nanjing University of Posts and Telecommunications

6D位姿估计

针对雨天视频中雨纹、模糊及轻微相机姿态变化导致的跨帧错配,DeLiVR将李群时空微分偏置直接注入注意力,用帧内旋转估计和相邻帧角速度替代昂贵光流,引导几何一致的特征聚合。实验显示其在公开去雨基准上优于多种方法,并提升检测、分割等下游任务;但论文与“6D位姿估计”分类关联不强。

Modeling discrete lattice data using the Potts and tapered Potts models Figure 1
arXiv preprint2025-09-25

Modeling discrete lattice data using the Potts and tapered Potts models

Maria Paula Duenas-Herrera

Department of Statistics, The Pennsylvania State University

6D位姿估计

这篇论文关注离散格点多类别数据中经典 Ising/Potts 模型在高空间相关下易发生相变、基态退化和拟合失真,并受不可解归一化常数限制的问题。作者提出 tapered Potts/Ising 变体,并配套 MCMCMLE 推断,以抑制极端单色配置、改善高相关场景的生成拟合;仿真和 2021 NLCD 土地覆盖实验显示其较经典 Potts 更能复现多类别空间结构。

mmHSense: Multi-Modal and Distributed mmWave ISAC Datasets for Human Sensing Figure 1
IEEE Access2025-09-24

mmHSense: Multi-Modal and Distributed mmWave ISAC Datasets for Human Sensing

Nabeel Nisar Bhat, Maksim Karnaukh, Stein Vandenbroeke, Wouter Lemoine, Jakob Struye, Jesus Omar Lacruz, Siddhartha Kumar, Mohammad Hossein Moghaddam, Joerg Widmer, Rafael Berkvens, Jeroen Famaey

University of Antwerp, Qamcom Research and Technology (Sweden)

6D位姿估计数据集/基准

针对毫米波 ISAC 人体感知缺少开放、多场景通信信号数据的问题,mmHSense 发布六个带标签数据集,覆盖手势、身份、定位与6D/人体姿态估计,包含 CSI、波束 SNR、PPBP,结合商用 Wi-Fi、5G OFDM、分布式接收与视觉/VR 多模态采集。论文用下游任务验证数据可用性,并展示 LoRA 可在适配新任务时降低训练开销且尽量保持旧任务性能,但具体增益幅度文中片段未充分说明。

TUN3D: Towards Real-World Scene Understanding from Unposed Images Figure 1
arXiv preprint2025-09-23

TUN3D: Towards Real-World Scene Understanding from Unposed Images

Anton Konushin, Nikita Drozdov, Bulat Gabdullin, Alexey Zakharov, Anna Vorontsova, Danila Rukhovich, Higher School of Economics, Armenia

Lomonosov Moscow State University; Higher School of Economics; Institute of Mechanics, Armenia

6D位姿估计

针对室内场景理解依赖点云、限制普通相机与随手视频应用的问题,TUN3D将布局估计与3D目标检测统一到多视图图像输入,甚至不需真实相机位姿和深度监督;其关键在轻量稀疏卷积骨干、双任务头和参数化墙面表示。实验显示其在点云、有位姿图像和无位姿图像三种设置下达到SOTA,目标检测接近专用方法,并显著提升布局估计。

DATS: Distance-Aware Temperature Scaling for Calibrated Class-Incremental Learning Figure 1
arXiv preprint2025-09-25

DATS: Distance-Aware Temperature Scaling for Calibrated Class-Incremental Learning

Giuseppe Serra, Florian Buettner

6D位姿估计

这篇论文关注类增量学习中模型虽能持续学习新类别、却容易因灾难性遗忘导致置信度失准的问题。作者指出单一全局温度无法处理不同任务间校准误差波动,提出 DATS:用原型距离估计测试样本/批次与各任务的接近程度,并据此自适应选择温度,无需测试时任务标签。实验在标准基准和不均衡生物医学数据上显示,其相比现有方法更稳定地降低跨任务校准误差。

A Novel Soil Profile Standardization Technique with XGBoost Framework for Accurate Surface Wave Inversion Figure 1
arXiv preprint2025-09-25

A Novel Soil Profile Standardization Technique with XGBoost Framework for Accurate Surface Wave Inversion

Mandal, Kousik, Tarun Naskar

● Department of Civil Engineering, Indian Institute of Technology Madras, India, Technology Madras, India

6D位姿估计

针对表面波反演中局部搜索易陷局部最优、全局搜索耗时且现有机器学习难处理可变层数的问题,论文将不同层状土剖面标准化为几何增厚的十层输出,并用1000万合成样本训练回归式XGBoost,同时加入速度突变与薄层约束。作者在14个文献剖面上与LSM和Geopsy比较,称复杂高低速层也能较好恢复,约半数案例优于Geopsy,推理仅需秒以下。

AI-Enabled Crater-Based Navigation for Lunar Mapping Figure 1
Astrodynamics2025-09-25

AI-Enabled Crater-Based Navigation for Lunar Mapping

1 Introduction

The University of Adelaide

6D位姿估计

针对以往月坑导航多面向短时着陆、难以适应长期月球测绘中稀疏成像、斜视和光照变化的问题,论文提出端到端 STELLA 流水线,结合 Mask R-CNN 月坑检测、无描述子识别、鲁棒 perspective-n-crater 位姿求解与批量轨道确定,并构建 CRESENT-365 年尺度仿真数据集评测。实验显示其在多视角、光照和纬度条件下平均达到米级位置精度与亚度级姿态精度。

Online Sequential Leveraging Sampling Method for Streaming Autoregressive Time Series with Application to Seismic Data Figure 1
The Annals of Applied Statistics2025-09-25

Online Sequential Leveraging Sampling Method for Streaming Autoregressive Time Series with Application to Seismic Data

Rui Xie, Τ. N. Sriram, Wei Biao Wu, Ping Ma

University of Central Florida, University of Georgia, University of Chicago

6D位姿估计

面向高频、近乎无限的流式地震自回归时间序列,论文关注在无法存储全量数据时如何兼顾实时推断与计算成本。其核心是提出 Sequential Leveraging Sampling:用在线杠杆分数随机确定连续数据块起点,并以序贯停止规则自适应决定块长,从而保留时间相关结构。理论上证明线性及非线性 AR 场景下归一化最小二乘估计渐近正态;在土叙双震和 Oklahoma 微震数据及仿真中,可用较少样本识别事件并刻画依赖变化。

EEG-Driven AR-Robot System for Zero-Touch Grasping Manipulation Figure 1
arXiv preprint2025-09-25

EEG-Driven AR-Robot System for Zero-Touch Grasping Manipulation

Junzhe Wang, Jiarui Xie, Pengfei Hao, Cheng Liu, Yi Cai

6D位姿估计机器人操作

针对EEG控制机器人中信号噪声大、目标选择僵化且缺少真实闭环验证的问题,本文构建了BCI–AR–Robot零接触抓取系统:用14通道MI解码产生指令,手机VST-AR提供方向一致的多目标神经反馈,并结合视觉位姿估计与逆运动学完成自主抓取。实验显示MI准确率93.1%,AR反馈将ITR提升至21.3 bit/min,闭环抓取成功率达97.2%。

Reflect3r: Single-View 3D Stereo Reconstruction Aided by Mirror Reflections Figure 1
arXiv preprint2025-09-24

Reflect3r: Single-View 3D Stereo Reconstruction Aided by Mirror Reflections

Jing Wu, Zirui Wang, Iro Laina, ryan@robots.ox.ac.uk

University of Oxford

6D位姿估计多视角三维重建

针对单张图像中镜面反射常被重建模型误当噪声、却实际包含额外视角线索的问题,Reflect3r 将镜中内容转换为物理一致的虚拟相机视图,在像素域构建单图双目/多视角输入,并用镜面对称约束优化位姿。实验在真实与16个可编辑 Blender 合成场景上显示,相比 DUSt3R、VGGT、MoGe 等基线可重建更完整点云,并可扩展到逐帧动态场景。

SeHDR: Single-Exposure HDR Novel View Synthesis via 3D Gaussian Bracketing Figure 1
arXiv preprint2025-09-23

SeHDR: Single-Exposure HDR Novel View Synthesis via 3D Gaussian Bracketing

Yiyu Li, Haoyuan Wang, Ke Xu, Gerhard Petrus Hancke, kkangwing@gmail.com @cityu.edu.hk

City University of Hong Kong

6D位姿估计高斯泼溅

针对HDR新视角合成依赖多曝光多视图采集、易受运动模糊与位姿/标定误差影响的问题,SeHDR从单曝光多视图LDR图像学习HDR 3DGS。其关键是先在共享几何上生成不同曝光的Bracketed 3D Gaussians,再用可微NeEF在球谐系数空间融合为HDR表示。实验显示其优于现有HDR-NVS与基线,文中报告在无HDR监督下提升约14.3dB。

Transfer Learning in Regression with Influential Points Figure 1
arXiv preprint2025-09-24

Transfer Learning in Regression with Influential Points

Bingbing Wang, Jiaqi Wang

6D位姿估计

针对目标域标注稀缺且源/目标数据中影响点会共同扭曲回归参数的问题,论文提出 Trans-CO 协同优化框架,将源模型参数迁移与目标域影响点稀疏检测、稳健拟合联合处理,并用 BIC 选参。仿真在样本量、稀疏度、漂移比例和异方差等设置下优于对比方法,真实数据上也取得更低预测误差;但其与 6D 位姿估计的直接关联文中未充分说明。

AJAHR: Amputated Joint Aware 3D Human Mesh Recovery Figure 1
arXiv preprint2025-09-24

AJAHR: Amputated Joint Aware 3D Human Mesh Recovery

Hyunjin Cho, Giyun Choi, Jongwon Choi Dept. of Advanced Imaging, GSAIM, Korea, Dept. of Artificial Intelligence, Korea @vilab.cau.ac.kr, choijw@cau.ac.kr

Korea Institute of Industrial Technology (KITECH), Korea

6D位姿估计

本文针对现有单目 3D 人体网格恢复默认完整人体、在截肢者上易幻觉缺失肢体的问题,提出 AJAHR:在 TokenHMR 基础上联合训练身体部位截肢分类器,并用 SMPL 运动树编码缺失关节;同时构建合成 A3D 与真实 ITW-amputee 评测集。结果显示其在非截肢者上保持竞争性能,并在截肢者网格恢复上达到最优表现。

Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materials Figure 1
arXiv preprint2025-09-25

Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materials

Shi Yin, Zujian Dai : 1, Xinyang Pan : 1

Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei National Laboratory, University of Science and Technology of China

6D位姿估计

针对传统 DFT 自洽迭代在大规模材料电子结构计算中的高成本,以及现有学习式哈密顿量模型跨元素、含 SOC 场景泛化不足的问题,本文提出 NextHAM:以零步哈密顿量注入物理先验并学习修正项,结合严格 E(3) 对称 Transformer 与实空间/k 空间联合目标抑制幽灵态;同时构建含 1.7 万结构、60 多元素的 Materials-HAM-SOC。实验显示其可达到接近 DFT 的能带与哈密顿量精度并显著加速计算。

Convex Regression with a Penalty Figure 1
arXiv preprint2025-09-24

Convex Regression with a Penalty

Eunji Lim

6D位姿估计

本文针对传统凸回归最小二乘在定义域边界易过拟合、次梯度估计发散的问题,提出将常见惩罚形式“反过来”:最小化次梯度惩罚,同时用可由数据估计的残差平方和上界约束拟合误差。论文给出相应 QCQP 形式,并证明估计函数及其次梯度的一致性与收敛速率,示例验证集中在单服务器队列等待时间估计,非 6D 位姿任务。

Particle Filtering for Non-Deterministic Electrocardiographic Imaging Figure 1
arXiv preprint2025-09-23

Particle Filtering for Non-Deterministic Electrocardiographic Imaging

Emma Lagracie, Luc de Montella

Laboratoire CarMeN

6D位姿估计

针对 ECGI 逆问题高度病态、传统方法只给单一确定性激活图且难表达噪声与模型不确定性的局限,论文用少量激活中心和半径参数化心脏激活序列,从而将粒子滤波引入非高斯、非线性重建,并输出激活概率、最早激活点伪概率及传导阻滞线置信度。模拟实验显示其可恢复激活点数量与高概率区域,在存在纤维建模偏差时仍给出合理不确定性;但验证主要限于仿真和较密体表采样,临床增益仍需实证。

Uncertainty Quantification of Large Language Models using Approximate Bayesian Computation Figure 1
arXiv preprint2025-09-19

Uncertainty Quantification of Large Language Models using Approximate Bayesian Computation

Mridul Sharma, Adeetya Patel, Zaneta D' Souza, Samira Abbasgholizadeh Rahimi, Siva Reddy, Sreenath Madathil

Faculty of Dental Medicine and Oral Health Sciences, McGill University, Montreal, Canada, Mila–Quebec Artificial Intelligence Institute, Montreal, Canada, School of Computer Science, McGill University, Montreal, Canada

6D位姿估计

该文实际聚焦LLM在临床文本分类中的不确定性量化,而非6D位姿估计;动机是logits和自报置信度常过度自信、校准差。核心做法是把LLM视为黑盒随机模拟器,用ABC/SMC-ABC通过生成描述与类别参考的相似性推断预测概率后验。在口腔病变合成集和GretelAI症状诊断集上,相比基线最高提升46.9%准确率、Brier分数降低74.4%,ECE和熵校准也更好。

MagiClaw: A Dual-Use, Vision-Based Soft Gripper for Bridging the Human Demonstration to Robotic Deployment Gap Figure 1
arXiv preprint2025-09-23

MagiClaw: A Dual-Use, Vision-Based Soft Gripper for Bridging the Human Demonstration to Robotic Deployment Gap

Tianyu Wu, Xudong Han, Haoran Sun, Zishang Zhang, Technology

Design + Learning Research Group, Southern University of Science and Technology, asRobotics

6D位姿估计机器人操作

面向示教到机器人部署中传感与末端形态不一致造成的域差,MagiClaw将同一双指软夹爪同时用作手持采集器和机器人末端,并用SPN内置相机估计6D力/接触形变,融合iPhone的6D位姿、RGB与LiDAR深度。论文展示其可支持遥操作、混合现实反馈和多模态回放学习,降低接触丰富数据采集门槛;但定量性能增益与策略泛化幅度文中未充分说明。

Trigger Where It Hurts: Unveiling Hidden Backdoors through Sensitivity with Sensitron Figure 1
arXiv preprint2025-09-23

Trigger Where It Hurts: Unveiling Hidden Backdoors through Sensitivity with Sensitron

Gejian Zhao, Hanzhou Wu, Xinpeng Zhang

6D位姿估计

这篇论文关注 NLP 后门触发器缺乏可解释性、难以量化模型脆弱位置的问题,提出 Sensitron:先用动态敏感性分析定位易受攻击 token,再用分层 SHAP 细化归因,并通过 Plug-and-Rank 生成语义自然的多词触发器。作者报告解释性分数与攻击成功率相关性 SRC=0.83,ASR 达 97.8%,在 0.1% 投毒率下仍有 85.4%,但其与 6D 位姿估计分类不匹配。

Category-Level Object Shape and Pose Estimation in Less Than a Millisecond Figure 1
arXiv preprint2025-09-23

Category-Level Object Shape and Pose Estimation in Less Than a Millisecond

Lorenzo Shaikewitz, Tim Nguyen, Luca Carlone

6D位姿估计类别级位姿

面向机器人在仅知类别、未知具体形状时仍需快速定位与操作的需求,本文将类别级形状先验与语义关键点对齐写成四元数下的非线性特征值问题,用自洽场迭代每步只求解 4×4 最小特征对,并配套基于 SDP 对偶的全局最优性证书。实验覆盖合成数据、两类真实数据集和无人机跟踪,求解约百微秒,显著快于常见局部求解器和学习基线,但精度仍受语义关键点检测影响。

Towards Robust LiDAR Localization: Deep Learning-based Uncertainty Estimation Figure 1
arXiv preprint2025-09-23

Towards Robust LiDAR Localization: Deep Learning-based Uncertainty Estimation

Minoo Dolatabadi, Fardin Ayar, Ehsan Javanmardi, Manabu Tsukada, Mahdi Javanmardi

Department of Computer Engineering, Amirkabir University of Technology, Tehran, Iran, Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan

6D位姿估计点云

针对 LiDAR 定位中 ICP 在退化场景、动态物体下易失效且难以给出可靠误差模型的问题,论文提出从单帧点云在匹配前预测 SE(3) 上完整 6×6 配准协方差,并用 Monte Carlo ICP 构造训练目标,使其可直接作为 Kalman 滤波量测噪声。KITTI 实验显示,该协方差预测用于建图定位和 SLAM 时,相比固定或启发式协方差可降低定位误差并提升鲁棒性。

Human-Interpretable Uncertainty Explanations for Point Cloud Registration Figure 1
arXiv preprint2025-09-24

Human-Interpretable Uncertainty Explanations for Point Cloud Registration

Johannes A. Gaus, Loris Schneider, Yitian Shi, Jongseok Lee, Rania Rayyes, Rudolph Triebel johannes.gaus@uni-tuebingen.de

6D位姿估计点云

针对ICP等点云配准在噪声、初始化误差和遮挡导致部分重叠时只给出“不确定度大小”却难以指导恢复的问题,论文提出GP-CA:用学习到的点云表征和高斯过程分类器把高不确定性归因到可解释概念,并用主动学习扩展新失效来源。实验覆盖LINEMOD、YCB、Coffee Cup和真实RGB-D机器人场景,显示其在准确率、运行效率和少样本查询效率上优于代表性基线,并可触发如换视角等针对性恢复动作。

SINGER: An Onboard Generalist Vision-Language Navigation Policy for Drones Figure 1
arXiv preprint2025-09-23

SINGER: An Onboard Generalist Vision-Language Navigation Policy for Drones

Maximilian Adang, JunEn Low, Ola Shorinwa, Mac Schwager

Department of Mechanical Engineering, Stanford University, Stanford, CA 94404, USA

6D位姿估计

针对开放词汇无人机导航缺少大规模示范、实时机载控制和外部定位依赖的问题,SINGER用带CLIP语义的3D Gaussian Splatting仿真器生成低仿真到现实差距数据,并以RRT*专家批量产生无碰撞轨迹,训练轻量端到端视觉运动策略。实机零样本测试中,相比语义速度控制基线,到达目标平均提升23.33%,目标保持在视野内提升16.67%,碰撞减少10%。

Arbitrary norm growth in the 3D Navier-Stokes equations Figure 1
arXiv preprint2025-09-23

Arbitrary norm growth in the 3D Navier-Stokes equations

Stan Palasek

6D位姿估计

本文针对三维 Navier–Stokes 方程中临界范数能否给出先验控制的问题,构造一族光滑且在 BMO^{-1}/B^{-1}_{∞,1} 中一致有界的初值。核心洞察是利用二次非线性在多模态间反复平方产生逆级联,使全局强解在指定尺度上逼近任意大幅度的单模态解。结果表明,即便在具备局部适定性的设置中,基于 BMO^{-1} 的多类自然先验估计和 Koch–Tataru Picard 构造都可失效。

Diffusion Policies with Offline and Inverse Reinforcement Learning for Promoting Physical Activity in Older Adults Using Wearable Sensors Figure 1
arXiv preprint2025-09-22

Diffusion Policies with Offline and Inverse Reinforcement Learning for Promoting Physical Activity in Older Adults Using Wearable Sensors

Chang Liu, Ladda Thiamwong, Yanjie Fu, Rui Xie

University of Central Florida, Arizona State University

6D位姿估计

本文面向老年人跌倒风险干预中离线强化学习难以定义奖励、临床反馈延迟且行为分布复杂的问题,提出 KANDI:用 Kolmogorov-Arnold Networks 从低跌倒风险“专家”可穿戴数据中做逆强化学习奖励估计,并在 Actor-Critic 中引入扩散策略生成贴近离线行为分布的连续时间动作。实验在 PEER 临床试验数据上验证可用于促进 MVPA、减少久坐,并在 D4RL 基准上优于多种离线 RL 方法;具体临床效果增益幅度文中片段未充分说明。

BlurBall: Joint Ball and Motion Blur Estimation for Table Tennis Ball Tracking Figure 1
arXiv preprint2025-09-22

BlurBall: Joint Ball and Motion Blur Estimation for Table Tennis Ball Tracking

Thomas Gossard, Filip Radovic, Andreas Ziegler

University of Tuebingen

6D位姿估计

针对乒乓球高速运动中目标常呈拖影、传统以前沿点标注会带来方向歧义且浪费速度线索的问题,论文提出以拖影中心定义球位置并显式标注模糊属性,同时发布相应数据集;BlurBall在多帧输入上联合估计球位置与运动模糊,并用SE等轻量注意力提取时序线索,在多种检测模型上提升精度,达到当前最佳球检测效果,并改善轨迹预测可靠性。

Joint Cooperative and Non-Cooperative Localization in WSNs with Distributed Scaled Proximal ADMM Algorithms Figure 1
arXiv preprint2025-09-21

Joint Cooperative and Non-Cooperative Localization in WSNs with Distributed Scaled Proximal ADMM Algorithms

Qiaojia Zhu, Xiaojing Shen, Haiqi Liu, Pramod K. Varshney

The Department of Mathematics, Sichuan University, Chengdu, Sichuan 610064, China, The Department of Electrical Engineering and Computer Science, Syracuse University, Syracuse, NY USA

6D位姿估计

面向传感器位置不确定且目标不可通信的 WSN 场景,论文认为先协作定位再目标定位会带来时延与误差传递。其核心是把协作/非协作定位统一为非凸最小二乘问题,并通过辅助变量解耦,设计分布式 SP-ADMM-JCNL。理论上证明收敛到重构问题 KKT 点及原问题临界点,速率 O(1/T),实验显示定位较准确可靠。

Core-elements Subsampling for Alternating Least Squares Figure 1
arXiv preprint2025-11-11

Core-elements Subsampling for Alternating Least Squares

Big Data, Beijing, Data Science, China Jingyi Zhang School of Science, Telecommunications, China

Institute of Statistics and Big Data, Renmin University of China, Beijing, China, Department of Statistics and Data Science, Tsinghua University, Beijing, China, School of Science, Department of Mathematics, Beijing University of Posts and Telecommunications, Center for Applied Statistics, Institute of Statistics and Big Data

6D位姿估计

这篇论文面向大规模含缺失评分矩阵中 ALS 低秩分解的计算瓶颈,而非典型 6D 位姿问题。核心思路是利用 ALS 迭代中因数矩阵的数值稀疏性,按元素选择更有信息量的 core-elements,并结合稀疏矩阵乘法和 partial quicksort 加速回归子问题。文中给出逐迭代近似与收敛保证,仿真和真实推荐数据表明在接近全量 ALS 精度、NDCG/Hit 等指标的同时显著降低运行时间。

Global Optimization via Softmin Energy Minimization Figure 1
arXiv preprint2025-09-22

Global Optimization via Softmin Energy Minimization

Italy marco.romito@unipi.it

Department of Mathematics, University of Pisa, Institute of Mathematical Statistics, University of Bern, Department of Buisness Economics, University Gabreiele D’annunzio, Marco Romito

6D位姿估计

针对高维非凸优化易陷入局部极小、Langevin 逃逸慢的问题,论文提出以 Softmin Energy 耦合多粒子的随机梯度群体动力学,并随 β 退火,在保留梯度效率的同时让高能粒子被排斥探索。理论上证明其可压低有效势垒并加快盆间跃迁,实验在双井和高维 Ackley 上优于模拟退火及若干梯度群体方法;但尚未展示在真实 6D 位姿估计任务中的效果。

Selecting Optimal Camera Views for Gait Analysis: A Multi-Metric Assessment of 2D Projections Figure 1
arXiv preprint2025-09-22

Selecting Optimal Camera Views for Gait Analysis: A Multi-Metric Assessment of 2D Projections

Dong Chen, Huili Peng, Yong Hu, Kenneth MC. Cheung

Kenneth MC. Cheung 1,2

6D位姿估计人体姿态

针对2D无标记步态分析中相机视角会压缩/扭曲3D运动信息、影响临床参数可靠性的问题,本文以3D动捕为基准,结合YOLOv8姿态估计与DTW、MCC、KLD、信息熵等多指标量化正面/侧面视角差异。结果显示侧面更适合步长、膝关节等矢状面运动学,正面更适合躯干旋转和腕-髋中点距离等对称性指标,提示实际部署应按疾病与参数选择或融合双视角。

Evict3R: Training-Free Token Eviction for Memory-Bounded Streaming Visual Geometry Transformers Figure 1
arXiv preprint2025-09-22

Evict3R: Training-Free Token Eviction for Memory-Bounded Streaming Visual Geometry Transformers

Soroush Mahdi, Fardin Ayar, Ehsan Javanmardi, Manabu Tsukada, Mahdi Javanmardi

Amirkabir University of Technology (AUT), Tehran, Iran, The University of Tokyo, Tokyo, Japan

6D位姿估计

面向机器人长时序3D感知,StreamVGGT的KV缓存随帧数线性增长,限制单GPU流式推理。Evict3R在不训练、不改权重的情况下,于推理时按层设定KV预算,并用带归一化的注意力重要性保留关键token、丢弃冗余token。实验显示其在深度、重建和相机位姿任务上接近原模型精度,7-Scenes长序列峰值显存由18.63GB降至9.39GB,精度与完整度仅降0.003,并可在紧预算下支持更密集采样。

VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video Figure 1
arXiv preprint2025-09-22

VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Video

Yu Liu, Baoxiong Jia 2, Ruijie Lu, Chuyue Gan, Huayu Chen Junfeng Ni, Song-Chun Zhu, Siyuan Huang 2

Tsinghua University State Key Laboratory of General Artificial Intelligence, BIGAI Peking University

6D位姿估计

VideoArtGS面向单目视频中铰接物体数字孪生构建,解决相机运动、几何、部件分割与关节运动相互耦合导致的病态估计。其核心是将预训练3D跟踪轨迹作为运动先验,经噪声过滤、运动类型分析与聚类初始化关节参数,并用中心-网格混合分配提升部件变形建模。实验显示其在关节与网格重建上达到SOTA,重建误差较既有方法约降两个数量级。

Comparing Data Assimilation and Likelihood-Based Inference on Latent State Estimation in Agent-Based Models Figure 1
arXiv preprint2025-09-22

Comparing Data Assimilation and Likelihood-Based Inference on Latent State Estimation in Agent-Based Models

Blas Kolic, Corrado Monti, Gianmarco De Francisci Morales, Marco Pangallo

Intesa Sanpaolo Innovation Center, Corso Inghilterra, 3, 10138, Turin, Italy

6D位姿估计

针对基于主体模型中微观潜状态难以从观测时间序列校准的问题,本文在有界信任意见动力学模型上系统比较数据同化与基于似然推断。核心洞察是二者存在精度与适用性的取舍:LBI依赖手工似然但更适合个体状态恢复,DA无需显式似然、在宏观聚合预测上仍稳健。实验显示LBI在个体意见重建和个体级预测中更准,DA在极化/共识等聚合指标上表现接近。

Overview of PlantCLEF 2023: Image-based Plant Identification at Global Scale Figure 1
arXiv preprint2025-09-22

Overview of PlantCLEF 2023: Image-based Plant Identification at Global Scale

Herve Goeau, Pierre Bonnet, Alexis Joly

6D位姿估计

面向人工植物鉴定成本高、全球物种类别极多且数据噪声重的问题,PlantCLEF 2023构建了80k物种、400万图像的多图像/元数据评测,比较可信GBIF与噪声网络数据下的大规模细粒度识别。结果显示,自监督预训练的Vision Transformer明显优于CNN,且扩大数据规模、纳入网络图像比过度筛选更有利;但领先方案依赖16张RTX 3090训练数月,增益可能主要来自scaling与算力。

A Computational Method for the Inverse Robin Problem with Convergence Rate Figure 1
arXiv preprint2025-09-22

A Computational Method for the Inverse Robin Problem with Convergence Rate

Erik Burman, Marvin Knöller, Lauri Oksanen

Department of Mathematics, University College London, 807b Gower Street, London, WC1E, Department of Mathematics and Statistics, University of Helsinki, P.O 68, 00014, Helsinki

6D位姿估计

本文面向椭圆方程中由局部观测反推 Robin 边界参数的问题,动机是传统连续唯一延拓在有限元离散后难以直接保证可识别与收敛。作者将唯一延拓稳定性与控制形式结合,构造仅需一阶 Lagrange 有限元的 Newton 重建方法,并在 Robin 参数属于已知有限维 C¹ 空间等假设下证明网格尺寸二阶收敛;含噪数据时该速率维持到噪声项主导误差,数值实验验证了重建可行性与理论速率。

Methods for statistical detection of GRBs in the context of the LST-CTAO Figure 1
arXiv preprint2025-09-22

Methods for statistical detection of GRBs in the context of the LST-CTAO

Mathieu de Bony de Lavergne, Armand Fiasson, Edna Ruiz-Velasco, David Sanchez, Kenta Terauchi

Laboratoire d’Annecy de Physique des Particules

6D位姿估计

该文针对 LST-CTAO 观测 GRB 余辉时通量快速衰减、标准 Li&Ma 稳态检验会稀释早期信号的问题,比较时间依赖 Li&Ma、Temporal ON/OFF、ExpTest、CuSum,并提出联合拟合能谱与时间衰减的 LiFT。基于 LST-1 IRF 的大规模模拟显示,引入显式时间模型可显著提高检出率;快速衰减早期场景下,时间依赖 Li&Ma 等方法相对标准 Li&Ma 可获得超过 2 倍检出提升,且多数方法保持低误报率。

AERO-MPPI: Anchor-Guided Ensemble Trajectory Optimization for Agile Mapless Drone Navigation Figure 1
arXiv preprint2025-09-22

AERO-MPPI: Anchor-Guided Ensemble Trajectory Optimization for Agile Mapless Drone Navigation

Xin Chen, Rui Huang, Longbin Tang, Lin Zhao

6D位姿估计

面向杂乱未知3D环境中无人机高速无地图飞行,论文指出传统建图—规划—控制链路延迟高且误差累积,单一MPPI又易陷局部最小。AERO-MPPI用多分辨率LiDAR点云快速生成前视锚点,并并行运行锚点引导的MPPI集成,在GPU上联合感知与轨迹优化。仿真中可维持7 m/s以上、成功率超过80%,实机在Jetson Orin NX上验证了机载实时避障能力。

Pose Estimation of a Cable-Driven Serpentine Manipulator Utilizing Intrinsic Dynamics via Physical Reservoir Computing Figure 1
arXiv preprint2025-09-22

Pose Estimation of a Cable-Driven Serpentine Manipulator Utilizing Intrinsic Dynamics via Physical Reservoir Computing

Kazutoshi Tanaka, Tomoya Takahashi, Masashi Hamaya

6D位姿估计

面向无关节传感器、轻量化线驱蛇形臂中因缆绳松弛/伸长和塑料连杆变形导致解析模型失准的问题,论文将这些柔性非线性动态视为物理储备池,仅用基座电机角度与负载进行位姿估计。在9自由度、545 mm、308 g样机上,平均误差为4.3 mm,接近LSTM的4.4 mm,明显优于解析法39.5 mm;但跨工况泛化仍文中未充分说明。

SPFSplatV2: Efficient Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views Figure 1
arXiv preprint2025-09-21

SPFSplatV2: Efficient Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views

Ranran Huang, Krystian Mikolajczyk

6D位姿估计三维重建高斯泼溅

针对稀疏多视图重建中 SfM 位姿昂贵且不稳定、现有 pose-free 方法训练仍依赖真值位姿的问题,SPFSplatV2 用共享骨干联合预测规范空间中的 3D Gaussian 与相机位姿,并以 masked attention 防止目标视图泄漏、重投影损失强化几何对齐。实验称其在域内/跨域新视角合成和相对位姿估计上优于多类 SOTA,且在大视角变化、低重叠场景更稳。

MoA-Off: Adaptive Heterogeneous Modality-Aware Offloading with Edge-Cloud Collaboration for Efficient Multimodal LLM Inference Figure 1
arXiv preprint2025-09-21

MoA-Off: Adaptive Heterogeneous Modality-Aware Offloading with Edge-Cloud Collaboration for Efficient Multimodal LLM Inference

Zheming Yang, Qi Guo, Yunqing Hu, Chang Zhao, Zhang, Chang, Jian Zhao, Wen Ji

6D位姿估计

针对多模态大模型在边缘设备上推理开销高、纯云端又带来传输延迟和带宽压力的问题,MoA-Off把输入模态差异显式纳入卸载决策:在边缘用轻量特征估计图像、文本复杂度,并结合实时系统状态动态分配到边或云。实验称延迟降低超过30%、资源开销下降30%–65%,但其与6D位姿估计的直接关联文中未充分说明。

Leveraging RGB Images for Pre-Training of Event-Based Hand Pose Estimation Figure 1
arXiv preprint2025-09-21

Leveraging RGB Images for Pre-Training of Event-Based Hand Pose Estimation

Ruicong Liu, Takehiko Ohkawa, Tze Ho Elden Tse, Mingfang Zhang Angela Yao, Japan, Singapore

The University of Tokyo, Japan, National University of Singapore, Singapore

6D位姿估计手部姿态事件相机

针对事件相机手部3D姿态估计缺少标注数据、RGB方法又易受光照和高速运动影响的问题,RPEP利用有标注RGB与未配对无标注事件数据预训练事件模型;其关键是将手部运动拆成多步形变并迭代生成伪事件,同时用运动反转约束校正运动先验。实验在EvRealHands及强光、闪光场景中优于现有迁移/预训练方法,正常场景相对提升最高约24%,且少量标注微调仍有效。

ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM Figure 1
arXiv preprint2025-09-21

ConfidentSplat: Confidence-Weighted Depth Fusion for Accurate 3D Gaussian Splatting SLAM

Amanuel T. Dufera, Yuan-Li Cai

Xi'an Jiaotong University

6D位姿估计相机位姿彩色深度三维重建高斯泼溅

针对RGB-only 3DGS SLAM中深度监督不可靠导致几何失真的问题,ConfidentSplat用像素级置信度融合多视图几何深度与Omnidata单目先验,并以代理深度优化可变形高斯地图以适应后端位姿更新。实验在TUM、ScanNet、Replica及手机采集数据上显示,其深度误差、渲染质量相对Splat-SLAM等基线提升明显,但长序列跟踪仍受固定前端漂移影响。

Spectral Compressive Imaging via Chromaticity-Intensity Decomposition Figure 1
arXiv preprint2025-09-20

Spectral Compressive Imaging via Chromaticity-Intensity Decomposition

Xiaodong Wang, Zijun He, Ping Wang, Lishun Wang, Yanan Hu, School of Engineering, Chinese Academy of Sciences

Zhejiang University, School of Engineering, Westlake University, Chengdu Institute of Biology, Chinese Academy of Sciences

6D位姿估计

本文针对 CASSI 高光谱重建中空间-光谱混叠严重、且辐射受光照影响导致反射率难恢复的问题,提出将高光谱分解为平滑强度图与光照不变的色度立方体,并在双相机系统中构建 CIDNet。其核心是用物理可解释分解约束展开网络,结合空间-光谱 Transformer 与自适应噪声估计来恢复稀疏细节。合成与真实数据实验显示,其在光谱重建和色度保真度上优于对比方法。

A Novel Metric for Detecting Memorization in Generative Models for Brain MRI Synthesis Figure 1
arXiv preprint2025-09-20

A Novel Metric for Detecting Memorization in Generative Models for Brain MRI Synthesis

Antonio Scardace

University of Catania, University of Messina

6D位姿估计

针对医学图像生成模型可能复现训练样本、泄露患者隐私且现有通用相似度难捕捉细粒度解剖差异的问题,论文提出 DeepSSIM:用自监督网络把图像嵌入到向量空间,并约束嵌入余弦相似度逼近配准后 SSIM,同时用结构保持增强降低对精确对齐的依赖。在脑 MRI 和胸片 LDM 记忆检测中,其 F1 相比最佳现有方法平均提升 52.03%。

TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulation Figure 1
arXiv preprint2025-09-20

TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulation

Yinghao Wu, Shuhong Hou, Haowen Zheng, Yichen Li, Weiyi Lu, Xun Zhou, Yitian Shao

State Key Laboratory of Smart Farm Technologies and Systems, Harbin, China

6D位姿估计机器人操作

针对精密插入中视觉难以感知微小错位、传统触觉响应慢或数据量大的问题,TranTac在夹爪软指尖内嵌单个低成本6轴IMU,利用瞬态平移与扭转触觉信号,经Transformer编码并与视觉融合,由扩散策略生成6D调整动作。实物实验中,视觉触觉策略抓取插入成功率达79%,触觉-only错位插入达88%,对USB和钥匙等未见物体仍接近70%。

Improving Deep Tabular Learning Figure 1
arXiv preprint2025-09-19

Improving Deep Tabular Learning

Yehudit Aperstein Intelligent Systems, Afeka Academic College of Engineering, Tel Aviv, Israel

Intelligent Systems, Afeka Academic College of Engineering, Tel Aviv, Israel

6D位姿估计

本文关注表格数据缺少天然结构、特征类型混杂且难以做有效增强,导致深度模型常输给 GBDT 的问题。作者提出 RuleNet,将数值特征的分段线性分位投影、可学习规则嵌入的 Transformer 编解码结构和特征遮蔽集成结合起来。8 个基准上经调参后在 4 个数据集超过已有 SOTA、3 个接近 SOTA,主要增益来自特征遮蔽,推理开销可能增加。

Recovering Parametric Scenes from Very Few Time-of-Flight Pixels Figure 1
arXiv preprint2025-09-19

Recovering Parametric Scenes from Very Few Time-of-Flight Pixels

Carter Sifferman 2 Co-first author, Yiquan Li 2 Co-first author, Yiming Li, Fangzhou Mu, Michael Gleicher, Mohit Gupta

University of Wisconsin-Madison

6D位姿估计

本文针对低成本单像素/少像素 ToF 传感器难以形成稠密点云的问题,探索在强几何先验下能否仅凭少量瞬态直方图恢复参数化场景。核心做法是用前馈网络给出初值,再通过可微 ToF 渲染的 analysis-by-synthesis 优化细化 6D 位姿。仿真与受控实拍中,方法用约 15 个 ToF 像素和无纹理网格即可估计已知物体姿态,并对球体参数和手部姿态给出初步结果,但实用性仍受传感距离、已知传感器位姿等假设限制。

UniTac2Pose: A Unified Approach Learned in Simulation for Category-level Visuotactile In-hand Pose Estimation Figure 1
arXiv preprint2025-09-19

UniTac2Pose: A Unified Approach Learned in Simulation for Category-level Visuotactile In-hand Pose Estimation

Mingdong Wu, Long Yang, Jin Liu, Weiyao Huang, Lehong Wu, Zelin Chen, Daolin Ma, School of Computer Science, School of Ocean, Civil Engineering, Xense Robotics

Center on Frontiers of Computing Studies, School of Computer Science, Peking University, PKU-AgiBot Lab, School of Ocean and Civil Engineering, Shanghai Jiao Tong University, Xense Robotics

6D位姿估计类别级位姿手部姿态

针对机器人在手操作中仅凭局部触觉难以精确定位、且需适应未见 CAD 模型的问题,UniTac2Pose 将候选采样/预排序、能量梯度细化和后排序统一到一个仅用仿真训练的能量式扩散模型中,并用 render-compare 缓解 sim-to-real。真实实验显示其优于回归、匹配和配准基线,同时支持位姿跟踪与不确定性估计。

Self-Supervised Cross-Modal Learning for Image-to-Point Cloud Registration Figure 1
arXiv preprint2025-09-19

Self-Supervised Cross-Modal Learning for Image-to-Point Cloud Registration

Xingmei Wang, Xiaoyu Hu, Chengkai Huang, Ziyan Zeng, Guohao Nie, Quan Z. Sheng, Lina Yao

6D位姿估计点云

面向自动驾驶/机器人中相机与 LiDAR 外参缺失或漂移时的图像-点云配准难题,CrossI2P 以自监督双路径对比学习缩小语义-几何鸿沟,并用超点-超像素到点级细化的粗到细流程结合可微 PnP 与动态梯度平衡实现端到端优化。在 KITTI Odometry 和 nuScenes 上分别较现有方法提升 23.7% 与 37.9%,显示出更好的精度与鲁棒性。

A PCA Based Model for Surface Reconstruction from Incomplete Point Clouds Figure 1
arXiv preprint2025-09-19

A PCA Based Model for Surface Reconstruction from Incomplete Point Clouds

Hao Liu

Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong

6D位姿估计点云三维重建

针对遮挡、吸光等导致点云缺失时传统重建难以约束空洞区域的问题,本文在水平集重建框架中用 PCA 从已有点估计并外推法向,将法向一致性与距离项、曲率正则联合建模,并用算子分裂求解。实验显示该方法能在缺失区域推断较合理的表面结构,重建质量优于对比方法;但其与6D位姿估计的直接关系文中未充分说明。

PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectors Figure 1
arXiv preprint2025-10-24

PolyJuice Makes It Real: Black-Box, Universal Red Teaming for Synthetic Image Detectors

Sepehr Dehdashtian, Mashrur M. Morshed, Jacob H. Seidman, Reality Defender @msu.edu @realitydefender.ai

Michigan State University

6D位姿估计仿真到现实

针对合成图检测器多为黑盒且现有红队攻击需逐图优化的问题,PolyJuice利用T2I潜空间中“被判真/假”样本的分布偏移,离线估计通用 steering 方向并迁移到高分辨率生成。实验显示其最高可使检测器受骗率达84%,用其增强数据再训练可将检测性能提升最高30%,但与6D位姿任务关联不明显。

MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the Wild Figure 1
arXiv preprint2025-09-19

MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the Wild

Deming Li, Kaiwen Jiang, Yutao Tang, Ravi Ramamoorthi, Rama Chellappa, Cheng Peng

Johns Hopkins University, University of California, San Diego

6D位姿估计三维重建高斯泼溅

MS-GS针对野外照片中视角稀疏且光照、季节等外观不一致时,3DGS易受稀疏SfM初始化限制并过拟合的问题。其核心是用SfM锚定的局部语义区域对齐单目深度,生成更可靠的稠密点云,并在虚拟视角上施加像素与特征级几何监督以约束多视图一致性。论文还提出更贴近真实注册噪声的数据与评测设置,实验显示在多数据集上较现有方法获得更清晰、照片级的重建与新视角合成结果。

STARC: See-Through-Wall Augmented Reality Framework for Human-Robot Collaboration in Emergency Response Figure 1
arXiv preprint2025-09-19

STARC: See-Through-Wall Augmented Reality Framework for Human-Robot Collaboration in Emergency Response

Shenghai Yuan, Guo, Weixiang, Tianxin Hu, Yang Yu, Jinyu Chen, Rui Qian, Zhongyuan Liu, Lihua Xie

6D位姿估计机器人操作

面向火灾、灾害救援等遮挡严重的室内场景,STARC试图解决救援人员只能获得局部视野、难以及时定位隐蔽人员和风险的问题。其核心是把地面机器人LIO建图与检测结果,通过救援人员佩戴/手持LiDAR的跨传感器位姿配准锚定到第一人称AR视图中。仿真、实验室和战术场测显示配准、检测与叠加较稳定,但真实高危环境中的鲁棒性仍需进一步验证。

NeuroRAD-FM: A Foundation Model for Neuro-Oncology with Distributionally Robust Training Figure 1
arXiv preprint2025-09-18

NeuroRAD-FM: A Foundation Model for Neuro-Oncology with Distributionally Robust Training

Introduction

6D位姿估计

针对脑肿瘤 MRI 在不同机构、类别及罕见分子标志物上分布不均导致基础模型泛化差的问题,NeuroRAD-FM在BYOL/DINO/MAE/MoCo自监督预训练中加入DRO以学习更站点不变的表征。实验显示+DRO提升分子预测,CUIMC平均平衡准确率0.744→0.785,罕见终点如CDKN2A/2B提升明显,并在三中心均改善生存c-index;仍需前瞻验证。

DIPP: Discriminative Impact Point Predictor for Catching Diverse In-Flight Objects Figure 1
arXiv preprint2025-09-18

DIPP: Discriminative Impact Point Predictor for Catching Diverse In-Flight Objects

Ngoc Huy Nguyen, Kazuki Shibata, Takamitsu Matsubara

and Takamitsu Matsubara

6D位姿估计

面向四足机器人用篮筐接住飞行物,论文关注短早期轨迹在复杂气动下难以预测落点的问题。作者采集20类物体8000条真实轨迹,并提出OIPP:用对象自适应编码器从位置、速度、加速度历史中学习动力学相关表征,再通过轨迹式NAE或直接式DPE预测撞击点。实验显示其在15个已见和5个未见物体上优于基线,早期落点预测提升也带来仿真与实机接球成功率提高。

RGB-Only Supervised Camera Parameter Optimization in Dynamic Scenes Figure 1
arXiv preprint2025-09-19

RGB-Only Supervised Camera Parameter Optimization in Dynamic Scenes

IL 61820 n-ahuja@illinois.edu

University of Illinois at Urbana-Champaign

6D位姿估计

针对动态场景中 COLMAP 依赖运动掩码且耗时、其他方法又常需焦距/深度/位姿等额外监督的问题,ROS-Cam 仅用单段 RGB 视频优化焦距与相机位姿。其核心是基于点跟踪的 patch 级筛选构造稀疏约束,并用带 Cauchy 不确定性的联合优化自适应压低运动外点,再以两阶段策略提升稳定性。作者在 4 个真实数据集和 MPI-Sintel 上验证,相机估计更快更准,并能改善后续 4D 重建质量。

Semantic-LiDAR-Inertial-Wheel Odometry Fusion for Robust Localization in Large-Scale Dynamic Environments Figure 1
arXiv preprint2025-09-18

Semantic-LiDAR-Inertial-Wheel Odometry Fusion for Robust Localization in Large-Scale Dynamic Environments

Haoxuan Jiang, Peicong Qian, Yusen Xie, Linwei Zheng, Xiaocong Li, Ming Liu, Jun Ma, Senior Member, IEEE

6D位姿估计相机位姿点云

面向港口等大尺度动态场景中 GPS/WiFi 不稳定、纯几何 LiDAR 定位易受动态物体和长期漂移影响的问题,本文将语义体素地图匹配与 LiDAR-IMU-轮速紧耦合 iESKF 结合,并用 3D 自适应 scaling 调整复杂地形下轮速权重。在百万平方米自动化港口、35 台 IGV 共 3575 小时数据上,系统较现有 LiDAR 定位方法更稳定,显示出较强工程落地价值。

UCorr: Wire Detection and Depth Estimation for Autonomous Drones Figure 1
arXiv preprint2025-09-18

UCorr: Wire Detection and Depth Estimation for Autonomous Drones

Benedikt Kolbeinsson, k.mikolajczyk@imperial.ac.uk

Imperial College London

6D位姿估计彩色深度

面向无人机避障中细电线难以由常规视觉或近距传感稳定发现、且仅分割不足以支持安全绕行的问题,UCorr提出单目端到端框架,在编码器-解码器中引入基于相邻两帧的时序相关层,并用合成数据训练,同时输出电线分割与深度;论文还设计了针对电线的深度评估指标,实验显示其在联合检测与深度估计上优于现有方法,但真实数据验证不足。

NeRF-based Visualization of 3D Cues Supporting Data-Driven Spacecraft Pose Estimation Figure 1
arXiv preprint2025-10-20

NeRF-based Visualization of 3D Cues Supporting Data-Driven Spacecraft Pose Estimation

Antoine Legrand, Renaud Detry, Christophe De Vleeschouwer

6D位姿估计三维重建航天器

面向在轨服务中的单目航天器6D位姿估计,论文针对数据驱动模型黑箱性阻碍任务采用的问题,提出用冻结位姿网络的反传梯度训练NeRF图像生成器,从任意视角合成能触发正确预测的目标3D线索。实验在SPNv2上显示该方法可恢复网络依赖的关键结构,并揭示监督方式会影响其隐式目标表示,多任务学习有助于提升泛化。

Unconditional and optimal error analysis of two linearized finite difference schemes for the logarithmic Schrödinger equation Figure 1
arXiv preprint2025-09-18

Unconditional and optimal error analysis of two linearized finite difference schemes for the logarithmic Schrödinger equation

Tingchun Wang, Jingye Yan

6D位姿估计

这篇论文并非6D位姿估计工作,而是针对对数薛定谔方程中对数非线性在零点奇异、既有方法常需正则化或时间步限制的问题,提出一阶/二阶后向差分结合中心差分的线性格式。核心在于直接处理未正则化项并给出无条件误差分析,得到一阶格式最优、二阶格式近最优的离散l2误差界,同时在无网格比限制下建立离散H1误差估计,数值实验验证了收敛率与动力学现象。

DICE: Diffusion Consensus Equilibrium for Sparse-view CT Reconstruction Figure 1
arXiv preprint2025-09-18

DICE: Diffusion Consensus Equilibrium for Sparse-view CT Reconstruction

Leon Suarez-Rodriguez, Roman Jacome, Romario Gualdrón-Hurtado, Ana Mantilla-Dulcey, Henry Arguello

Industrial University of Santander

6D位姿估计三维重建

稀疏视角 CT 为降低辐射和扫描时间会带来严重欠采样,传统正则或端到端网络难以兼顾数据一致性与真实结构先验。DICE 将扩散模型采样改写为两代理共识平衡:近端算子约束投影测量,扩散代理提供干净图像估计,并随噪声调度迭代协调二者。在 15/30/60 视角、均匀与非均匀采样下均优于现有基线,显示出较强鲁棒性;但其与仓库“6D 位姿”分类关联不明显。

Indoor Airflow Imaging Using Physics-Informed Background-Oriented Schlieren Tomography Figure 1
arXiv preprint2025-09-17

Indoor Airflow Imaging Using Physics-Informed Background-Oriented Schlieren Tomography

Arjun Teh1, Wael H. Ali2, Joshua Rapp2, Hassan Mansour2

6D位姿估计

面向室内 HVAC 优化中三维气流难以非接触测量的问题,本文把单视角 BOS 折射成像扩展到房间尺度:用投影图案与相机观测微小畸变,结合准线性光线追踪、RRTE 物理渲染损失和满足浮力驱动流 PDE 的 PINN 正则来缓解单视角层析歧义。结果展示了温度场重建及损失消融的误差降低,但定量指标与泛化验证文中未充分说明。

\textsc{Gen2Real}: Towards Demo-Free Dexterous Manipulation by Harnessing Generated Video Figure 1
arXiv preprint2025-09-16

\textsc{Gen2Real}: Towards Demo-Free Dexterous Manipulation by Harnessing Generated Video

Kai Ye, Yuhang Wu, Shuyuan Hu, Junliang Li, Meng Liu, Yongquan Chen, Rui Huang

The Chinese University of Hong Kong, Shenzhen, Shenzhen Institute of Artificial Intelligence and Robotics for Society, University of California, San Diego

6D位姿估计机器人操作

针对灵巧手操作依赖遥操作/动捕示范、数据采集昂贵且难覆盖新任务的问题,Gen2Real尝试只用一段由语言条件生成的人手操作视频学习策略。其关键在于从视频解析手—物6D轨迹,并用PIOM加入几何、接触与时序物理约束,再经运动重定向和残差PPO稳定执行。实验中仅用生成视频在仿真抓取达到77.3%成功率,并展示真实机器人连贯执行。

Deconstructing Intraocular Pressure: A Non-invasive Multi-Stage Probabilistic Inverse Framework Figure 1
arXiv preprint2025-09-17

Deconstructing Intraocular Pressure: A Non-invasive Multi-Stage Probabilistic Inverse Framework

1 Introduction

6D位姿估计

该文针对青光眼中眼压只能间接反映房水外流、且小梁网渗透率无法体内测量的问题,提出按 Darcy 物理分解的多阶段概率逆框架:用有限元训练 AI 代理估计渗透率,再以 PCDS 扩展数据学习个体几何校准,并用贝叶斯量化不确定性。结果显示两阶段模型在合成测试上 R²约0.77/0.79,推断渗透率与临床外流能力高度相关,非侵入式外流能力估计接近 tonography,但前瞻验证仍文中未充分说明。

BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection Figure 1
arXiv preprint2025-09-17

BEVUDA++: Geometric-aware Unsupervised Domain Adaptation for Multi-View 3D Object Detection

Rongyu Zhang, Jiaming Liu, Xiaoqi Li, Xiaowei Chi, Dan Wang, Li Du Yuan Du 🖂, Shanghang Zhang

University. (e-mail

6D位姿估计仿真到现实多视角

该文针对多视角 BEV 3D 检测在场景、天气、昼夜等仿真/现实或跨域部署中性能骤降的问题,指出域偏移会在 2D、Voxel 与 BEV 几何空间逐级累积。BEVUDA++ 用可靠深度教师融合目标域 LiDAR 与低不确定性深度预测,并让学生在统一几何嵌入中对齐多空间特征,配合不确定性引导 EMA 降低伪标签误差。在 nuScenes 多个 UDA 场景取得 SOTA,昼夜适配提升 12.9% NDS、9.5% mAP。

A Task Equalization Allocation Algorithm Incorporating Blocking Estimation and Resource Similarity Analysis for Vehicle Control Real-Time Systems Figure 1
arXiv preprint2025-09-17

A Task Equalization Allocation Algorithm Incorporating Blocking Estimation and Resource Similarity Analysis for Vehicle Control Real-Time Systems

Qianlong duan, Bide Hao, Shichun Yang, Fei Chen, Fan Zhou

6D位姿估计

面向智能车多核控制中共享资源竞争导致的同步阻塞与实时性下降,论文提出 BR-WFD 任务分配算法,在分配阶段估计阻塞时间,并结合资源访问相似性将相关任务聚合到同核,同时用最坏适配维持负载均衡。仿真显示其在高负载、强竞争场景下可减少 11%–28% 所需核心数,调度成功率提高约 15%–20%,但结果主要基于模拟实验。

Physics-based deep kernel learning for parameter estimation in high dimensional PDEs Figure 1
arXiv preprint2025-09-17

Physics-based deep kernel learning for parameter estimation in high dimensional PDEs

Weihao Yan* Mathematics of Imaging, The Netherlands w.yan@utwente.nl, Christoph Brune Mathematics of Imaging, The Netherlands c.brune@utwente.nl, Sweden mengwu.guo@math.lu.se

University of Twente, The Netherlands, Centre for Mathematical Sciences, Lund University, Sweden

6D位姿估计

针对高维 PDE 反问题中传统数值求解和普通 GP 代理难以兼顾计算成本、维度灾难与不确定性量化的问题,论文提出两阶段贝叶斯框架:先用物理约束 DKL 学习低维非线性特征并给出参数初值,再固定网络权重用 HMC 采样核超参数与 PDE 参数后验。实验显示其在稀疏观测下能较准确估计参数并给出不确定性,但与 6D 位姿估计关联不明显。

Time-smoothed inverse probability weighted estimation of effects of generalized time-varying treatment strategies on repeated outcomes truncated by death Figure 1
arXiv preprint2025-09-17

Time-smoothed inverse probability weighted estimation of effects of generalized time-varying treatment strategies on repeated outcomes truncated by death

Sean McGrath, Takuya Kawahara, Joshua Petimar, Sheryl L. Rifas-Shiman, Iván Díaz, Jason P. Block, Jessica G. Young

Department of Biostatistics, Yale University, New Haven, CT, USA, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA, USA, Clinical Research Promotion Center, The University of Tokyo Hospital, Japan, Division of Biostatistics, New York University, New York, NY, USA

6D位姿估计

本文针对电子健康记录中动态用药策略评估的难点:结局稀疏、非单调且受死亡截断,提出带时间平滑的逆概率加权估计框架,可处理广义时间变化策略并利用重复结局提升精度。模拟显示其相比传统非平滑 IPW 有明显效率增益;抗抑郁药体重变化案例验证了方法可用性,但与6D位姿估计关联不明。

SWA-PF: Semantic-Weighted Adaptive Particle Filter for Memory-Efficient 4-DoF UAV Localization in GNSS-Denied Environments Figure 1
arXiv preprint2025-09-20

SWA-PF: Semantic-Weighted Adaptive Particle Filter for Memory-Efficient 4-DoF UAV Localization in GNSS-Denied Environments

Jiayu Yuan, Ming Dai, Enhui Zheng, Chao Su, Nanxing Chen, Qiming Hu, Shibo Zhu, Yibin Cao

6D位姿估计航天器

针对 GNSS 受限环境下无人机视觉定位对数据集、实时性和跨季节泛化的依赖,论文提出 MAFS/ SemanticMAFS 多高度飞行数据集,并用语义加权的自适应粒子滤波融合无人机俯视图与低分辨率卫星图,估计经纬度、高度和航向。实验称其可在数秒内完成 4-DoF 定位,误差低于 10 米,较特征提取方法计算效率提升约 10 倍。

Bridging the Synthetic-Real Gap: Supervised Domain Adaptation for Robust Spacecraft 6-DoF Pose Estimation Figure 1
arXiv preprint2025-09-17

Bridging the Synthetic-Real Gap: Supervised Domain Adaptation for Robust Spacecraft 6-DoF Pose Estimation

Inder Pal Singh, Nidhal Eddine Chenni, Abd El Rahman Shabayek, Arunkumar Rathinam, Djamila Aouada

SnT, University of Luxembourg, Luxembourg

6D位姿估计仿真到现实航天器

针对航天器6D位姿估计中合成训练到真实/实验图像性能骤降的问题,本文把少量有标注真实数据纳入混合式“检测-关键点-PnP”流程的关键点回归阶段,基于LIRR联合学习域不变表征与任务风险。SPEED+实验显示其优于仅源域、微调和oracle基线,5%目标域标注即可达到或超过更多真实标注训练的oracle表现。

Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysis Figure 1
arXiv preprint2025-09-17

Who is Introducing the Failure? Automatically Attributing Failures of Multi-Agent Systems via Spectrum Analysis

Yu Ge, Linna Xie : 1, Zhong Li, Yu Pei

Nanjing University, The Hong Kong Polytechnic University

6D位姿估计

针对 LLM 多智能体系统失败后难以从冗长自然语言日志中定位责任动作的问题,论文提出 Famas:通过重复回放失败任务、将日志抽象为 agent-action-state 轨迹,并借鉴谱系故障定位计算动作可疑度;其关键洞察是致错动作/状态会在多次失败执行中反复出现,同时用智能体行为与动作行为两类指标校正 MAS 的异质执行模式。在 Who&When 的 184 条失败轨迹上,Famas 相比 12 个基线最佳,动作级归因准确率达 29.35%,较既有方法提升 49.13%。

UM-Depth : Uncertainty Masked Self-Supervised Monocular Depth Estimation with Visual Odometry Figure 1
arXiv preprint2025-09-17

UM-Depth : Uncertainty Masked Self-Supervised Monocular Depth Estimation with Visual Odometry

Tae-Wook Um, Ki-Hyeon Kim, Hyun-Duck Choi, Hyo-Sung Ahn

6D位姿估计相机位姿彩色深度

UM-Depth针对自监督单目深度在动态物体、低纹理区域中光度监督不可靠的问题,引入教师-学生框架:教师仅在训练期用光流、深度与位姿估计生成运动/不确定性引导,学生结合Mamba编码器、PBU-HRNet解码器和轻量range-map模块细化低置信区域,避免推理额外开销。实验显示其在KITTI深度与里程计上达到SOTA,在Cityscapes上保持竞争力。

Gaussian Alignment for Relative Camera Pose Estimation via Single-View Reconstruction Figure 1
arXiv preprint2025-09-17

Gaussian Alignment for Relative Camera Pose Estimation via Single-View Reconstruction

Yumin Li, Dylan Campbell

6D位姿估计相机位姿三维重建高斯泼溅

针对传统双目相对位姿依赖2D匹配、尺度不确定且在大基线和弱纹理场景易失效的问题,GARPS将两张单图分别重建为带度量尺度的3D高斯混合模型,再用结合几何、颜色、各向异性协方差与语义一致性的可微目标优化相机位姿,无需训练和显式对应。RealEstate10K实验显示其优于经典方法及MASt3R等学习方法。

Object Pose Estimation through Dexterous Touch Figure 1
arXiv preprint2025-09-16

Object Pose Estimation through Dexterous Touch

Jiyue Zhu, Kezhou Chen, Sha Yi, Cornelia Fermüller, Yiannis Aloimonos, Xiaolong Wang ¡-this

University of Twente, AE Enschede, The Netherlands, Bernard D. Researcheris with the Department of Electrical Engineering, Wright State University

6D位姿估计物体位姿

针对视觉受光照、遮挡和材质影响、而触觉又稀疏局部的6D物体位姿估计问题,本文提出双手触觉主动探索框架:一只手稳定持物,另一只搭载简单FSR传感器的灵巧手通过强化学习选择接触点,并用累积接触点云迭代细化形状与位姿。其关键在于将覆盖率和位姿不确定性写入状态与奖励,使无模板对象也能被有效探索;在未见物体上,100步触觉探索达到87% ADD-S准确率。

Using Visual Language Models to Control Bionic Hands: Assessment of Object Perception and Grasp Inference Figure 1
arXiv preprint2025-09-16

Using Visual Language Models to Control Bionic Hands: Assessment of Object Perception and Grasp Inference

Ozan Karaali, Hossam Farag, Strahinja Došen, Technology, Denmark Email: @es.aau.dk, sdosen@hst.aau.dk

Department of Electronic Systems, Aalborg University, Denmark, Department of Health, Science and Technology, Aalborg University, Denmark

6D位姿估计手部姿态

针对半自主仿生手依赖检测、分割、位姿估计和抓取规划多模块流水线、控制复杂且认知负担高的问题,论文评测单个VLM能否从静态图像直接输出物体属性与抓取参数的结构化JSON。基于34个日常物体和8个VLM的基准显示,模型在物体名称和形状识别上较可靠,但尺寸估计、腕部旋转和手张开量等细粒度抓取推理波动明显,说明其可作为感知模块原型,但离稳定闭环假肢控制仍有差距。

MapAnything: Universal Feed-Forward Metric 3D Reconstruction Figure 1
arXiv preprint2025-09-18

MapAnything: Universal Feed-Forward Metric 3D Reconstruction

Nikhil Keetha, Norman Müller, Johannes Schönberger, Lorenzo Porzi, Yuchen Zhang Tobias Fischer, Arno Knapitsch, Duncan Zauss, Ethan Weber, Nelson Antunes Jonathon Luiten, Manuel Lopez-Antequera, Samuel Rota Bulò, Christian Richardt Deva Ramanan, Sebastian Scherer, Peter Kontschieder Meta Reality Labs

Nikhil Keetha 1,2, Ethan Weber, Meta Reality Labs, Carnegie Mellon University

6D位姿估计三维重建

针对传统三维重建需拆分 SfM、MVS、深度与相机位姿估计且难以利用异构先验的问题,MapAnything 用统一 Transformer 前馈模型接收图像及可选内参、外参、深度等几何输入;其关键是将场景分解为深度、局部 raymap、相机位姿与全局尺度,便于跨数据集监督和度量化输出。实验显示其在多视图重建、两视图、标定与深度任务上达到或超过专用前馈模型,并能从额外几何输入中继续获益。

Investigating the Performance of EKF, UKF, and PF for Quadrotor Position Estimation in Hurricane Wind Disturbances Figure 1
arXiv preprint2025-09-16

Investigating the Performance of EKF, UKF, and PF for Quadrotor Position Estimation in Hurricane Wind Disturbances

Ahmed A. Elgohary, Benjamin Gwinnell, Josh Augustine

6D位姿估计

面向飓风级湍流下小型四旋翼难以稳定定位的问题,论文在Von Karman风场和纵向动力学仿真中比较EKF、UKF、PF,并用遗传算法调参Q/R及UKF参数。核心洞察是精度、平滑性与计算量存在明显权衡:EKF最快但非线性适应性弱,PF鲁棒却计算开销高,UKF在捕捉动态风扰和位置估计误差上表现最均衡。

ROOM: A Physics-Based Continuum Robot Simulator for Photorealistic Medical Datasets Generation Figure 1
arXiv preprint2025-09-16

ROOM: A Physics-Based Continuum Robot Simulator for Photorealistic Medical Datasets Generation

Salvatore Esposito, Matías Mattamala, Daniel Rebain, Francis Xiatian Zhang, Kevin Dhaliwal, Mohsen Khadem, Subramanian Ramamoorthy

6D位姿估计机器人操作数据集/基准医学/手术

针对支气管镜连续体机器人难以获取真实临床训练数据、又需要毫米级视觉与物理反馈的问题,ROOM将患者CT重建、连续体机器人动力学/组织接触和内窥镜光照噪声渲染整合为自动化仿真管线,生成RGB、深度、法向、光流和点云等多模态数据;文中在多视角位姿估计和单目深度任务上验证其数据能暴露医学场景迁移难点,并可用于微调深度模型和支持导航应用。

Efficient estimation for flexible spatial zero-inflated models with environmental applications Figure 1
Stochastic Environmental Research and Risk Assessment2025-09-16

Efficient estimation for flexible spatial zero-inflated models with environmental applications

Chung-Wei Shen, Bu-Ren Hsu, Chia-Ming Hsu, Chia-Yi, Taiwan, R.O.C, Taoyuan

National Chung Cheng University, National Central University

6D位姿估计

针对零膨胀且存在空间相关的大规模环境数据,论文关注传统参数分布假设易带来偏差、潜变量维度高导致估计缓慢的问题。其核心做法是用基函数投影压缩空间潜变量,并结合 GEE、AIC 选基函数数目和 block jackknife 评估稳定性。仿真与 2016 年台湾日降雨数据表明该方法可在保持灵活建模的同时提升估计可行性;与 6D 位姿估计的直接关联文中未充分说明。

C3DE: Causal-Aware Collaborative Neural Controlled Differential Equation for Long-Term Urban Crowd Flow Prediction Figure 1
arXiv preprint2025-09-15

C3DE: Causal-Aware Collaborative Neural Controlled Differential Equation for Long-Term Urban Crowd Flow Prediction

Yuting Liu, Qiang Zhou (✉, Hanzhe Li, Chenqi Gong, Jingjing Gu

6D位姿估计

面向长周期城市人流预测中粗粒度采样带来的误差累积,以及POI演化与人流在不同时间尺度上不同步、易产生伪相关的问题,C3DE用双路径NCDE连续建模人流与POI协同动态,并引入基于反事实的因果效应估计与动态校正来削弱无关POI干扰。三组真实城市数据实验显示其整体优于对比方法,尤其在人流波动明显的城市更有效。

3D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review Figure 1
arXiv preprint2025-09-23

3D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review

Salma Galaaoui, Eduardo Valle, David Picard, Nermin Samet

6D位姿估计人体姿态点云

面向自动驾驶和城市场景中从稀疏、噪声和遮挡严重的 LiDAR 点云恢复人体 3D 姿态与形状的需求,本文系统综述 2019–2025 年 32 项深度学习方法,提出按传感器、任务与网络设计组织的分类框架,并统一比较常用数据集、评测指标和基准表。主要结果是厘清了现有方法的优势与局限,指出数据多样性、点云稀疏性、多模态/弱监督利用等仍是关键瓶颈。

Robust Fetal Pose Estimation across Gestational Ages via Cross-Population Augmentation Figure 1
Lecture notes in computer science2025-09-15

Robust Fetal Pose Estimation across Gestational Ages via Cross-Population Augmentation

Sebastian Diaz, Benjamin Billot, Neel Dey, Molin Zhang, Esra Abaci Turk, P. Ellen Grant, Polina Golland, Elfar Adalsteinsson

Harvard University

6D位姿估计

本文针对早孕期胎儿 MRI 姿态估计难以标注、且由晚孕期训练的关键点模型跨孕周泛化差的问题,提出跨人群增强:在常规 MRI 扰动外,将分割出的胎儿随机缩放、形变并嵌入不同子宫环境,以模拟早孕期更小体型和更大活动空间。实验显示该增强降低预测波动,并在晚孕期与更具挑战的早孕期病例上均带来显著提升。

Generalizing Behavior via Inverse Reinforcement Learning with Closed-Form Reward Centroids Figure 1
arXiv preprint2025-09-15

Generalizing Behavior via Inverse Reinforcement Learning with Closed-Form Reward Centroids

Filippo Lazzati Politecnico di Milano Milan, Italy

6D位姿估计

本文针对仅有专家示范、却需迁移到新动力学或额外约束环境时,IRL奖励不可辨识导致策略选择含糊的问题,提出在可行奖励集的有界无偏子集上取“平均”决策,并证明可通过闭式奖励质心规划实现。作者给出三类行为模型下的无偏先验、质心公式及仅用离线示范估计的高效算法;实验为数值仿真,说明策略行为关系,但目前限于表格MDP,尚未验证6D位姿等真实机器人场景。

Segmentation-Driven Initialization for Sparse-view 3D Gaussian Splatting Figure 1
arXiv preprint2025-11-18

Segmentation-Driven Initialization for Sparse-view 3D Gaussian Splatting

Yi-Hsin Li, Thomas Sikora, Sebastian Knorr, Mårten Sjöström

6D位姿估计三维重建高斯泼溅

该文针对稀疏视角3D Gaussian Splatting中SfM位姿初始化不稳、SfM-free方法逐像素反投影又造成高斯数量和显存开销过大的问题,提出SDI-GS:用区域分割线索在初始化阶段筛选结构重要区域,对稠密点云选择性下采样。实验显示其最多减少约50%高斯数量,并在PSNR、SSIM上保持相当或更好质量,LPIPS仅小幅下降,同时加快训练、降低内存占用。

IMD: A 6-DoF Pose Estimation Benchmark for Industrial Metallic Objects Figure 1
arXiv preprint2025-09-15

IMD: A 6-DoF Pose Estimation Benchmark for Industrial Metallic Objects

Ruimin Ma, Sebastián Zudaire, Zhen Li, Chi Zhang

KTH Royal Institute of Technology, ABB Corporate Research

6D位姿估计数据集/基准

针对现有6D位姿基准偏向低反光日用品、难以反映金属无纹理工业件的问题,IMD构建了含45个真实比例金属零件、CAD模型、RGB-D视频及精修分割/位姿标注的数据集,并覆盖视频分割、位姿跟踪和one-shot估计三类任务。对SAM2、XMem、BundleTrack、BundleSDF等评测表明,强反光、遮挡和复杂布局使该基准明显难于家用物体数据集。

Machine Learning-Driven Predictive Resource Management in Complex Science Workflows Figure 1
arXiv preprint2025-09-15

Machine Learning-Driven Predictive Resource Management in Complex Science Workflows

Tadashi Maeno, Fatih Furkan Akman, Joseph Boudreau, Sankha Dutta, Shengyu Feng, Adolfy Hoisie, Kuan-Chieh Hsu, Raees Khan, Jaehyung Kim, Ozgur O. Kilic, Scott Klasky, Alexei Klimentov, Tatiana Korchuganova, Verena Ingrid Martinez Outschoorn, Paul Nilsson, David K. Park, Norbert Podhorszki, Yihui Ren, John Rembrandt Steele, Frédéric Suter, Sairam Sri Vatsavai, Torre Wenaus, Wei Yang, Yiming Yang, Shinjae Yoo

6D位姿估计

本文面向 PanDA 等大规模科学工作流中资源需求事先未知的问题,动机是减少 Scout Jobs 两阶段试跑带来的失败、等待和资源错配。核心做法是用任务提交时可得特征与四年约 400 万次成功任务数据,训练分类式模型预测内存、CPU 时间、I/O 强度和 walltime,并形成反馈更新管线。结果显示可在 ATLAS 类测试环境中提前支持调度决策,但具体效率增益和相对基线数值文中未充分说明,增益来源可能主要来自历史数据规模。

FR-Net: Learning Robust Quadrupedal Fall Recovery on Challenging Terrains through Mass-Contact Prediction Figure 1
IEEE Robotics and Automation Letters2025-09-15

FR-Net: Learning Robust Quadrupedal Fall Recovery on Challenging Terrains through Mass-Contact Prediction

Yidan Lu, Yinzhao Dong, Jiahui Zhang, Ji Ma, Peng Lu

University of Hong Kong

6D位姿估计

针对四足机器人在陡坡、楼梯、悬空梁和间隙等复杂地形跌倒后难以安全起身的问题,FR-Net 将强化学习恢复策略与质量-接触预测器结合,用有限本体感知估计质心分布和接触状态,并通过特权学习与奖励设计抑制危险翻滚。实验显示其可在仿真中跨 Go2、Spot、Lite3 等平台泛化,并在 Go2 的 10 类真实场景中完成更稳健的跌倒恢复。

Solving ill-conditioned polynomial equations using score-based priors with application to multi-target detection Figure 1
arXiv preprint2025-09-14

Solving ill-conditioned polynomial equations using score-based priors with application to multi-target detection

Rafi Beinhorn, Shay Kreymer, Amnon Balanov, Michael Cohen, Alon Zabatani, Tamir Bendory

6D位姿估计

低阶矩恢复常会转化为病态多项式方程,在高噪声 MTD 与超分辨场景中传统自相关/矩方法不稳定甚至不可解。本文的核心思路是把 score-based 扩散模型作为数据先验嵌入矩估计求解,用生成先验约束非线性反问题。MNIST 实验显示,其可提升三阶矩重建精度,并使原本病态的超分辨 MTD 可行;但理论收敛与真实 cryo-EM/机器人位姿场景泛化仍文中未充分说明。

ActivePose: Active 6D Object Pose Estimation and Tracking for Robotic Manipulation Figure 1
arXiv preprint2025-09-14

ActivePose: Active 6D Object Pose Estimation and Tracking for Robotic Manipulation

Sheng Liu, Zhe Li, Weiheng Wang, Han Sun, Heng Zhang, Hongpeng Chen, Yusen Qin, Arash Ajoudani, Yizhao Wang

Karlsruhe Institute of Technology, Germany, Shanghai Jiao Tong University, China, The Hong Kong Polytechnic University, Hong Kong, D-Robotics, China

6D位姿估计物体位姿机器人操作

针对零样本6D位姿在遮挡、对称或纹理缺失视角下易产生歧义、固定相机又难以跟随操作过程的问题,ActivePose将CAD渲染与FoundationPose熵用于构造几何提示,让VLM判断当前视角歧义,并在IK可行候选中选择NBV;同时用模仿学习训练扩散策略主动规划相机轨迹。仿真与真实双臂实验、插孔装配案例显示其相较经典基线提升了位姿消歧和跟踪稳定性,但VLM查询延迟仍是主要瓶颈。

Nonreciprocal RIS-Aided Covert Channel Reciprocity Attacks and Countermeasures Figure 1
arXiv preprint2025-09-14

Nonreciprocal RIS-Aided Covert Channel Reciprocity Attacks and Countermeasures

Haoyu Wang, Jiawei Hu, Jiaqi Xu, Ying Ju, A. Lee Swindlehurst

6D位姿估计

本文关注TDD多天线系统中恶意非互易RIS破坏上下行信道互易性的隐蔽威胁:攻击者无需发射信号、CSI或严格同步,也可使基站按错误下行信道设计预编码并增强窃听。核心在于采用物理一致的NR-RIS模型刻画CRACK,并提出基于深度强化学习的SecureCoder,仅利用上行CSI估计和速率反馈修正预编码。仿真显示CRACK会显著降低吞吐,而SecureCoder可恢复速率并降低安全泄露风险。

Multi-Task Diffusion Approach For Prediction of Glioma Tumor Progression Figure 1
arXiv preprint2025-09-13

Multi-Task Diffusion Approach For Prediction of Glioma Tumor Progression

Aghiles Kebaili, Romain Modzelewski, Jérôme Lapuyade-Lahorgue, Maxime Fontanilles, Sébastien Thureau, Su Ruan

6D位姿估计

针对胶质瘤随访 MRI 稀疏、时间间隔不规则导致像素级进展预测不稳的问题,本文提出多任务扩散框架,仅用早期两次扫描即可在任意未来时间生成 FLAIR,并基于 SDF 输出肿瘤演化概率图;同时引入形变场模块、序列/模态补全增强和放疗剂量加权 focal loss。方法在公开数据训练并在私有数据验证,报告取得有希望的结果,但具体量化增益与消融贡献文中未充分说明。

USCTNet: A deep unfolding nuclear-norm optimization solver for physically consistent HSI reconstruction Figure 1
arXiv preprint2025-09-19

USCTNet: A deep unfolding nuclear-norm optimization solver for physically consistent HSI reconstruction

Xiaoyang Ma, Yiyang Chai, Xia Qü, Hongchun Sun

6D位姿估计三维重建

单幅 RGB 重建高光谱图像易因相机光谱响应和光照未知而产生颜色不一致。USCTNet 将问题写成带核范数低秩先验的物理反问题,在深度展开迭代中显式估计前向成像算子,并用低秩子空间近端替代完整 SVD 的 SVT,以提升效率和训练稳定性。标准基准上其在重建精度、感知质量和颜色一致性方面超过现有 RGB 方法。

HiLWS: A Human-in-the-Loop Weak Supervision Framework for Curating Clinical and Home Video Data for Neurological Assessment Figure 1
arXiv preprint2025-09-09

HiLWS: A Human-in-the-Loop Weak Supervision Framework for Curating Clinical and Home Video Data for Neurological Assessment

Atefeh Irani, Maryam S. Mirian, Alex Lassooij, Reshad Hosseini, Hadi Moradi, Martin J. McKeown

6D位姿估计

面向帕金森等神经评估中家庭视频质量差、任务执行不一致和标注噪声的问题,HiLWS将自适应视频过滤、姿态估计调参、任务片段选择与两阶段人机协同弱监督结合,用概率标签替代简单投票。作者在2000余段临床/家庭手部任务视频上分析失败模式,指出帧率、手部可见比例等阈值会显著影响姿态与临床预测,且居家场景需要上下文相关的筛选和专家复核。

Self-supervised Learning Of Visual Pose Estimation Without Pose Labels By Classifying LED States Figure 1
arXiv preprint2025-09-12

Self-supervised Learning Of Visual Pose Estimation Without Pose Labels By Classifying LED States

Nicholas Carlotti, Mirko Nava, Alessandro Giusti

the Dalle Molle Institute for Artificial Intelligence (IDSIA), USI-SUPSI, Lugano, 6962, Switzerland

6D位姿估计

针对多机器人相对定位中姿态标注和真实 CAD 模型成本高的问题,本文把可独立闪烁 LED 的状态分类设计为自监督前置任务,使单目模型在无位姿标签、无形状外观先验下学习机器人位置、距离和方位;实验显示其性能可接近需监督或 CAD 的方法,并能跨环境和多机器人使用,但当前主要验证在地面机器人 2D 位姿,遮挡与完整 3D 扩展仍未充分说明。

Acetrans: An Autonomous Corridor-Based and Efficient UAV Suspended Transport System Figure 1
arXiv preprint2025-09-12

Acetrans: An Autonomous Corridor-Based and Efficient UAV Suspended Transport System

Weiyan Lu, Huizhe Li, Yuhao Fang, Zhexuan Zhou, Junda Wu, Yude Li, Youmin Gong, Jie Mei

6D位姿估计航天器

针对吊挂载荷无人机在复杂环境中难以同时感知线缆/载荷状态、规划效率低且弯缆扰动下安全性不足的问题,Acetrans 将双 LiDAR-IMU 全身状态估计、面向多尺寸几何的 MACIRI 安全走廊生成、时空轨迹优化与带弯缆约束的 NMPC 统一起来。仿真和实机实验显示其在位姿/线缆估计精度、走廊规划效率和执行安全性上均优于对比方法。

AI Harmonics: a human-centric and harms severity-adaptive AI risk assessment framework Figure 1
arXiv preprint2025-09-12

AI Harmonics: a human-centric and harms severity-adaptive AI risk assessment framework

Sofia Vei, Paolo Giudici, Pavlos Sermpezis, Athena Vakali, Adelaide Emma Bernardelli

6D位姿估计

针对现有 AI 风险评估偏向机构合规、难纳入受害者视角且依赖不可靠数值评分的问题,本文提出 AI Harmonics,用序数严重度与基于 Gini/CI 的 AIH 指标将真实事件中的多方标注转化为可排序的危害优先级。实验显示政治与身体伤害的集中度最高,应优先治理;但与 6D 位姿估计关联不明显。

Loc $^2$ : Interpretable Cross-View Localization via Depth-Lifted Local Feature Matching Figure 1
arXiv preprint2025-09-29

Loc $^2$ : Interpretable Cross-View Localization via Depth-Lifted Local Feature Matching

Zimin Xia, Chenghao Xu, Switzerland @epfl.ch Equal contribution

6D位姿估计彩色深度

针对城市机器人中 GNSS 误差大、跨视角定位难解释的问题,Loc² 不再依赖全局描述子或先验 BEV 对齐,而是直接学习地面图像与航拍图像的局部对应;再用单目深度将地面点提升到 BEV,并通过可微的尺度感知 Procrustes 解析估计平移、朝向及相对深度尺度,仅需位姿弱监督。实验显示其在跨区域和未知朝向场景达到 SOTA,同时匹配内点数、RANSAC 剔除和重投影布局提供了较强可解释性。

MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos Figure 1
arXiv preprint2025-09-11

MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos

Rutav Shah, Shuijing Liu, Qi Wang, Zhenyu Jiang, Sateesh Kumar, Amazon Consumer Robotics, NVIDIA

The University of Texas at Austin Amazon Consumer Robotics NVIDIA

6D位姿估计机器人操作

MimicDroid针对机器人ICL依赖昂贵遥操作数据、难以扩展的问题,改用未标注人类play视频训练人形机器人少样本操作策略;关键做法是自监督检索相似操作片段构造context-target元训练样本,并将RGB估计的人手腕位姿重定向到机器人、用随机patch masking缓解具身与视觉差异。实验在新仿真基准和真实场景中优于现有方法,真实成功率接近翻倍,且随训练视频规模增大继续提升。

MultimodalHugs: Enabling Sign Language Processing in Hugging Face Figure 1
arXiv preprint2025-09-10

MultimodalHugs: Enabling Sign Language Processing in Hugging Face

Gerard Sant, Zifan Jiang, Carlos Escolano, Amit Moryossef, Mathias Müller, Rico Sennrich

Amit Moryossef 1,2, University of Zurich, 2 \href, Barcelona Supercomputing Center

6D位姿估计

本文动机是手语处理长期依赖临时、多代码库流程,姿态序列、视频和文本等多模态输入难以接入 Hugging Face,导致复现和公平比较困难。核心贡献是 MultimodalHugs:在 Hugging Face 之上加入统一数据格式、模态感知处理器、训练与评测抽象,兼容 Trainer/API。实验覆盖手语翻译中的姿态数据和像素字符翻译,主要证明框架可支持非文本模态的统一实验;具体性能增益并非重点,增益来源文中未充分说明。

Australian Supermarket Object Set (ASOS): A Benchmark Dataset of Physical Objects and 3D Models for Robotics and Computer Vision Figure 1
arXiv preprint2025-09-09

Australian Supermarket Object Set (ASOS): A Benchmark Dataset of Physical Objects and 3D Models for Robotics and Computer Vision

Australia Coles Group

Deakin University, Australia, Monash University, Australia, Coles Group, Australia

6D位姿估计机器人操作数据集/基准

针对YCB等物体集在澳洲难以完整采购、超市场景和可交互实物覆盖不足的问题,ASOS构建了50个Coles常见低成本商品,跨10类形状、尺寸和重量,并用高分辨率图像与SfM生成带纹理的水密3D网格及质量/尺寸元数据。主要结果是提供可同时用于仿真与真实机器人操作、6D位姿估计和检测基准的开放对象集;文中未充分说明算法层面的量化增益。

ObjectReact: Learning Object-Relative Control for Visual Navigation Figure 1
arXiv preprint2025-09-11

ObjectReact: Learning Object-Relative Control for Visual Navigation

Australia, IIIT Hyderabad, India, MBZUAI

&Vineeth Bhat 2 &Lachlan Mares 1 &Stefan Podgorski 1 &Madhava Krishna 2 &Feras Dayoub 1 &Ian Reid 1,3, University of Adelaide, Australia

6D位姿估计

本文针对单目拓扑导航中“当前图像—子目标图像”控制强依赖机器人位姿与机体形态的问题,提出以地图中的物体关系作为不随轨迹和 embodiment 变化的控制参照。方法构建相对 3D 场景图,并用 WayObject Costmap 直接驱动 ObjectReact 局部控制器,弱化显式图像匹配。实验显示其在传感器高度变化、反向行驶、捷径与新目标等任务上优于图像相对基线,且仿真训练策略可迁移到真实室内环境。

Evaluating Quantum Amplitude Estimation for Pricing Multi-Asset Basket Options Figure 1
arXiv preprint2025-09-11

Evaluating Quantum Amplitude Estimation for Pricing Multi-Asset Basket Options

Muhammad Kashif 12, Shaf Khalid12, Nouhaila Innan12, Alberto Marchisio12, Muhammad Shafique12 Emails: @nyu.edu

eBrain Lab, Division of Engineering, New York University Abu Dhabi, PO Box 129188, Abu Dhabi, UAE, Center for Quantum and Topological Systems, NYUAD Research, Institute, New York University Abu Dhabi, UAE

6D位姿估计

该文面向多资产篮子期权在真实市场数据下定价维度高、经典蒙特卡洛和 Black–Scholes 假设受限的问题,构建量子幅度估计与经典方法的混合对比流程,并系统考察不确定性量子比特数和资产数的影响。结果显示 QAE 在小规模设置可接近经典估计,部分配置更准确,但资源开销与硬件限制明显;增益来源可能主要来自 scaling / data,实际量子优势仍未充分说明。

A Hybrid Hinge-Beam Continuum Robot with Passive Safety Capping for Real-Time Fatigue Awareness Figure 1
arXiv preprint2025-09-11

A Hybrid Hinge-Beam Continuum Robot with Passive Safety Capping for Real-Time Fatigue Awareness

Tongshun Chen, Zezhou Sun, Yanhan Sun, Yuhao Wang, Dezhen Song, Ke Wu

6D位姿估计机器人操作

针对线驱连续体机器人长期运行中塑性变形、材料退化导致疲劳累积且难以在线监测的问题,论文提出混合铰链-梁结构,将 BendBeam 被动转轴与 TwistBeam 解耦弯曲/扭转,并用被动限位器结合电机侧扭矩在极限位姿估计刚度,无需额外传感器。实验显示,相比传统设计疲劳累积约降低49%,限位扭矩也能稳定反映结构疲劳与损伤。

Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection Figure 1
arXiv preprint2025-09-11

Plug-and-play Diffusion Models for Image Compressive Sensing with Data Consistency Projection

Xiaodong Wang, Ping Wang, Zhangyuan Li, Xin Yuan

Zhejiang University, Westlake University

6D位姿估计

针对压缩成像等病态逆问题中扩散先验生成质量高但测量一致性难保证、PnP优化一致性强但先验表达有限的问题,论文将DDIM采样拆解为去噪、数据一致性和采样三阶段,并把HQS/GAP等PnP式保真项线性混合后作用于去噪估计,以不破坏扩散轨迹的方式校正观测一致性。单像素成像实验显示重建质量优于对比方法,但更广泛任务与6D位姿关联文中未充分说明。

A Zero-Inflated Spatio-Temporal Model for Integrating Fishery-Dependent and Independent Data under Preferential Sampling Figure 1
arXiv preprint2025-09-11

A Zero-Inflated Spatio-Temporal Model for Integrating Fishery-Dependent and Independent Data under Preferential Sampling

Daniela Silva

6D位姿估计

针对渔业独立调查数据稀疏但较无偏、商业捕捞数据密集却存在偏好采样和零膨胀的问题,本文提出六层联合时空模型,分离出现概率与相对生物量,并显式建模捕捞点过程、船只可捕性及环境协变量。仿真显示多数参数估计较准确,能识别不同强度偏好信号;葡萄牙沙丁鱼案例中,融合数据提升了空间预测并揭示更清晰的高生物量热点。

Model-Agnostic Open-Set Air-to-Air Visual Object Detection for Reliable UAV Perception Figure 1
arXiv preprint2025-09-11

Model-Agnostic Open-Set Air-to-Air Visual Object Detection for Reliable UAV Perception

Spyridon Loukovitis, Anastasios Arsenos, Vasileios Karampinis, Athanasios Voulodimos

6D位姿估计航天器

面向真实空对空无人机场景中域偏移、传感器扰动和未知目标会使闭集检测失效的问题,论文提出一种适配嵌入式检测器的模型无关开集框架,用嵌入空间熵建模估计语义不确定性,并结合谱归一化、温度缩放和腐蚀感知增强来拒识未知/背景目标。在 AOT-C 与真实飞行测试中,相比 YOLO 类基线 AUROC 约由 0.80 提升到 0.88,最高约 10% 相对增益,并声称 Jetson 上可超过 20 FPS。

On the True Significance of the Hubble Tension: A Bayesian Error Decomposition Accounting for Information Loss Figure 1
Universe 2025, 11(9), 3032025-09-10

On the True Significance of the Hubble Tension: A Bayesian Error Decomposition Accounting for Information Loss

Nathalia M. N. da Rocha, Andre L. B. Ribeiro, Francisco B. S. Oliveira

6D位姿估计

针对早期宇宙与本地距离梯测得 H0 长期不一致的问题,本文提出贝叶斯层级误差分解框架,将观测张力拆为测量误差、参数空间投影导致的信息损失和真实物理张力,并用 Fisher 矩阵与 MCMC 估计损失系数。结果显示约 78% 方差来自真实张力,信息损失约 9%,6.39σ 分歧中真实部分约 5.64σ,指向 ΛCDM 之外新物理的可能性。

iMatcher: Improve matching in point cloud registration via local-to-global geometric consistency learning Figure 1
Pattern Recognition2025-09-10

iMatcher: Improve matching in point cloud registration via local-to-global geometric consistency learning

Karim Slimani, Catherine Achard, Brahim Tamadazte

Centre National de la Recherche Scientifique

6D位姿估计点云

点云配准在遮挡、噪声和低重叠下依赖高内点率匹配,传统最近邻或仅特征相似的软分配易产生几何不一致。iMatcher将局部图卷积初始化匹配矩阵、SVD预对齐后的双向重定位匹配与全局几何一致性概率学习串联为可微框架,以区分内点/外点。实验覆盖KITTI、KITTI-360、3DMatch、TUD-L等,内点率在多场景达到SOTA,如KITTI 95%–97%、3DMatch最高81.1%,但极低重叠下注册召回增益可能趋于饱和。

An U-Net-Based Deep Neural Network for Cloud Shadow and Sun-Glint Correction of Unmanned Aerial System (UAS) Imagery Figure 1
arXiv preprint2025-09-10

An U-Net-Based Deep Neural Network for Cloud Shadow and Sun-Glint Correction of Unmanned Aerial System (UAS) Imagery

Yibin Wang, Wondimagegn Beshah, Padmanava Dash, Haifeng Wang

Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, MS, USA, Department of Geosciences, Mississippi State University, Mississippi State, MS, USA

6D位姿估计航天器

针对无人机多光谱水域影像在云下飞行时易受云影、太阳耀斑干扰,影响水质参数反演的问题,论文将遮挡/耀斑区域与清晰区域构造成像素级配对样本,用 U-Net 进行五波段图像恢复,并比较损失函数与评价指标。实验显示模型可对池塘区域进行可视化校正并筛出较优配置,但文中定量增益和跨场景泛化仍未充分说明。

PianoVAM: A Multimodal Piano Performance Dataset Figure 1
arXiv preprint2025-09-10

PianoVAM: A Multimodal Piano Performance Dataset

Yonghyun Kim, Junhyung Park, Joonhyung Bae, Kirak Kim, Taegyun Kwon, Alexander Lerch, Juhan Nam

6D位姿估计数据集/基准

针对钢琴转录在真实练习场景中受音色、混响和噪声影响且缺少手部/指法信息的问题,PianoVAM构建了同步顶视视频、音频、MIDI、手部关键点、指法伪标签和元数据的多模态数据集,并设计半自动指法标注与跨模态对齐流程。论文给出音频与音视钢琴转录基准,显示数据可支持更细粒度研究,但具体增益幅度和来源文中未充分说明。

Error Analysis of Krylov Subspace approximation Based on IDR( $s$ ) Method for Matrix Function Bilinear Forms Figure 1
arXiv preprint2025-09-24

Error Analysis of Krylov Subspace approximation Based on IDR( $s$ ) Method for Matrix Function Bilinear Forms

Qianqian Xue, Xiaoqiang Yue, Xian-Ming Gu : 4

6D位姿估计

面向大规模稀疏矩阵中 uᵀf(A)v 这类双线性矩阵函数计算,论文针对 Arnoldi 正交化成本和存储随迭代增长的问题,引入 IDR(s) 生成的 Hessenberg 分解构造 Krylov 近似,并推导误差展开,将首项作为后验误差估计与停止准则。数值实验显示该估计对指数、三角等光滑函数较可靠,相比 Arnoldi 具备更低资源开销;但其与 6D 位姿估计关联不明显。

Deep Visual Odometry for Stereo Event Cameras Figure 1
IEEE Robotics and Automation Letters2025-09-10

Deep Visual Odometry for Stereo Event Cameras

Sheng Zhong, Junkai Niu, Yi Zhou

Centre for Artificial Intelligence and Robotics

6D位姿估计相机位姿事件相机多视角

针对事件相机VO在低光HDR、快速运动下依赖手工关联不稳,以及单目DEVO存在尺度不确定和离线运行的问题,本文提出Stereo-DEVO:用双目事件相机建立高效静态立体关联进行稀疏深度估计,并纳入紧耦合BA,结合递归网络的事件光流/patch关联获得公制位姿。实验覆盖多个公开与自采数据集,显示其在VGA事件流上可实时运行,精度优于多种事件VO方法,并能在大尺度夜间HDR场景保持稳定估计。

Online Dynamic SLAM with Incremental Smoothing and Mapping Figure 1
IEEE Robotics and Automation Letters2025-09-10

Online Dynamic SLAM with Incremental Smoothing and Mapping

Jesse Morris, Yiduo Wang, Viorela Ila

Australian Centre for Robotic Vision

6D位姿估计相机位姿

面向动态场景中机器人需在线同时估计相机位姿、静态地图与运动物体的问题,本文指出现有 Dynamic SLAM 虽准但依赖高开销批优化。其核心是将增量平滑首次引入动态 SLAM,并提出融合 object-centric 与 world-centric 的 Hybrid 因子图及降低相机—物体连接的并行架构,以增强稀疏性。多数据集结果显示,相机位姿和物体运动精度达到或优于现有方法,同时相对基线约 5× 加速。

Contributions to Robust and Efficient Methods for Analysis of High Dimensional Data Figure 1
arXiv preprint2025-09-09

Contributions to Robust and Efficient Methods for Analysis of High Dimensional Data

PAGE 1, Kai Yang

Department of Epidemiology, Biostatistics and Occupational Health, McGill University

6D位姿估计

面向生物影像和遗传等“特征数远大于样本数”的高维数据分析难题,本文提出三类统计计算方法:用基于互信息与FFT核密度估计的变量筛选捕捉非线性关联,设计非凸惩罚稀疏估计的加速优化算法,并以qGaussian线性混合模型增强异常值鲁棒性。实验包括仿真与ABIDE神经影像案例,显示方法可提升变量识别、计算效率和相关观测建模稳健性;与6D位姿估计的直接关系文中未充分说明。

SVN-ICP: Uncertainty Estimation of ICP-based LiDAR Odometry using Stein Variational Newton Figure 1
arXiv preprint2025-10-12

SVN-ICP: Uncertainty Estimation of ICP-based LiDAR Odometry using Stein Variational Newton

Shiping Ma, Haoming Zhang, Marc Toussaint

6D位姿估计相机位姿点云

针对传统 ICP 激光里程计只给点估计、在退化几何或噪声环境中难以为多传感器融合提供可靠协方差的问题,SVN-ICP 将位姿放在 SE(3) 流形上,用粒子近似后验并以 Stein Variational Newton 引入二阶信息,避免手工噪声建模并改善收敛。作者将其接入误差状态 Kalman 滤波与 IMU 融合,在多数据集退化场景中相较强基线取得更好里程计精度,且不确定性可随 LiDAR 退化变化。

One View, Many Worlds: Single-Image to 3D Object Meets Generative Domain Randomization for One-Shot 6D Pose Estimation Figure 1
arXiv preprint2025-09-09

One View, Many Worlds: Single-Image to 3D Object Meets Generative Domain Randomization for One-Shot 6D Pose Estimation

Zheng Geng, Nan Wang, Shaocong Xu, Chongjie Ye, Bohan Li, Zhaoxi Chen, Sida Peng, Hao Zhao : 2, 3 ^ Beijing Academy of Artificial Intelligence, BAAI, FNii, Ningbo zhenggeng@bit.edu.cn ∗ ^ zhaohao@air.tsinghua.edu.cn

Beijing Academy of Artificial Intelligence, BAAI, Zhejiang University, Institute for AI Industry Research (AIR), Tsinghua University, Nanyang Technological University, FNii, The Chinese University of Hongkong, Shenzhen, Shanghai Jiao Tong University, Eastern Institute of Technology, Ningbo

6D位姿估计

面向机器人在长尾未知物体上缺少 CAD、单视图重建无真实尺度且合成到真实存在域差的问题,OnePoseViaGen 将单图生成纹理 3D 模型用于一阶段参考建模,并通过多视角特征匹配加 render-and-compare 粗到细联合校准尺度与位姿,再用文本引导的生成式域随机化扩充纹理来微调估计器。其在 YCBInEOAT、Toyota-Light、LM-O 等基准上超过既有方法,并展示了真实灵巧手抓取验证。

Convergence analysis for the Barrett-Garcke-Nurnberg method of transport type Figure 1
arXiv preprint2025-09-09

Convergence analysis for the Barrett-Garcke-Nurnberg method of transport type

Genming Bai, Harald Garcke, Shravan Veerapaneni

6D位姿估计

该文面向由给定背景速度场驱动的闭曲线演化,解决运输主导情形缺乏全离散收敛证明的问题。作者构造运输型 BGN 参数有限元格式,引入基于投影误差的离散能量估计与稳定化切向项,利用正交结构获得额外稳定性。主要结果是在 L2 范数下证明次优收敛,并声称这是一般流驱动曲线全离散方法的首个收敛证明;与 6D 位姿估计关联不明显。

MVAT: Multi-View Aware Teacher for Weakly Supervised 3D Object Detection Figure 1
arXiv preprint2025-09-09

MVAT: Multi-View Aware Teacher for Weakly Supervised 3D Object Detection

Saad Lahlali, Alexandre Fournier Montgieux, Nicolas Granger, Hervé Le Borgne, Quoc Cuong Pham Université Paris-Saclay, CEA, List, F-91120, Palaiseau, France firstname.lastname@cea.fr

6D位姿估计多视角

MVAT针对仅用2D框弱监督训练3D检测时的投影歧义和单视角遮挡问题,利用自动驾驶序列中的时序多视角信息聚合目标点云,并通过Teacher-Student蒸馏与多视角2D投影损失生成更可靠伪3D标签。实验显示其在nuScenes弱监督设置达到47.6 mAP、49.1 NDS,较ALPI提升5.8 mAP,并在Waymo上接近全监督性能。

Parse Graph-Based Visual-Language Interaction for Human Pose Estimation Figure 1
arXiv preprint2025-09-09

Parse Graph-Based Visual-Language Interaction for Human Pose Estimation

Shibang Liu, Xuemei Xie, Guangming Shi

6D位姿估计人体姿态

针对遮挡场景中全局视觉-语言融合会削弱局部响应、导致关节对齐和定位失败的问题,论文提出PGVL:将视觉与语言特征分别构造成解析图,低层保留局部细节,高层提供全局语义,并用Guided Module让高语义节点指导跨注意后的低层更新。方法在主流人体姿态数据集上验证有效,并尝试迁移到动物姿态估计,但具体增益幅度文中未充分说明。

Design of Input-Output Observers for a Population of Systems with Bounded Frequency-Domain Variation using $DK$ -iteration Figure 1
arXiv preprint2025-09-08

Design of Input-Output Observers for a Population of Systems with Bounded Frequency-Domain Variation using $DK$ -iteration

Timothy Everett Adams, James Richard Forbes

Department of Mechanical Engineering, McGill University, Sherbrooke St. W, Scholar with the Department of Mechanical Engineering, McGill University

6D位姿估计

面向批量机器人/机电系统因制造差异或刚度变化导致观测器逐台整定成本高、统一模型又缺少性能保证的问题,论文将群体动力学差异建模为频域有界不确定性,并用DK迭代为输入输出观测器合成一个可复用的鲁棒校正滤波器,再与各设备辨识模型配对。柔性关节机械臂实验显示,该单滤波器方案在不同关节刚度下的状态估计精度接近逐配置定制增益方法。

H ${2}$ OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers Figure 1
arXiv preprint2025-09-08

H ${2}$ OT: Hierarchical Hourglass Tokenizer for Efficient Video Pose Transformers

Wenhao Li, Mengyuan Liu, Hong Liu, Pichao Wang, Shijian Lu, Nicu Sebe

6D位姿估计

视频姿态 Transformer 依赖长序列建模但自注意力开销高,难以部署。H2OT 的核心洞察是深层无需保留全帧 pose token:先用分层 TPM 逐步保留代表帧,再由 TRM 恢复全时序输出,形成可插拔“剪枝—恢复”结构。其在 MHFormer、MixSTE、MotionBERT、MotionAGFormer 等 VPT 上验证,可在基本保持甚至提升 3D 姿态精度的同时显著降低计算与推理成本。

From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humans Figure 1
arXiv preprint2025-09-08

From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humans

Marilyn Keller, Keenon Werling, Soyong Shin, Scott Delp, Sergi Pujades, C. Karen Liu, Michael J. Black

Max Planck Institute for Intelligent Systems, Stanford University, Stanford, Carnegie Mellon University, Inria centre at the University Grenoble Alpes

6D位姿估计医学/手术

针对SMPL等视觉人体模型关节位置与真实解剖结构不一致、难以用于生物力学分析的问题,论文提出SKEL:用生物力学骨架重新绑定SMPL,并构建BioAMASS伪真值数据学习从网格到关节/骨旋转的映射。结果显示其关节位置更接近生物力学估计,骨骼更好嵌入体表,还可将既有人体姿态数据升级为含生物力学参数的数据。

Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster Figure 1
arXiv preprint2025-09-08

Musculoskeletal simulation of limb movement biomechanics in Drosophila melanogaster

Pembe Gizem Özdil, Chuanfang Ning, Jasper S. Phelps, Sibo Wang-Chen, Guy Elisha, Alexander Blanke, Auke Ijspeert, Pavan Ramdya

EPFL, Switzerland, University of Bonn, Germany

6D位姿估计

针对果蝇已有神经连接组和行为姿态数据难以直接解释肌肉如何驱动关节运动的问题,论文构建了首个基于解剖影像的3D果蝇腿肌骨模型,并同时落地到OpenSim与MuJoCo,采用Hill型肌肉和参数优化连接形态数据与动力学仿真。结果显示,模型可用真实3D姿态回放行走和梳理行为,预测任务相关的肌肉协同;MuJoCo模仿学习实验还表明关节阻尼与刚度能提升学习速度和稳定性。

IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs Figure 1
arXiv preprint2025-10-09

IPR: Intelligent Prompt Routing with User-Controlled Quality-Cost Trade-offs

Aosong Feng, Balasubramaniam Srinivasan : 1, Yun Zhou : 1, Zhichao Xu : 1, Kang Zhou, Sheng Guan, Yueyan Chen, Xian Wu, Ninad Kulkarni, Yi Zhang, Zhengyuan Shen, Dmitriy Bespalov, Soumya Smruti Mishra, Yifei Teng, Darren Yow-Bang Wang, Haibo Ding, Lin Lee Cheong AWS AI @amazon.com

Dmitriy Bespalov

6D位姿估计

面对多模型云平台中强模型成本高、手工选型或固定规则难以匹配请求复杂度的问题,IPR将提示路由建模为质量约束下的成本最小化:用1.5M带奖励分数的提示训练轻量质量估计器,并通过用户容忍度τ动态设定每个请求的质量阈值,结合冻结编码器与模型适配器提升扩展性。生产部署中在保持Claude最强模型质量相当的同时降低43.9%成本,但质量监督仍依赖奖励模型,专门领域泛化文中未充分说明。

DVLO4D: Deep Visual-Lidar Odometry with Sparse Spatial-temporal Fusion Figure 1
ICRA 20252025-09-07

DVLO4D: Deep Visual-Lidar Odometry with Sparse Spatial-temporal Fusion

Mengmeng Liu, Michael Ying Yang, Jiuming Liu, Yunpeng Zhang, Jiangtao Li, Sander Oude Elberink, George Vosselman, Hao Cheng

University of Twente, The Netherlands, University of Bath, UK, Shanghai Jiao Tong University, China, PhiGent Robotics, China

6D位姿估计相机位姿点云

DVLO4D针对视觉-LiDAR里程计中传感器错位、跨配置融合低效及长期序列尺度漂移问题,采用以稀疏LiDAR点为查询的跨模态融合,并通过特征/位姿记忆库进行时序交互更新;训练上用Temporal Clip与Collective Average Loss做多帧轨迹约束。在KITTI和Argoverse上达到SOTA精度与鲁棒性,推理约82 ms,具备实时部署潜力。

Motion Aware ViT-based Framework for Monocular 6-DoF Spacecraft Pose Estimation Figure 1
arXiv preprint2025-09-07

Motion Aware ViT-based Framework for Monocular 6-DoF Spacecraft Pose Estimation

Jose Sosa, Dan Pineau, Arunkumar Rathinam, Abdelrahman Shabayek, Djamila Aouada

Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, Luxembourg

6D位姿估计航天器

针对航天器单目6D位姿估计常逐帧处理、忽略轨道序列中运动线索的问题,本文将人体姿态中的 motion-aware heatmap 思路迁移到航天器场景,用 ViT 提取图像特征,并融合预训练光流模型的时序运动信息来定位2D关键点,再经 PnP 求解位姿。在 SPADES-RGB 上优于单帧基线,并在 SPARK-2024 合成与真实子集上测试了跨域泛化;真实域仍有性能下降,说明域差异仍是主要限制。

S-LAM3D: Segmentation-Guided Monocular 3D Object Detection via Feature Space Fusion Figure 1
arXiv preprint2025-09-07

S-LAM3D: Segmentation-Guided Monocular 3D Object Detection via Feature Space Fusion

Diana-Alexandra Sas, Florin Oniga

Technical University of Cluj-Napoca, Computer Science Department

6D位姿估计

针对单目3D检测缺乏深度线索、仅靠RGB特征对小目标不稳定的问题,S-LAM3D用Grounded SAM预生成分割先验,并以解耦方式在特征空间中注入,不新增检测分支;实验比较了融合位置与策略,发现DLA后逐元素乘法更有效。在KITTI验证集上,相比LAM3D主要提升行人和骑行者等小目标检测,车类收益较有限。

Multi-LVI-SAM: A Robust LiDAR-Visual-Inertial Odometry for Multiple Fisheye Cameras Figure 1
arXiv preprint2025-09-06

Multi-LVI-SAM: A Robust LiDAR-Visual-Inertial Odometry for Multiple Fisheye Cameras

Xinyu Zhang, Kai Huang, Junqiao Zhao, Zihan Yuan, Tiantian Feng

6D位姿估计相机位姿点云

针对单目 LVIO 视场窄、快速运动或弱纹理下易丢失特征,而纯多相机又缺乏 LiDAR/IMU 互补的问题,Multi-LVI-SAM 将多鱼眼相机特征统一到全景球面模型,并通过外参补偿修正相机中心与全景中心不一致导致的三角化误差,再在因子图中紧耦合视觉、LiDAR 与 IMU。公开数据集实验显示其多相机约束更一致,位姿精度和鲁棒性优于已有多相机 LVIO。

MonoGlass3D: Monocular 3D Glass Detection with Plane Regression and Adaptive Feature Fusion Figure 1
arXiv preprint2025-09-06

MonoGlass3D: Monocular 3D Glass Detection with Plane Regression and Adaptive Feature Fusion

Kai Zhang, Guoyang Zhao, Jianxing Shi, Bonan Liu, Weiqing Qi, Jun Ma, Senior Member, IEEE

6D位姿估计

玻璃在RGB、深度相机和激光雷达中常因透明与反射而难以被机器人可靠定位,现有数据也缺少真实复杂场景。MonoGlass3D构建带2D/3D标注的真实玻璃数据集,将单目深度估计改写为玻璃平面参数回归,并用基于centerness的自适应特征融合捕获上下文。实验显示其在玻璃分割和单目玻璃深度估计上优于已有方法。

Interpretable dimension reduction for compositional data Figure 1
arXiv preprint2025-09-06

Interpretable dimension reduction for compositional data

Junyoung Park, Cheolwoo Park, Jeongyoun Ahn

6D位姿估计

本文并非6D位姿估计工作,而是针对微生物组等高维组成数据中单纯形约束、零值多、log-ratio变换难解释且需补零的问题,提出CDR框架:用列随机矩阵将组成直接软聚合到低维单纯形,并结合充分降维定义中心组成子空间与CKDR估计。结果显示该方法可在三元图中同时可视化样本嵌入和变量贡献,估计具一致性与稀疏性,在真实微生物组数据上能揭示可解释的生物模式。

Cryo-EM as a Stochastic Inverse Problem Figure 1
arXiv preprint2025-09-05

Cryo-EM as a Stochastic Inverse Problem

Diego Sanchez Espinosa, Erik Henning Thiede, Yunan Yang

Center for Applied Mathematics, Cornell University, Ithaca, NY (), Department of Chemistry, Cornell University, Ithaca, NY (), Department of Mathematics, Cornell University, Ithaca, NY ()

6D位姿估计

针对冷冻电镜中分子构象连续异质性难以由离散分类重建的问题,论文将重建表述为概率测度上的随机逆问题:用随机前向算子把结构分布推送到图像分布,并以 KL/MMD 等分布差异经 Wasserstein 梯度流和粒子法优化。合成实验和真实感蛋白模型显示其可恢复连续结构状态分布,同时给出与 MAP/DTO 方法的联系及一致性条件。

Room Temperature Single Photon Detection at 1550 nm using van der Waals Heterojunction Figure 1
Advanced Functional Materials2025-09-05

Room Temperature Single Photon Detection at 1550 nm using van der Waals Heterojunction

Nithin Abraham, Kenji Watanabe, Takashi Taniguchi, Kausik Majumdar

Indian Institute of Science Bangalore, National Institute for Materials Science

6D位姿估计

面向量子通信等场景中1550 nm单光子探测对室温、低暗计数方案的需求,本文用黑磷低带隙吸收层耦合WSe2/MoS2范德华异质结FET,将光生电子转移并俘获为可读出的单电子电阻涨落。器件在室温实现21.4%总体量子效率(偏振光估计42.8%)和约720 Hz最低暗计数。

WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool Figure 1
arXiv preprint2025-09-05

WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool

Zizun Li, Jianjun Zhou, Yifan Wang, Haoyu Guo, Wenzheng Chang Yang Zhou, Haoyi Zhu, Junyi Chen, Chunhua Shen, Technology of China, Shanghai AI Lab, SII

University of Science and Technology of China Shanghai AI Lab SII Zhejiang University

6D位姿估计三维重建

WinT3R针对在线三维重建中全局注意力太慢、纯流式状态记忆又导致相邻帧交互不足的问题,采用重叠滑动窗口让局部图像 token 充分交换信息,并用紧凑相机 token 池作为轻量全局记忆辅助位姿估计。实验显示其在多数据集上同时提升点图质量、相机位姿精度与速度,可超过17 FPS实现在线重建。

Plug-and-Play Latent Diffusion for Electromagnetic Inverse Scattering with Application to Brain Imaging Figure 1
arXiv preprint2025-09-05

Plug-and-Play Latent Diffusion for Electromagnetic Inverse Scattering with Application to Brain Imaging

Rui Guo, Yi Zhang, Yhonatan Kvich, Tianyao Huang, Maokun Li, Yonina C. Eldar

Engineering, University of Science and Technology Beijing, Beijing

6D位姿估计

针对电磁脑卒中成像中逆散射问题非线性强、病态且传统先验过于简单的问题,本文将未配对介电常数/电导率图训练的潜在扩散先验接入物理前向模型,通过PnP后验采样交替约束似然与先验,并用MMSE汇总样本。脑成像实验显示其在重建精度、结构相似度和测量保真度上优于对比方法,但与6D位姿任务关联不明显。

UAV-Based Intelligent Traffic Surveillance System: Real-Time Vehicle Detection, Classification, Tracking, and Behavioral Analysis Figure 1
arXiv preprint2025-09-04

UAV-Based Intelligent Traffic Surveillance System: Real-Time Vehicle Detection, Classification, Tracking, and Behavioral Analysis

Ali Khanpour, Tianyi Wang, Afra Vahidi-Shams, Wim Ectors, Farzam Nakhaie, Amirhossein Taheri, Christian Claudel

Wim Ectors is with the Transportation Research Institute (IMOB), UHasselt-Hasselt University, Agoralaan, Diepenbeek 3590, Belgium

6D位姿估计航天器

针对固定摄像头和地感设备覆盖有限、部署维护成本高的问题,本文构建了基于无人机航拍的实时交通监控系统,将多尺度/多角度模板匹配、卡尔曼跟踪、单应性标定与地理围栏、轨迹偏差分析结合,用于车辆检测分类、速度估计和违章识别。在约200米城市航拍案例中,检测精度91.8%、F1为90.5%,MOTA/MOTP达92.1%/93.7%,但拥挤遮挡和相似车型仍会带来召回与分类误差。

Stitching the Story: Creating Panoramic Incident Summaries from Body-Worn Footage Figure 1
arXiv preprint2025-09-04

Stitching the Story: Creating Panoramic Incident Summaries from Body-Worn Footage

PAGE 1, Dor Cohen

Academic College of Engineering, School Of Computer Science, Holon Institute of Technology

6D位姿估计

面向执法、消防等第一响应场景中随身摄像头视频过长、难以及时复盘的问题,论文提出用单目 SLAM 估计 6DoF 相机轨迹并重建稀疏空间布局,再以 Dominant Set 对关键帧位姿聚类,最后用 OpenPano 多帧拼接生成分区域全景摘要。实验展示该流程可从多段视频得到较紧凑、空间连贯的事故现场全景图,便于快速理解环境;但评价主要偏定性,量化指标和相对基线增益文中未充分说明。

Odometry Calibration and Pose Estimation of a 4WIS4WID Mobile Wall Climbing Robot Figure 1
arXiv preprint2025-09-04

Odometry Calibration and Pose Estimation of a 4WIS4WID Mobile Wall Climbing Robot

Branimir Ćaran, Vladimir Milić, Marko Švaco, Bojan Jerbić

Faculty of Mechanical Engineering and Naval Arhitecture, University of Zagreb, Zagreb, 10000, Croatia

6D位姿估计相机位姿机器人操作

面向建筑外立面作业中 GPS、激光等定位手段易失效的问题,论文为4WIS4WID壁面攀爬机器人建立轮式里程计校准与位姿估计流程:用非线性优化、LM、遗传算法和粒子群标定运动学参数,并融合轮速、RealSense视觉里程计与IMU构建EKF/UKF估计器。实验平台与OptiTrack真值对比表明,校准和多传感器融合可降低里程计漂移、提升位姿估计稳定性,但摘要未给出明确量化增益。

Robust MIMO Semantic Communication with Imperfect CSI via Knowledge Distillation Figure 1
IEEE Transactions on Vehicular Technology2025-09-04

Robust MIMO Semantic Communication with Imperfect CSI via Knowledge Distillation

Mingze Gong, Shuoyao Wang, Shijian Gao, Jia Yan, Suzhi Bi

Shenzhen University

6D位姿估计

针对MIMO语义图像传输依赖完美CSI、在实际信道估计误差下性能下降的问题,论文提出HANA-JSCC,在信道编解码中加入信道矩阵适配器,并用完美CSI教师模型进行两阶段知识蒸馏,以缓解估计矩阵到真实矩阵的一对多病态映射。多数据集和不同SNR、估计误差下,平均PSNR较代表性方法提升0.40–0.54 dB。

ContraGS: Codebook-Condensed and Trainable Gaussian Splatting for Fast, Memory-Efficient Reconstruction Figure 1
arXiv preprint2025-09-03

ContraGS: Codebook-Condensed and Trainable Gaussian Splatting for Fast, Memory-Efficient Reconstruction

Sankeerth Durvasula 1 ^, Sharanshangar Muhunthan, Zain Moustafa, Richard Chen, Ruofan Liang Yushi Guan, Nilesh Ahuja, Nilesh Jain, Selvakumar Panneer, Intel @cs.toronto.edu @mail.utoronto.ca @intel.com

University of Toronto Intel

6D位姿估计三维重建高斯泼溅

ContraGS针对高斯数量增大导致3DGS训练/渲染显存和带宽开销过高的问题,提出在训练过程中直接使用码本压缩表示,并将不可微的高斯到码本索引学习转化为贝叶斯推断,用Metropolis-Hastings/MCMC通过拆分、合并和参数更新探索压缩状态空间。在约200万高斯设置下,平均训练峰值显存降低3.49倍,训练加速1.36倍,渲染FPS提升1.88倍,同时保持接近现有方法的重建质量。

Parameter Tuning Under Uncertain Road Perception in Driver Assistance Systems Figure 1
arXiv preprint2025-09-03

Parameter Tuning Under Uncertain Road Perception in Driver Assistance Systems

Leon Greiser, Christian Rathgeber, Vladislav Nenchev, Sören Hohmann

BMW Group, Unterschleissheim, Germany (e-mail, University of the Bundeswehr Munich, Werner-Heisenberg-Weg 39, Neubiberg, Germany (e-mail, Institute of Control Systems, Karlsruhe Institute of Technology, Karlsruhe, Germany (e-mail

6D位姿估计

针对车道保持中感知车道线含噪、MPC横向轨迹规划权重依赖人工调参的问题,论文在不改变现有规划器结构的前提下,将代价权重调优表述为规划器无关的双层优化,并用记录数据重仿真来隐式利用噪声特性而不假设噪声分布。实验基于真实驾驶数据,显示优化参数在未见测试数据上降低代价、改善横向行为,但具体收益幅度和场景覆盖范围文中未充分说明。

A Comprehensive Review of Multi-Agent Reinforcement Learning in Video Games Figure 1
arXiv preprint2025-09-03

A Comprehensive Review of Multi-Agent Reinforcement Learning in Video Games

Zhengyang Li, Qijin Ji, Xinghong Ling, Quan Liu

6D位姿估计

面对现代联网游戏中多智能体协作、对抗和替补人类玩家的需求,本文系统梳理MARL从双人回合制到FPS、RTS、MOBA等实时游戏的应用脉络。核心洞察是将自博弈、监督学习与深度强化学习的成功案例和非平稳、部分可观测、稀疏奖励、扩展性等难题统一比较,并提出估计游戏复杂度的方法。主要结果是归纳了AlphaStar、OpenAI Five、王者荣耀等实现路径与未来方向;因属综述,具体性能增益来源不清。

Predicting Antimicrobial Resistance (AMR) in Campylobacter, a Foodborne Pathogen, and Cost Burden Analysis Using Machine Learning Figure 1
arXiv preprint2025-09-03

Predicting Antimicrobial Resistance (AMR) in Campylobacter, a Foodborne Pathogen, and Cost Burden Analysis Using Machine Learning

Shubham Mishra, The Anh Han

School of Computing, Engineering and Digital Technologies, \orgname, Teesside University, \orgaddress, School of Health and Life Sciences, \orgname, National Horizons Centre, \orgname

6D位姿估计

针对弯曲杆菌耐药性增加带来的公共卫生与经济负担,论文将英国2001–2017年6683株分离株的WGS、流行病学元数据与成本预测结合,用随机森林识别gyrA、tet(O)、blaOXA等关键耐药特征,并用SARIMA、SIR和Prophet外推至2050年。模型耐药表型预测准确率约74%,预测病例率可能超过130/10万人、年经济负担超19亿英镑;但该工作与仓库“6D位姿估计”分类明显不符。

SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data Figure 1
arXiv preprint2025-09-03

SmartPoser: Arm Pose Estimation with a Smartphone and Smartwatch Using UWB and IMU Data

Nathan DeVrio, Vimal Mollyn, Chris Harrison

Carnegie Mellon University

6D位姿估计

SmartPoser面向健身、康复、AR输入等需要移动式手臂追踪的场景,避免摄像头隐私问题和多传感器穿戴负担。其核心是仅用现成手机与手表,将UWB提供的绝对距离约束与IMU姿态、加速度融合,以缓解惯性漂移并支持用户移动。10人室内实验中,在无需个人训练数据的情况下,腕部和肘部位置中位误差为11.0厘米。

Count2Density: Crowd Density Estimation without Location-level Annotations Figure 1
Pattern Recognition2025-09-03

Count2Density: Crowd Density Estimation without Location-level Annotations

Mattia Litrico, Feng Chen, Michael Pound, Sotirios A Tsaftaris, Sebastiano Battiato, Mario Valerio Giuffrida

6D位姿估计

这篇论文针对人群密度估计依赖逐人点标注、难以规模化的问题,提出 Count2Density:仅用图像总人数监督,通过历史密度图库与 EMA 迭代生成伪密度图,并用超几何采样和自监督对比空间正则恢复拥挤区域的空间结构。实验显示其在多个数据集上明显优于跨域适应方法,并在半监督设置中超过近期方法,还能支持子区域计数;但历史图库存储与训练开销是主要限制。

Towards Realistic Hand-Object Interaction with Gravity-Field Based Diffusion Bridge Figure 1
arXiv preprint2025-09-03

Towards Realistic Hand-Object Interaction with Gravity-Field Based Diffusion Bridge

Miao Xu, Xiangyu Zhu, Xusheng Liang, Zidu Wang, Jinlin Wu, Chinese Academy of Sciences, China Centre for Artificial Intelligence, Robotics, China China Mobile Financial Technology Co, Ltd, China, ZKTeco Co, China School of Computer Science, Engineering, M.U.S.T, Macau, China @ia.ac.cn @cair-cas.org.hk gaolids@chinamobile.com, richard.chen@zkteco.com

Institute of Automation, Chinese Academy of Sciences, China, Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science, Hong Kong SAR, School of Artificial Intelligence, University of Chinese Academy of Sciences, China

6D位姿估计手部姿态

针对现有手-物体位姿/重建虽能给出粗交互但常出现网格穿插、接触空隙且难表达手部表面形变的问题,本文将接触建模为引力吸引过程,提出 GravityDB:以物体表面为零势能流形,在 SDE 扩散桥中加入多尺度引力场、MANO 结构约束,并用 LLM 从文本推断语义接触区域。多数据集实验显示其可减少穿插和抓取空隙,生成更稳定且符合语义的手部形变。

IL-SLAM: Intelligent Line-assisted SLAM Based on Feature Awareness for Dynamic Environments Figure 1
arXiv preprint2025-09-03

IL-SLAM: Intelligent Line-assisted SLAM Based on Feature Awareness for Dynamic Environments

Haolan Zhang, Thanh Nguyen Canh, Chenghao Li, Ruidong Yang, Yonghoon Ji, Nak Young Chong

6D位姿估计相机位姿

IL-SLAM针对动态物体剔除后点特征不足、而持续引入线/面特征又带来额外计算和噪声累积的问题,提出特征感知机制:按剩余点特征数量与分布判断是否启用线特征,仅在跟踪、局部建图和回环中辅助初始位姿,并避免进入全局优化。TUM RGB-D实验显示其相较ORB-SLAM3及多种动态/多特征SLAM在ATE、RPE上整体更优,5个序列中4个ATE最佳。

Robotic 3D Flower Pose Estimation for Small-Scale Urban Farms Figure 1
arXiv preprint2025-09-02

Robotic 3D Flower Pose Estimation for Small-Scale Urban Farms

Harsh Muriki, Hong Ray Teo, Ved Sengupta, Ai-Ping Hu

Georgia Institute of Technology, Atlanta, GA USA, Cornell University, Ithaca, NY USA, Georgia Tech Research Institute, Atlanta, GA USA

6D位姿估计机器人操作

面向城市小农场中机器人授粉对花朵精确位姿的需求,论文基于改装 FarmBot 自动采集草莓植株点云,提出沿六个正交视角平移占据栅格,将3D点云转为可用2D检测器处理的图像,再回映射提取花朵点云并拟合超椭球、抛物面和平面估计姿态。该方法在实验中找回约80%的扫描花朵,平均姿态误差7.7°,基本满足授粉操作精度。

Improving Hardware Requirements for Fault-Tolerant Quantum Computing by Optimizing Error Budget Distributions Figure 1
arXiv preprint2025-09-02

Improving Hardware Requirements for Fault-Tolerant Quantum Computing by Optimizing Error Budget Distributions

Tobias V. Forster1, Nils Quetschlich1, Mathias Soeken2, Robert Wille134

Chair for Design Automation, Technical University of Munich, Germany, Microsoft Quantum, Switzerland, Software Competence Center Hagenberg GmbH (SCCH), Austria

6D位姿估计

针对容错量子计算中纠错带来巨大量子比特与运行时间开销的问题,论文指出总误差预算不应默认均匀分配,而应按电路各部分“容错代价”差异进行优化;其通过随机采样资源估计构建数据集,并训练监督模型为任意电路预测误差预算分布。实验在383个量子电路上相较均匀分配使超过75%的样本降低估计时空成本,平均降幅15.6%,最高77.7%。

Towards High-Fidelity, Identity-Preserving Real-Time Makeup Transfer: Decoupling Style Generation Figure 1
arXiv preprint2025-09-04

Towards High-Fidelity, Identity-Preserving Real-Time Makeup Transfer: Decoupling Style Generation

Lydia Kin Ching Chau, Zhi Yu, Ruowei Jiang

Peace Research Institute Frankfurt

6D位姿估计

针对实时虚拟试妆中半透明彩妆易与肤色、身份特征混淆,导致跨肤色迁移失真和视频闪烁的问题,论文将“彩妆提取”和“图形渲染应用”解耦,用渲染管线与 k-means 生成透明遮罩伪真值,并加入 alpha 加权重建与唇色损失。实验显示该方法在细节保真、身份保持和时序稳定性上优于既有基线,但极端姿态和不透明特效妆仍受限。

Extrapolated Markov Chain Oversampling Method for Imbalanced Text Classification Figure 1
arXiv preprint2025-09-02

Extrapolated Markov Chain Oversampling Method for Imbalanced Text Classification

Systems Analysis pauliina.ilmonen(at)aalto.fi

Aalto University, School of Science, Department of Mathematics and Systems Analysis

6D位姿估计

该文关注不平衡文本分类中少数类样本少、词表随样本增长而扩张的问题。核心做法是用外推 Markov 链生成少数类文本,并在转移概率中引入部分多数类信息,使过采样不局限于少数类已有特征空间。多组真实数据与 ROS、SMOTE、ADASYN、DRO、DECOM、EDA 等比较显示,EMCO 在严重不平衡场景下表现更有竞争力;但其与 6D 位姿估计标签不匹配。

Dual Target-Mounted RISs-Assisted ISAC Against Eavesdropping and Malicious Interference Figure 1
arXiv preprint2025-09-02

Dual Target-Mounted RISs-Assisted ISAC Against Eavesdropping and Malicious Interference

Zehra Yigit, Sefa Kayraklik, Ertugrul Basar, Ali Gorcin

6D位姿估计

面向6G ISAC中无人机目标既窃听又借恶意RIS干扰的安全问题,论文提出双目标挂载RIS框架:合法无人机RIS辅助用户通信,敌对无人机RIS作为最坏情况威胁,并用SDR两阶段联合优化基站波束与合法RIS相位以最大化保密速率。仿真显示该方法在多种配置下提升用户保密速率,同时改善感知SINR与AoD估计CRB;但结果主要为仿真验证,与仓库“6D位姿估计”关联不强。

Generalizing Unsupervised Lidar Odometry Model from Normal to Snowy Weather Conditions Figure 1
arXiv preprint2025-09-02

Generalizing Unsupervised Lidar Odometry Model from Normal to Snowy Weather Conditions

Beibei Zhou, Zhiyuan Zhang, Zhenbo Song, Jianhui Guo, Hui Kong

Beibei Zhou is with Shanghai Polytechnic University, Shanghai, China (e-mail, Zhiyuan Zhang is with Singapore Management University, Singapore (e-mail

6D位姿估计相机位姿点云

针对激光里程计在雪天受雪花噪声和离群点干扰、由晴天训练难以泛化的问题,论文提出无监督端到端模型:用PSM按局部patch空间离散度削弱稀疏噪声,再用PPWP结合强度阈值、距离与多模态特征为点分配权重。模型仅在晴天训练,在KITTI、Ford和WADS等清晰、雪天及动态场景中提升位姿精度与鲁棒性。

Rate of convergence of the vanishing viscosity method for Hamilton-Jacobi equations with Neumann boundary conditions Figure 1
arXiv preprint2025-09-02

Rate of convergence of the vanishing viscosity method for Hamilton-Jacobi equations with Neumann boundary conditions

Alessandro Goffi

6D位姿估计

本文关注带 Neumann 边界的时变 Hamilton-Jacobi 方程中消失粘性近似的定量收敛,动机是理解小噪声极限在边界与区域几何影响下的误差速度。核心洞察是结合对偶方法与 Fokker-Planck 方程的 L1 收缩/Harnack 估计处理无界凸域;主要证明一般局部 Lipschitz Hamiltonian 下 L∞ 误差为 O(√ε),二次 Hamiltonian 且半超调和时可提升到单侧 O(ε) 与 O(ε^β)。

Adaptive AI Model Partitioning over 5G Networks Figure 1
arXiv preprint2025-09-02

Adaptive AI Model Partitioning over 5G Networks

Tam Thanh Nguyen, Tuan Van Ngo, Long Thanh Le, Yong Hao Pua, Mao Van Ngo, Binbin Chen, Tony Q. S. Quek

6D位姿估计

这篇论文关注移动端运行视觉/AI模型时,本地推理耗电、全量上云又带来隐私和时延的问题;其核心是在5G信道波动、干扰甚至干扰攻击下,用AI频谱感知和吞吐量预测动态选择DNN切分点,而非固定端边划分。基于NVIDIA Aerial 5G测试床,方法在兼顾隐私与终端能耗的同时,端到端时延相对基线最高降低约65%;但与6D位姿估计的直接关系文中未充分说明。

Doctoral Thesis: Geometric Deep Learning For Camera Pose Prediction, Registration, Depth Estimation, and 3D Reconstruction Figure 1
arXiv preprint2025-09-02

Doctoral Thesis: Geometric Deep Learning For Camera Pose Prediction, Registration, Depth Estimation, and 3D Reconstruction

Xueyang Kang

6D位姿估计相机位姿彩色深度三维重建

针对3D数据高维、标注稀缺以及传统SfM/SLAM在非结构场景和细节重建中不稳的问题,该博士论文将深度、法线、SE(3)等变性等几何先验嵌入学习框架,分别用于无人机相机姿态跟踪、surfel点云配准、焦栈深度估计和SDF三维重建。实验显示四类方法在公开数据集上均优于对应SOTA,尤其提升低内点率配准、任意长度焦栈和细粒度表面恢复的鲁棒性。

Cohort-Anchored Robust Inference for Event-Study with Staggered Adoption Figure 1
arXiv preprint2025-09-28

Cohort-Anchored Robust Inference for Event-Study with Staggered Adoption

PAGE 1, Ziyi Liu

(UC Berkeley)

6D位姿估计事件相机

本文关注分期采纳事件研究中传统稳健推断因跨 cohort 聚合、处理组构成动态变化及控制组随时间收缩而产生的偏误。作者提出在 cohort-period 层面进行推断,并用固定初始控制组定义“block bias”,使处理前趋势与处理后平行趋势违背可比较。模拟和最低工资再分析显示,在 cohort 预趋势异质时,该方法的置信集更居中且有时更窄;其适用性依赖多 cohort 与足够组内精度。

Articulated Object Estimation in the Wild Figure 1
arXiv preprint2025-09-01

Articulated Object Estimation in the Wild

Abdelrhman Werby, Martin Büchner, Adrian Röfer, Chenguang Huang, Wolfram Burgard

University of Freiburg University of Stuttgart University of Technology Nuremberg

6D位姿估计

针对现有关节物体估计多依赖固定视角、孤立物体和完整观测,难以用于真实机器人场景的问题,论文提出 ArtiPoint:从自我中心 RGB-D 人类交互视频中检测交互片段,结合任意点深度跟踪、相机运动补偿与因子图优化,估计移动部件轨迹、关节轴及平移/转动类型。同时发布含 45 段序列、414 次交互和真值位姿/关节标注的 Arti4D 数据集;实验显示其在该基准上优于经典与学习式基线。

From Discord to Harmony: Decomposed Consonance-based Training for Improved Audio Chord Estimation Figure 1
26th International Society for Music Information Retrieval Conference (ISMIR 2025), September 21-25, Daejeon, Korea2025-09-01

From Discord to Harmony: Decomposed Consonance-based Training for Improved Audio Chord Estimation

Andrea Poltronieri, Xavier Serra, Martín Rocamora

6D位姿估计

针对音频和弦估计中标注主观性与类别长尾导致性能停滞的问题,论文先分析多标注者分歧,指出许多“错误”其实仍具和声相近性;据此提出协和度加权的距离指标,并在 Conformer 中加入基于协和度的标签平滑,同时分解预测根音、低音和音高激活以缓解词表不平衡。实验显示该方法优于现有 ACE 基线,尤其在非二值和协和度相关指标上更明显。

ViSTA-SLAM: Visual SLAM with Symmetric Two-view Association Figure 1
arXiv preprint2025-09-01

ViSTA-SLAM: Visual SLAM with Symmetric Two-view Association

Ganlin Zhang 1, Shenhan Qian 1, Xi Wang 1, Daniel Cremers 1, 2 ^ 1 ^ TU Munich, 2 ^ MCML, 3 ^ ETH Zurich

{}^{1~} TU Munich 2 {}^{2~} MCML 3 {}^{3~} ETH Zurich

6D位姿估计相机位姿

针对单目稠密SLAM依赖相机内参、现有3D基础模型前端不对称且易漂移的问题,ViSTA-SLAM用轻量对称两视图关联网络从两张RGB图同时估计相对位姿与各自局部点图,并结合带回环的Sim(3)位姿图抑制累计误差。其前端仅为VGGT约35%,在7-Scenes和TUM-RGBD上实现更好的相机轨迹估计与稠密三维重建。

Aleatoric Uncertainty from AI-based 6D Object Pose Predictors for Object-relative State Estimation Figure 1
IEEE Robotics and Automation Letters2025-09-01

Aleatoric Uncertainty from AI-based 6D Object Pose Predictors for Object-relative State Estimation

Thomas Jantos, Stephan Weiss, Jan Steinbrener

University of Klagenfurt

6D位姿估计物体位姿

针对6D物体位姿网络输出缺少可信测量噪声、导致EKF需人工调协方差的问题,本文在冻结预训练位姿预测器的基础上,为平移和旋转分支接入轻量MLP来估计完整6D偶然不确定性,并将其作为动态测量协方差用于物体相对状态估计。合成与真实实验表明,相比固定协方差,该方法提升估计精度,并支持基于不确定性的参考物体切换和异常值剔除。

Enhancing Uncertainty Estimation in LLMs with Expectation of Aggregated Internal Belief Figure 1
the AAAI Conference on Artificial Intelligence 20262025-09-01

Enhancing Uncertainty Estimation in LLMs with Expectation of Aggregated Internal Belief

Zeguan Xiao, Diyang Dou : 1, Boya Xiong : 1, Yun Chen, Guanhua Chen : 2

6D位姿估计

针对经 RLHF 的大语言模型常给出过度自信但错误答案、导致不确定性估计不可靠的问题,本文提出 EAGLE:在自评时不只读取最终置信分数,而是抽取多层隐藏状态对应的“内部信念”,投影为候选置信度分布并取期望。实验在多个数据集和模型上显示其校准与失败预测优于现有自评基线,但与 6D 位姿估计标签关联不明显。

FGO-SLAM: Enhancing Gaussian SLAM with Globally Consistent Opacity Radiance Field Figure 1
arXiv preprint2025-09-01

FGO-SLAM: Enhancing Gaussian SLAM with Globally Consistent Opacity Radiance Field

Fan Zhu, Yifan Zhao, Ziyu Chen, Biao Yu, Hui Zhu

Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei, China

6D位姿估计相机位姿高斯泼溅

针对传统稠密 SLAM 重建粗糙、现有 Gaussian SLAM 位姿优化不足且难以提取几何表面的问题,FGO-SLAM 将特征式 VO 的全局调整与基于 3D Gaussian 的全局一致不透明度辐射场结合,并加入深度畸变、法向一致性约束,通过四面体网格和等值面直接抽取 mesh。实验在真实与大规模合成数据上显示其跟踪精度和建图质量达到 SOTA。

A James-Stein Estimator based Generalized OMP Algorithm for Robust Signal Recovery using Sparse Representation Figure 1
arXiv preprint2025-09-01

A James-Stein Estimator based Generalized OMP Algorithm for Robust Signal Recovery using Sparse Representation

Debraj Banerjee, Amitava Chatterjee

Indian Institute of Science, Jadavpur University, Amitava Chatterjee

6D位姿估计

本文关注噪声字典/测量下稀疏表示中 OMP、gOMP 易选入错误原子、恢复信号失去稀疏性的问题;核心做法是在 gOMP 的多原子贪婪选择框架中引入 James-Stein 估计器进行收缩去噪,以平衡恢复与抑噪。MATLAB 仿真显示,在高斯噪声下 JS-gOMP 的临界稀疏度、重构误差和信噪比优于 OMP/gOMP;但与6D位姿估计的直接关系文中未充分说明。

End-to-End Low-Level Neural Control of an Industrial-Grade 6D Magnetic Levitation System Figure 1
arXiv preprint2025-09-01

End-to-End Low-Level Neural Control of an Industrial-Grade 6D Magnetic Levitation System

Philipp Hartmann, Jannick Stranghöner, Klaus Neumann

6D位姿估计

针对工业级6D磁悬浮底层控制高度不稳定、依赖专家建模且调参周期长的问题,论文提出首个端到端神经控制器,用专有控制器交互数据进行行为克隆,直接由原始传感器和目标6D位姿输出线圈电流,并配套硬实时推理库。真实系统实验显示其能跟踪未见轨迹、适应载荷和位姿范围外情形;残差校正可缓解协变量偏移,部分场景精度超过专有控制器。

Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation Figure 1
arXiv preprint2025-09-01

Learning Correlation-aware Aleatoric Uncertainty for 3D Hand Pose Estimation

Lee Chae-Yeon, Nam Hyeon-Woo, Tae-Hyun Oh

6D位姿估计手部姿态

面向遮挡、自相似和运动模糊导致的3D手部姿态不确定性,本文不只回归关节位置,而是在现有模型上加入可插拔不确定性头;核心是把手部关节输出建模为概率分布,并用单线性层在对角协方差与全协方差之间高效刻画关节相关性。FreiHAND和HO3Dv2实验显示,其不确定性估计优于既有建模方式,同时保持有竞争力的姿态估计精度。

SR-SLAM: Scene-reliability Based RGB-D SLAM in Diverse Environments Figure 1
Robotics and Autonomous Systems2025-09-01

SR-SLAM: Scene-reliability Based RGB-D SLAM in Diverse Environments

Haolan Zhang, Chenghao Li, Thanh Nguyen Canh, Lijun Wang, Nak Young Chong

Japan Advanced Institute of Science and Technology, Hanyang University, Anyang University

6D位姿估计相机位姿点云彩色深度

针对动态、低纹理或遮挡环境中特征数量与质量波动导致 RGB-D SLAM 位姿不稳的问题,SR-SLAM以“场景可靠性”作为统一调度信号,结合检测置信度、特征与深度质量及历史信息,自适应选择动态区域约束、用深度辅助DBSCAN剔除动态特征,并在低可靠场景融合直接法进行位姿细化,同时改进关键帧选择和加权优化。公开数据集与真实场景实验显示其相较动态SLAM基线最高带来约90%的精度与鲁棒性提升。

An End-to-End Framework for Video Multi-Person Pose Estimation Figure 1
arXiv preprint2025-09-01

An End-to-End Framework for Video Multi-Person Pose Estimation

Technology of China weizh588@mail.ustc.edu.cn

University of Science and Technology of China

6D位姿估计

针对视频多人姿态估计中两阶段方法割裂检测与时序建模、依赖 RoI/NMS 导致密集场景低效的问题,VEPE 将视频姿态实例建模为端到端序列预测,引入 STPE、STDME、STPD 三个时空 Transformer 模块,并用实例一致性机制缓解跨帧 query 匹配错误。PoseTrack 实验显示其精度超过多数两阶段方法,推理效率提升约 300%。

A Hybrid APIM-CFGM Model for Longitudinal Non-Exchangeable Dyads: Demonstrating and Comparing Estimation Approaches Using Multilevel Modeling Figure 1
arXiv preprint2025-08-31

A Hybrid APIM-CFGM Model for Longitudinal Non-Exchangeable Dyads: Demonstrating and Comparing Estimation Approaches Using Multilevel Modeling

Liu

College of Education, University of Washington

6D位姿估计

面向导师—学生等角色可区分的纵向二元数据,论文关注小样本下同时刻画个体影响与共享轨迹的建模难题。作者将 APIM 与 CFGM 融合为可在 R/lme4、brms 中估计的两层 MLM,比较角色编码、样本量与 ML/贝叶斯估计。模拟结果显示,编码不改拟合但改变参数解释;5 对样本估计不稳,贝叶斯区间更能反映不确定性,较大样本下两者趋同。

Response Matrix Estimation in Unfolding Differential Cross Sections Figure 1
Journal of Instrumentation2025-08-31

Response Matrix Estimation in Unfolding Differential Cross Sections

Huanbiao Zhu, Andrea Carlo Marini, Mikael Kuusela, Larry Wasserman

6D位姿估计

针对粒子物理展开中响应矩阵通常只能由有限蒙特卡洛样本估计、直方图计数易产生噪声的问题,本文提出先在未分箱空间做响应核的条件密度估计,再积分成响应矩阵。仿真显示该方法在多数设置下比传统直方图估计更平滑、效率更高,展开结果通常更好或不差;同时发现直方图噪声在无正则展开中可能意外起到隐式正则化作用。

UPGS: Unified Pose-aware Gaussian Splatting for Dynamic Scene Deblurring Figure 1
arXiv preprint2025-09-03

UPGS: Unified Pose-aware Gaussian Splatting for Dynamic Scene Deblurring

Zhijing Wu, Longguang Wang

6D位姿估计三维重建高斯泼溅

UPGS针对单目动态场景重建中运动模糊会破坏COLMAP位姿、进而累积到3DGS优化的问题,将相机与物体运动统一表示为作用在高斯基元上的可学习SE(3)仿射变换,并采用“先场景、再位姿、后联合”的三阶段训练稳定耦合优化。在Stereo Blur与BARD-GS上,相比动态去模糊基线获得更高PSNR、更低LPIPS,并提升位姿估计精度,边缘和快速运动区域改善最明显。

DyPho-SLAM : Real-time Photorealistic SLAM in Dynamic Environments Figure 1
arXiv preprint2025-08-31

DyPho-SLAM : Real-time Photorealistic SLAM in Dynamic Environments

Yi Liu, Keyu Fan, Bin Lan, Houde Liu

Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China, Jianghuai Advance Technology Center, Hefei, China

6D位姿估计相机位姿

DyPho-SLAM针对动态物体导致的相机跟踪漂移和3DGS稠密建图模糊问题,利用历史帧先验构建更稳定的动态掩码,并在剔除动态区域后通过自适应特征点选择补足优化约束,再将掩码与特征点融入显式高斯泼溅建图。公开动态RGB-D数据集实验显示,其在相机位姿估计和照片级稠密重建上达到SOTA并保持实时运行。

MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimation Figure 1
arXiv preprint2025-08-31

MV-SSM: Multi-View State Space Modeling for 3D Human Pose Estimation

Aviral Chharia, Wenbo Gou, haoye@nus.edu.sg

Carnegie Mellon University National University of Singapore

6D位姿估计人体姿态多视角

针对多视角3D人体姿态在遮挡、多人与新相机布局下易过拟合的问题,MV-SSM将状态空间模型引入多视角几何建模,在图像特征与人体关键点两级显式建模关节空间序列,并用PSS块结合投影注意力与GTBS扫描逐步细化三维关键点。实验显示其泛化优势明显:CMU Panoptic三相机AP25提升10.8,不同相机布局提升7.0,跨数据集Campus A1的PCP提升15.3。

Robust Resource Allocation for LEO Satellite-Assisted Secure SWIPT via STAR-RIS under CSI Uncertainty Figure 1
arXiv preprint2025-08-30

Robust Resource Allocation for LEO Satellite-Assisted Secure SWIPT via STAR-RIS under CSI Uncertainty

Zahra Rostamikafaki, Francois Chan, Claude D'Amours

6D位姿估计航天器

面向直连链路受阻、低轨卫星难以同时为地面物联网终端供能和安全通信的场景,论文把STAR-RIS引入卫星辅助SWIPT,并在有界CSI误差下构建保密速率与发射功率约束的鲁棒资源分配问题;通过S-procedure、交替优化和惩罚项联合设计卫星主动波束与RIS透反系数。仿真显示其总 harvested power 高于传统RIS和基线方案,但结论主要来自仿真,实际信道与部署开销仍需验证。

Stage-wise Adaptive Label Distribution for Facial Age Estimation Figure 1
arXiv preprint2025-08-30

Stage-wise Adaptive Label Distribution for Facial Age Estimation

Bo Wu, Zhiqi Ai, Jun Jiang, Congcong Zhu, Shugong Xu

6D位姿估计

这篇论文关注人脸年龄估计中的标签歧义:相邻年龄外观相似,但不同年龄阶段的不确定性并不一致。作者通过特征相似性分析提出阶段性歧义规律,并设计 SA-LDL,将阶段自适应方差 SAV 与阶段加权损失 SAW 结合,按年龄段建模软标签分布。实验在 MORPH-II 和 FG-NET 上分别达到 1.74、2.15 MAE,显示较强竞争力。

Generative Visual Foresight Meets Task-Agnostic Pose Estimation in Robotic Table-Top Manipulation Figure 1
arXiv preprint2025-08-30

Generative Visual Foresight Meets Task-Agnostic Pose Estimation in Robotic Table-Top Manipulation

Chuye Zhang, Xiaoxiong Zhang, Wei Pan, Linfang Zheng, Wei Zhang, Technology LimX Dynamics, zhangw3@sustech.edu.cn

Southern University of Science and Technology, The University of Hong Kong

6D位姿估计机器人操作

面向桌面操作中任务多样且示教动作标注昂贵的问题,GVF-TAPE将生成式视觉前瞻与任务无关的末端6D位姿估计解耦:先由视频模型根据单视角图像和语言任务想象未来RGB-D轨迹,再从预测帧中恢复末端位姿并闭环执行。位姿模块仅用随机探索数据训练,减少专家示教依赖;仿真和真实实验显示其在多类任务上达到实时部署,并优于或匹配若干需动作标注或自探索的基线。

Hybrid Perception and Equivariant Diffusion for Robust Multi-Node Rebar Tying Figure 1
CASE2025-08-26

Hybrid Perception and Equivariant Diffusion for Robust Multi-Node Rebar Tying

Zhitao Wang, Yirong Xiong, Roberto Horowitz, Yanke Wang, Yuxing Han

Zhitao Wang, Yirong Xiong, and Yuxing Han are with Tsinghua University, Shenzhen International Graduate School, Shenzhen, China

6D位姿估计

面向钢筋绑扎中节点拥挤、姿态估计易错且人工示教数据昂贵的问题,论文将点云几何感知与SE(3)等变扩散规划结合:用DBSCAN、正交几何特征和PCA检测并排序多节点,再以少量5–10次示教生成末端绑扎位姿。实验覆盖单层、多层和杂乱钢筋网,显示节点检测与连续绑扎成功率较高;但真实场景仍有位姿生成失败,复杂实景数据下的泛化增益仍需进一步验证。

Performance is not All You Need: Sustainability Considerations for Algorithms Figure 1
arXiv preprint2025-09-03

Performance is not All You Need: Sustainability Considerations for Algorithms

Xiang Li, Chong Zhang, Hongpeng Wang, Shreyank Narayana Gowda, Yushi Li, Xiaobo Jin

The Chinese University of Hong Kong, Xi’an Jiaotong-Liverpool University, University of Sydney, University of Nottingham

6D位姿估计

针对深度学习训练能耗和碳排常被传统精度指标忽略的问题,论文提出将性能与能耗统一量化的可持续评估框架:用 FMS 以调和平均衡量单位能耗下的表现,并用 ASC 描述性能—功耗曲线面积。作者在分类、分割、位姿估计及在线/批学习任务上验证,结果显示这些指标能揭示不同模型的性能—能效权衡,为绿色算法选择提供量化依据。

Efficient Diffusion-Based 3D Human Pose Estimation with Hierarchical Temporal Pruning Figure 1
IEEE Transactions on Circuits and Systems for Video Technology2025-08-29

Efficient Diffusion-Based 3D Human Pose Estimation with Hierarchical Temporal Pruning

Yuquan Bi, Hongsong Wang, Xinli Shi, Zhipeng Gui, Jie Gui, Yuan Yan Tang

Southeast University, Wuhan University, University of Macau

6D位姿估计人体姿态

针对扩散式3D人体姿态估计因多步去噪和多假设采样带来的高计算开销,论文提出分层时间剪枝HTP,在帧级用时序相关图选择关键帧,并以稀疏注意力和掩码引导的姿态token剪枝保留运动关键信息。Human3.6M与MPI-INF-3DHP实验显示,训练MACs降38.5%、推理MACs降56.8%、FPS平均提升81.1%,同时达到SOTA精度。

Revisiting the extremely long-period cataclysmic variables V479 Andromedae and V1082 Sagitarii Figure 1
arXiv preprint2025-09-04

Revisiting the extremely long-period cataclysmic variables V479 Andromedae and V1082 Sagitarii

Gagik Tovmassian, Diogo Belloni, Anna F. Pala, Thomas Kupfer, Weitian Yu, Boris T. Gänsicke, Elizabeth O. Waagen, Juan-Luis González-Carballo, Paula Szkody, Domitilla de Martino, Matthias R. Schreiber, Knox S. Long, Alan Bedard, Slawomir Bednarz, Jordi Berenguer, Krzysztof Bernacki, Simone Bolzoni, Carlos Botana-Albá, Christopher Cantrell, Walt Cooney, Charles Cynamon, Pablo De la Fuente Fernández, Sjoerd Dufoer, Esteban Fernández Mañanes, Faustino García-Cuesta, Rafael Gonzalez Farfán, Pierre A. Fleurant, Enrique A. Gómez, Matthew J. Green, Franz-Josef Hambsch

Elizabeth O. Waagen, Domitilla de Martino

6D位姿估计

论文针对极长轨道周期激变变星难以被现有演化模型解释的问题,重访 V479 And 与 V1082 Sgr;结合紫外/红外光谱、圆偏振、Gaia DR3 距离与 MESA/CARB 强磁制动模拟,指出两者供体均充满洛希瓣且经历热时标传质,V479 And 为 polar、V1082 Sgr 为 intermediate polar,并支持亚巨星供体系统存在更强角动量损失、可能贡献近距双白矮星族群。

Design and evaluation of a serious game in virtual reality to increase empathy towards students with phonological dyslexia Figure 1
Multimedia Systems 31, 365 (2025)2025-08-29

Design and evaluation of a serious game in virtual reality to increase empathy towards students with phonological dyslexia

Jose Manuel Alcalde-Llergo, Andrea Zingoni, Pilar Aparicio-Martinez, Sara Pinzi, Enrique Yeguas-Bolivar

University of Córdoba, Università degli Studi della Tuscia

6D位姿估计

针对音韵性读写障碍学生常因他人缺乏理解而难以获得补偿性支持的问题,论文设计了VR严肃游戏“The Magic Potion”,让非障碍者在任务中体验解码困难与辅助工具价值。101名参与者测试显示,游戏后同理心水平平均提升约20%,反馈也表明其能改变对补偿工具“是否公平”的看法;但效果长期保持与具体增益来源文中未充分说明。

PHD: Personalized 3D Human Body Fitting with Point Diffusion Figure 1
arXiv preprint2025-08-28

PHD: Personalized 3D Human Body Fitting with Point Diffusion

Hsuan-I Ho, Chen Guo, Po-Chen Wu, Ivan Shugurov, Chengcheng Tang, Abhay Mittal, Sizhe An, Manuel Kaufmann † 2 ^, Linguang Zhang † 3 ^, ETH Zürich ETH AI Center, ETH Zürich Reality Labs, Meta

Abhay Mittal, Department of Computer Science, ETH Zürich, ETH AI Center, ETH Zürich, Reality Labs, Meta

6D位姿估计

针对通用 HMR 在视频中逐帧耦合估计体型、姿态和骨盆位置、且过度依赖 2D 对齐导致 3D 精度受损的问题,PHD 先用 SHAPify 标定个人体型,再以体型条件的 PointDiT 点扩散 3D 姿态先验和 Point Distillation Sampling 引导拟合。该模块仅用合成数据训练,可接入现有估计器,并在 EMDB 上刷新骨盆对齐与绝对姿态精度。

Reverse Imaging for Wide-spectrum Generalization of Cardiac MRI Segmentation Figure 1
Lecture notes in computer science2025-08-28

Reverse Imaging for Wide-spectrum Generalization of Cardiac MRI Segmentation

Yidong Zhao, Peter Kellman, Hui Xue, Tongyun Yang, Yi Zhang, Yuchi Han, Orlando Simonetti, Qian Tao

Delft University of Technology, National Institutes of Health, National Heart Lung and Blood Institute, Microsoft (United States), The Ohio State University Wexner Medical Center

6D位姿估计

针对心脏 MRI 分割模型在 bSSFP、GRE、MOLLI 等不同序列间因对比度变化而失效的问题,论文提出 Reverse Imaging:用 MRI 物理前向模型和由 mSASHA 学到的扩散“自旋先验”,从观测图像反推 PD/T1/T2 作为可解释潜变量,再合成未见序列或做物理增强。实验显示 RI-Aug 在 MOLLI 与植入设备数据上显著提升 LV、MYO、RV Dice,实现无需目标域数据的零样本跨序列泛化。

Privacy Auditing Synthetic Data Release through Local Likelihood Attacks Figure 1
arXiv preprint2025-08-28

Privacy Auditing Synthetic Data Release through Local Likelihood Attacks

Joshua Ward, Chi-Hua Wang, Guang Cheng

University of California, Los Angeles, Purdue University

6D位姿估计仿真到现实

本文关注合成表格数据发布中的训练样本隐私泄漏,指出现有审计多依赖启发式或不现实的模型访问假设。核心是无盒成员推断攻击 Gen-LRA,用测试点对局部似然比估计的影响刻画生成模型局部过拟合,并给出密度比解释与成员/非成员均值间隔理论。实验在模拟与1525组合基准上优于多种 MIA,低误报率下优势更明显;与6D位姿关联文中未充分说明。

ROBUST-MIPS: A Combined Skeletal Pose and Instance Segmentation Dataset for Laparoscopic Surgical Instruments Figure 1
arXiv preprint2025-08-27

ROBUST-MIPS: A Combined Skeletal Pose and Instance Segmentation Dataset for Laparoscopic Surgical Instruments

Zhe Han, Charlie Budd, Gongyu Zhang, Huanyu Tian, Christos Bergeles, Tom Vercauteren

King’s College London, School of Biomedical Engineering & Imaging Sciences, London, SE1 EU, UK

6D位姿估计数据集/基准医学/手术

针对腹腔镜手术器械分割标注成本高、框标注又难表达细长可遮挡结构的问题,ROBUST-MIPS在ROBUST-MIS的10040帧真实手术图像上补充骨架关键点位姿,并清理与位姿无关的套管实例掩码,使位姿与实例分割可同场比较。作者还发布标注工具和基线模型;常用姿态估计方法在该基准上取得较高质量定位结果,但提升更多来自数据与标注形式,具体泛化增益仍需更多验证。

Multi-View 3D Point Tracking Figure 1
arXiv preprint2025-08-28

Multi-View 3D Point Tracking

Frano Rajič, Haofei Xu, Marko Mihajlovic, Siyuan Li

ETH Zürich Carnegie Mellon University Balgrist University Hospital Microsoft

6D位姿估计多视角

本文针对单目3D点跟踪易受深度歧义和遮挡影响、传统多相机方法又依赖大量相机与逐序列优化的问题,提出MVTracker:在已知相机位姿和多视角深度下,将特征融合为动态3D点云,用kNN相关与时空Transformer在线更新长程对应。模型用5K Kubric合成序列训练,在Panoptic Studio和DexYCB上分别达到3.1cm、2.0cm中位轨迹误差,并能适配1–8视角与不同深度来源。

COMETH: Convex Optimization for Multiview Estimation and Tracking of Humans Figure 1
Expert Systems with Applications2025-08-28

COMETH: Convex Optimization for Multiview Estimation and Tracking of Humans

Enrico Martini, Ho Jin Choi, Nadia Figueroa, Nicola Bombieri

University of Verona, University of Pennsylvania

6D位姿估计多视角

面向工业5.0中的人体监测与人机协作,COMETH针对集中式多相机带宽/算力开销大、边缘部署又易产生精度下降和时空不一致的问题,提出轻量级多视角人体姿态融合:用运动学与生物力学约束保证骨架合理性,以凸二次规划逆运动学做空间融合,并用状态观测器抑制抖动和漂移。在CMU Panoptic及工业场景测试中,其定位、检测和跟踪精度优于对比方法,适合实时安全关键应用。

Estimating 2D Keypoints of Surgical Tools Using Vision-Language Models with Low-Rank Adaptation Figure 1
Lecture notes in computer science2025-08-28

Estimating 2D Keypoints of Surgical Tools Using Vision-Language Models with Low-Rank Adaptation

Krit Duangprom, Tryphon Lambrou, Binod Bhattarai

University of Aberdeen

6D位姿估计医学/手术

针对手术器械关键点标注稀缺、CNN/Transformer在小规模医学数据上易过拟合的问题,论文将2D关键点估计改写为带固定提示的VQA任务,用预训练VLM生成器械名称和12个语义关键点坐标,并通过LoRA轻量适配而非全量重训。实验显示仅微调两轮即可优于基线模型,说明语义提示与低秩适配在低资源场景有效;但具体指标增益幅度在给定文本中未充分说明。

Latent Variable Modeling for Robust Causal Effect Estimation Figure 1
arXiv preprint2025-08-27

Latent Variable Modeling for Robust Causal Effect Estimation

Tetsuro Morimura, Tatsushi Oka, Yugo Suzuki, Daisuke Moriwaki

Keio University, Yokohama City University

6D位姿估计

这篇论文针对观测数据中协变量缺失、隐藏混杂导致因果效应估计偏差的问题,提出 latent DML:只在双重机器学习第二阶段引入潜变量,把表示/残差估计与潜变量推断解耦,并覆盖潜变量仅影响结果或同时影响处理与结果两种情形。实验在合成与真实数据上显示其较标准 DML 和线性基线更稳健,文中还给出一致性等理论分析。

OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations Figure 1
arXiv preprint2025-08-27

OpenM3D: Open Vocabulary Multi-view Indoor 3D Object Detection without Human Annotations

Peng-Hao Hsu, Ke Zhang : 1, Fu-En Wang, Tao Tu, Ming-Feng Li, Yu-Lun Liu, Albert Y. C. Chen, Min Sun, Amazon

National Tsing Hua University Amazon Cornell University, Carnegie Mellon University National Yang Ming Chiao Tung University

6D位姿估计未知物体多视角

针对开放词汇3D检测多依赖点云和人工标注、难以用于低成本机器人感知的问题,OpenM3D从多视角RGB构建体素特征,利用SAM分割与图嵌入聚类生成3D伪框,并用多视角CLIP特征进行体素语义对齐,实现无人工标注的单阶段检测。实验显示其伪框质量优于OV-3DET/SAM3D,在ScanNet200和ARKitScenes上精度与召回领先,推理仅需RGB且约0.3秒/场景。

Unconditional Uniqueness of 5th Order KP Equations Figure 1
arXiv preprint2025-08-27

Unconditional Uniqueness of 5th Order KP Equations

James Patterson

University of Birmingham

6D位姿估计

本文动机是将五阶 KP-I/KP-II 方程的解映射唯一性从依赖 Bourgain 类辅助空间推进到完整的连续各向异性 Sobolev 空间。核心做法是在 Guo–Molinet 能量估计框架中结合短时 X^{s,b} 方法,并针对时间边界处的损失,用对称性与多线性插值引入 L^4 Strichartz 估计获得额外导数增益。主要结果证明两类五阶 KP 方程在 C_T H^{s,0}、任意 s>0 中无条件唯一,几乎达到 L^2 临界门槛。

Hierarchical Bayesian model updating using Dirichlet process mixtures for structural damage localization Figure 1
Mechanical Systems and Signal Processing2025-08-27

Hierarchical Bayesian model updating using Dirichlet process mixtures for structural damage localization

Taro Yaoyama, Tatsuya Itoi, Jun Iyama

6D位姿估计

针对传统层次贝叶斯有限元模型更新难以刻画结构在服役中出现的多损伤状态、多峰参数分布问题,论文将狄利克雷过程混合先验引入结构参数空间,并用 Metropolis-within-Gibbs 联合推断损伤状态聚类与刚度后验。数值与钢框架实验显示,推断簇基本对应完好到中重度损伤状态,刚度估计与真值或梁端裂纹位置一致,且较非层次基线显著降低不确定性。

Inferring geometry and material properties from Mueller matrices with machine learning Figure 1
arXiv preprint2025-08-27

Inferring geometry and material properties from Mueller matrices with machine learning

Lars Doorenbos, C. H. Lucas Patty, Raphael Sznitman, Pablo Márquez-Neila

University of Bern, Bern, Switzerland, University of Bonn, Bonn, Germany

6D位姿估计

这篇工作针对 Mueller 矩阵同时反演表面几何与材料属性的病态性,检验其是否可由数据驱动模型直接解码。作者用多波长、25种各向同性球体的完整偏振矩阵训练随机森林,分别估计法线和分类材料;结果显示未知材料上仍可一定程度恢复法线并重建形状,材料识别也有效,且对角项更关联材料、非对角项更影响法线估计。

Autonomous Aerial Manipulation at Arbitrary Pose in SE(3) with Robust Control and Whole-body Planning Figure 1
The International Journal of Robotics Research2025-08-27

Autonomous Aerial Manipulation at Arbitrary Pose in SE(3) with Robust Control and Whole-body Planning

Dongjae Lee, Byeongjun Kim, and H. Jin Kim

Seoul National University

6D位姿估计人体姿态机器人操作航天器

针对传统多旋翼空中操作受欠驱动限制、难以在大滚俯仰姿态下稳定作业的问题,本文面向全向空中机械臂提出几何鲁棒控制与两阶段全身轨迹优化框架,在SE(3)上同时规划浮动基座位姿和机械臂关节并处理避障/自碰撞。实验显示其可在近90°甚至180°俯仰姿态下完成抓取与拉拽,规划频率超过10 Hz。

WEBEYETRACK: Scalable Eye-Tracking for the Browser via On-Device Few-Shot Personalization Figure 1
arXiv preprint2025-08-27

WEBEYETRACK: Scalable Eye-Tracking for the Browser via On-Device Few-Shot Personalization

Eduardo Davalos, Yike Zhang, Namrata Srivastava, Yashvitha Thatigotla, Jorge A. Salas, Sara McFadden, Sun-Joo Cho, Amanda Goodwin, Ashwin TS, Gautam Biswas

6D位姿估计

针对高精度凝视估计难以在浏览器和消费设备上实时、隐私友好部署,WebEyeTrack将轻量BlazeGaze CNN与基于3D人脸重建/径向Procrustes的头姿估计结合,并用不超过9个样本做端侧少样本个性化校准。系统还集成眨眼抑制、点击流持续校准和注视点检测;在GazeCapture上达到2.32 cm误差,iPhone 14推理约2.4 ms。

2D Ultrasound Elasticity Imaging of Abdominal Aortic Aneurysms Using Deep Neural Networks Figure 1
arXiv preprint2025-08-25

2D Ultrasound Elasticity Imaging of Abdominal Aortic Aneurysms Using Deep Neural Networks

Utsav Ratna Tuladhar, Richard Simon, Doran Mix, Michael Richards Email: @rit.edu, doran.mix@urmc.rochester.edu

Rochester Institute of Technology, Rochester, NY, USA, University of Rochester Medical Center, Rochester, NY, USA

6D位姿估计

针对腹主动脉瘤仅用最大直径难以反映破裂风险的问题,论文将2D超声位移场到血管壁弹性模量分布的反问题交给U-Net学习,训练数据主要来自有限元仿真。方法在COMSOL数字体模、实体体模和临床超声上验证,仿真NMSE约0.73%,体模模量比接近期望,并较传统迭代重建显著降低计算开销;但临床定量收益仍需进一步说明。

Safe Navigation under State Uncertainty: Online Adaptation for Robust Control Barrier Functions Figure 1
IEEE Robotics and Automation Letters2025-08-26

Safe Navigation under State Uncertainty: Online Adaptation for Robust Control Barrier Functions

Ersin Daş, Rahal Nanayakkara, Xiao Tan, Ryan M. Bena, Joel W. Burdick, Paulo Tabuada, Aaron D. Ames

California Institute of Technology, University of California, Los Angeles

6D位姿估计

这篇论文针对机器人依赖 VIO 等不准确状态估计时,传统鲁棒控制屏障函数因固定保守参数导致不可行或控制代价过高的问题,提出基于局部扰动采样的在线参数优化来自适应调节 R-CBF,并用泊松安全函数把多障碍约束合并为单一数值 CBF,同时处理履带车独轮车模型的双相对阶。仿真和硬件实验显示,该方法在多障碍导航中相较既有 R-CBF 提升了可行性与控制性能。

Can we make NeRF-based visual localization privacy-preserving? Figure 1
arXiv preprint2025-08-26

Can we make NeRF-based visual localization privacy-preserving?

Maxime Pietrantoni

6D位姿估计相机位姿三维重建

面向云端视觉定位中 NeRF 场景表示可能泄露纹理、文档等隐私细节的问题,论文先提出基于反演攻击和视觉语言模型的隐私评估协议,指出即使移除颜色头,RGB 光度训练仍会在几何表示中保留细粒度信息;随后提出 ppNeSF,用自监督层次分割监督替代 RGB 监督,通过分割图对齐进行位姿细化。实验显示其隐私保护优于既有方法,定位精度达到或接近非隐私 NeRF 方法的水平。

GSVisLoc: Generalizable Visual Localization for Gaussian Splatting Scene Representations Figure 1
arXiv preprint2025-08-25

GSVisLoc: Generalizable Visual Localization for Gaussian Splatting Scene Representations

Fadi Khatib, Dror Moran, Guy Trostianetsky, Yoni Kasten, Meirav Galun

Weizmann Institute of Science, NVIDIA

6D位姿估计相机位姿三维重建高斯泼溅

针对3DGS已能高质量重建但相机定位仍常需初值、重训练或参考图像的问题,GSVisLoc直接把原始3D高斯下采样编码为场景特征,并与查询图像块做粗到细3D-2D匹配,再接PnP与3DGS位姿细化。实验显示其在室内外基准上优于既有3DGS定位方法,在7-Scenes上接近主流最佳方法,且可泛化到未见场景;户外效果仍受3DGS重建质量限制。

PriorFormer: A Transformer for Real-time Monocular 3D Human Pose Estimation with Versatile Geometric Priors Figure 1
arXiv preprint2025-08-21

PriorFormer: A Transformer for Real-time Monocular 3D Human Pose Estimation with Versatile Geometric Priors

Mohamed Adjel, Vincent Bonnet

Centre National de la Recherche Scientifique

6D位姿估计人体姿态

面向人机交互、运动分析等对边端实时性的需求,本文针对单目2D到3D人体姿态提升中深度歧义和标定依赖问题,提出小型Transformer lifter,将短时2D关节序列与可选的相机内参、骨段长度先验结合,并用随机掩码适配先验缺失场景。模型在AMASS合成投影上训练评估,MPJPE最低约36mm,少于0.6M参数,GPU/CPU推理约380/1800µs;但真实视频噪声与遮挡验证仍未充分说明。

SAIL-Recon: Large SfM by Augmenting Scene Regression with Localization Figure 1
arXiv preprint2025-08-25

SAIL-Recon: Large SfM by Augmenting Scene Regression with Localization

Junyuan Deng, Heng Li : 1, Tao Xie, Weiqiang Ren, Qian Zhang Ping Tan, Xiaoyang Guo : 2, Technology, Horizon Robotics

The Hong Kong University of Science and Technology Horizon Robotics Zhejiang University

6D位姿估计

针对 VGGT 等场景回归式 SfM 难以处理大量图像、显存随视图数快速增长且分段方案易漂移的问题,SAIL-Recon 将视觉定位并入前馈 Transformer:先由少量 anchor 图像生成全局神经场景表示,再让其余图像在该隐式地图条件下回归位姿与场景坐标。实验显示其可在数分钟内重建上千张图像,并在 TUM-RGBD、CO3Dv2、Tanks & Temples 的位姿估计和新视角合成上达到或超过传统与学习式基线。

Camera Pose Refinement via 3D Gaussian Splatting Figure 1
arXiv preprint2025-08-25

Camera Pose Refinement via 3D Gaussian Splatting

Lulu Hao, Lipu Zhou, Zhenzhong Wei, Xu Wang

6D位姿估计相机位姿三维重建高斯泼溅

针对现有相机位姿细化依赖特定2D-3D描述子、场景专用网络或仅用特征相似度而缺少几何约束的问题,本文提出GS-SMC:直接利用已有3DGS模型渲染参考/扰动视图,通过查询图与多渲染图的2D-2D匹配和对极几何迭代优化位姿,且可替换特征与匹配器、无需额外训练。在7-Scenes和Cambridge上,相比SOTA中位平移/旋转误差分别降低53.3%/56.9%和40.7%/53.2%。

DroneKey: Drone 3D Pose Estimation in Image Sequences using Gated Key-representation and Pose-adaptive Learning Figure 1
IROS 20252025-08-25

DroneKey: Drone 3D Pose Estimation in Image Sequences using Gated Key-representation and Pose-adaptive Learning

Seo-Bin Hwang, Yeong-Jun Cho

Department of AI Convergence, Chonnam National University, Korea

6D位姿估计

DroneKey面向反无人机中单目估计无人机3D位姿的需求,针对螺旋桨关键点外观相似、姿态变化大导致顺序和位置难判的问题,设计基于Transformer的关键点检测与PnP位姿管线,通过多层中间/紧凑表示的门控融合和姿态自适应Mahalanobis损失提升极端姿态稳定性;在自建并公开数据集上关键点AP达99.68%,44 FPS,3D位姿误差为10.62°、0.221m RMSE。

IDU: Incremental Dynamic Update of Existing 3D Virtual Environments with New Imagery Data Figure 1
arXiv preprint2025-08-25

IDU: Incremental Dynamic Update of Existing 3D Virtual Environments with New Imagery Data

PAGE 1, 2025 Interservice/Industry Training, Simulation, Education Conference (I/ITSEC

USC Institute for Creative Technologies, Colorado School of Mines

6D位姿估计

面向军事仿真中既有3DGS/三维场景因新增障碍物等局部变化而快速过时、全量重建成本高的问题,IDU提出用少量新图像增量更新虚拟环境:先估计相机位姿对齐旧模型,再做变化检测,并结合3D生成模型与人工校正逐个生成和放置新物体。作者在STTC和Geronimo两处数据上验证,视觉结果显示可减少更新时间、人工和计算开销;但定量指标与自动化收益边界文中未充分说明。

No Pixel Left Behind: A Detail-Preserving Architecture for Robust High-Resolution AI-Generated Image Detection Figure 1
arXiv preprint2025-08-24

No Pixel Left Behind: A Detail-Preserving Architecture for Robust High-Resolution AI-Generated Image Detection

Lianrui Mu, Zou Xingze, Jianhong Bai, Jiaqi Hu, Wenjie Zheng, Jiangnan Ye, Jiedong Zhuang, Mudassar Ali, Jing Wang, Haoji Hu

6D位姿估计

针对高分辨率 AI 生成图检测中缩放/裁剪会抹除高频伪迹或遗漏区域的问题,论文提出 HiDA-Net:以全覆盖原分辨率 tiles 保留细节,并用 FAM 融合局部与全局特征,辅以 TFL 定位局部伪造、QFE 解耦 JPEG 压缩噪声;同时发布 HiRes-50K。实验在 Chameleon 和 HiRes-50K 上分别带来约 13% 和 10% 准确率提升,但代价是大图 tile 推理更慢。

Literature Review of the Effect of Quantum Computing on Cryptocurrencies using Blockchain Technology Figure 1
Journal of Informatics Education and Research ISSN:1526-4726 Vol 5 Issue 2 (2025)2025-08-24

Literature Review of the Effect of Quantum Computing on Cryptocurrencies using Blockchain Technology

Adi Mutha, Jitendra Sandu

12th Standard Student, Dr. Kalmadi Shamarao Junior College

6D位姿估计

这篇论文并非6D位姿估计工作,而是面向区块链加密货币在量子计算发展下的安全风险综述。作者从46篇文献归纳Shor算法对公钥签名、Grover算法对哈希与共识的威胁,并对比PQC、QKD、协议升级等防护思路;主要结论是当前量子硬件尚不足以立即攻破主流币,但迁移到后量子密码标准需要提前规划。

PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotation Figure 1
arXiv preprint2025-08-26

PersPose: 3D Human Pose Estimation with Perspective Encoding and Perspective Rotation

Technology, China @mail.sustech.edu.cn

Southern University of Science and, Technology, China

6D位姿估计人体姿态

PersPose针对单目3D人体姿态中常见的“只看裁剪图”问题,指出缺少裁剪后相机内参会使关节相对深度不可辨,且人物偏离图像中心会加剧透视畸变。方法用Perspective Encoding将裁剪内参编码成2D特征图,并用Perspective Rotation把人物旋到中心以稳定透视关系。其在3DPW、MPI-INF-3DHP和Human3.6M上达到SOTA,3DPW MPJPE为60.1mm,较前方法低7.54%。

Source-Condition Analysis of Kernel Adversarial Estimators Figure 1
arXiv preprint2025-08-24

Source-Condition Analysis of Kernel Adversarial Estimators

Antonio Olivas-Martinez, Andrea Rotnitzky

Department of Biostatistics, University of Washington

6D位姿估计

本文针对条件矩约束下 nuisance 函数估计的病态逆问题,分析基于 RKHS 正则的对抗稳定估计器 KRAS。核心在于用可解释的源条件替代抽象病态度量,并允许解不唯一;主要结果给出弱误差与 RMSE 的有限样本界,同时比较 KRAS、L2 正则 RAS 与 KMMR 的假设、稳定性和收敛权衡。

M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environments Figure 1
arXiv preprint2025-08-23

M3DMap: Object-aware Multimodal 3D Mapping for Dynamic Environments

Technology, Moscow, Russia AIRI, Russia yudin.da@mipt.ru

Moscow Institute of Physics and Technology, Moscow, Russia

6D位姿估计

针对动态环境中图像、点云、文本难以统一到可更新3D地图的问题,M3DMap一方面梳理多模态3D建图分类,另一方面提出对象感知的模块化框架,串联多模态分割跟踪、可学习里程计、地图构建更新与检索。论文报告这些模块在3D grounding、机器人/车辆任务中带来性能提升,并给出多模态有益的理论论证,但具体增益幅度与实时性仍文中未充分说明。

DualReg: Dual-Space Filtering and Reinforcement for Rigid Registration Figure 1
arXiv preprint2025-08-23

DualReg: Dual-Space Filtering and Reinforcement for Rigid Registration

Jiayi Li, Yuxin Yao : 1, Qiuhang Lu, Technology of China, yuxinyao@cityu.edu.hk, luqiuhang2021@ia.ac.cn, juyong@ustc.edu.cn

University of Science and Technology of China, City University of Hong Kong, University of Chinese Academy of Sciences

6D位姿估计

DualReg面向噪声、低重叠点云中刚体配准既要全局鲁棒又要实时的矛盾,核心洞察是把特征空间的粗匹配与几何空间的局部精配联合优化:先用轻量1点RANSAC和概率引导3点RANSAC过滤外点,再以高置信匹配构造几何代理并迭代求解位姿。在KITTI上相对MAC保持相近精度,同时CPU时间加速约32倍。

Fiducial Marker Splatting for High-Fidelity Robotics Simulations Figure 1
arXiv preprint2025-08-23

Fiducial Marker Splatting for High-Fidelity Robotics Simulations

Diram Tabaa, Gianni Di Caro

Carnegie Mellon University

6D位姿估计机器人操作

面向温室等遮挡密集、重复结构多的机器人仿真场景,传统网格难兼顾真实感与建模成本,而 Gaussian Splatting 又不便直接加入用于定位的 AprilTag 等标记。论文提出用高斯基元显式生成 fiducial marker 的混合框架,无需逐场景图像拟合即可嵌入 GS 场景。实验显示该方法在生成效率、标记可识别性和位姿估计精度上优于传统拟合方案,并以温室定位仿真验证了可用性。

Estimating volumetric water content from electrical resistivity using a random forest model Figure 1
arXiv preprint2025-08-08

Estimating volumetric water content from electrical resistivity using a random forest model

PAGE 1

Department of Physics and Astronomy, Heidelberg University, submitted by, Center in Svalbard (UNIS)

6D位姿估计

本文面向滑坡风险监测中体积含水量依赖侵入式局部传感器的问题,尝试用电阻率/ERT结合随机森林进行非侵入式估计与短期预测,并引入降水、气温及随深度变化的滞后以刻画入渗过程。结果显示气象变量可使MAE降低7.3%–73.0%,深度滞后将MRE压到2.8%以下,24小时预测各深度MRE低于5%;但单地点训练模型跨地点泛化较差,应用仍需多地点自动化校准。

HAMSt3R: Human-Aware Multi-view Stereo 3D Reconstruction Figure 1
arXiv preprint2025-08-22

HAMSt3R: Human-Aware Multi-view Stereo 3D Reconstruction

Sara Rojas, Matthieu Armando, Bernard Ghanem Philippe Weinzaepfel, Vincent Leroy, Grégory Rogez KAUST, NAVER LABS Europe

KAUST NAVER LABS Europe

6D位姿估计多视角三维重建

HAMSt3R针对DUSt3R/MASt3R在含人场景中难以处理关节形变、遮挡与人体语义的问题,将MASt3R扩展到稀疏、未标定多视角下的人体与场景联合重建。其核心是引入融合MASt3R与Multi-HMR知识的DUNE编码器,并增加人体实例分割、DensePose与深度等前馈预测头,使点云带有结构化人体语义。实验在EgoHumans、EgoExo4D及传统MVS/位姿回归任务上表明,该方法能更好重建人体,同时基本保持通用三维重建能力。

An Investigation of Visual Foundation Models Robustness Figure 1
Machine Learning2025-08-22

An Investigation of Visual Foundation Models Robustness

Roberto Passerone

Queen's University Belfast, University of Trento

6D位姿估计

面向6D位姿等依赖视觉基础模型的机器人感知任务,论文关注真实部署中的光照、天气、传感器噪声和对抗扰动导致的鲁棒性失效。核心洞察是将分布偏移、空间/噪声畸变与对抗攻击统一为VFM鲁棒性评估框架,并梳理防御、消融维度和指标;实验显示ConvNeXT、ViT、ResNet等在模拟扰动下预测显著变化,ImageBind嵌入在PGD攻击下分类准确率由100%降至74.8%。

Quasi Instrumental Variable Methods for Stable Hidden Confounding and Binary Outcome Figure 1
arXiv preprint2025-09-20

Quasi Instrumental Variable Methods for Stable Hidden Confounding and Binary Outcome

Zhonghua Liu, Baoluo Sun, Ting Ye, David Richardson, Eric Tchetgen Tchetgen

). Eric Tchetgen Tchetgen is University Professor

6D位姿估计

本文针对观测数据中二元结局的因果效应估计,关注传统工具变量排除限制和独立性常被破坏的问题。核心思路是用仅需预测结局的准工具变量,在稳定隐藏混杂假设下识别ATT,并通过广义 odds product 参数化保证概率有界。结果给出因果零假设检验、条件/边际ATT的非参数识别,以及最大似然和三重稳健半参数估计器;与6D位姿估计的关联文中未充分说明。

GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM System Figure 1
arXiv preprint2025-08-21

GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM System

Hung-Jui Huang, Mohammad Amin Mirzaee, Michael Kaess, Wenzhen Yuan

Hung-Jui Huang and Michael Kaess are with Carnegie Mellon University, Pittsburgh, PA, USA

6D位姿估计相机位姿

针对视觉在遮挡、弱光和接触操作中难以稳定获取物体位姿与细节形状的问题,GelSLAM探索仅用GelSight类触觉实现长时程6D跟踪与三维重建。核心洞察是放弃近乎平坦、难配准的触觉点云,直接利用法向与曲率等微分几何表示,并结合跟踪、关键帧、回环检测和位姿图优化抑制漂移。实验显示其在多类物体上优于NormalFlow、点云配准和Tac2Structure,可实时处理数万帧,并达到亚毫米级重建精度。

UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimation Figure 1
arXiv preprint2025-08-21

UnPose: Uncertainty-Guided Diffusion Priors for Zero-Shot Pose Estimation

Zhaodong Jiang, Ashish Sinha, Tongtong Cao, Yuan Ren, Bingbing Liu, Canada, Canada @huawei.com, zhaodong.jiang@mail.utoronto.ca

Huawei Noah’s Ark Lab, Canada University of Toronto, Canada

6D位姿估计

UnPose 面向开放世界机器人中缺少物体 CAD、类别训练或已知多视角参考时的 6D 位姿估计问题。其核心是把预训练多视角扩散模型生成的 3D 先验表示为 3DGS,并显式估计像素级认知不确定性,用来在后续 RGB-D 观测到来时权衡先验与真实测量;同时通过位姿图联合优化扩散视图和观测视图,保持全局一致。实验显示其在零样本位姿精度和重建质量上优于现有方法,并展示了真实机器人操作应用。

Strichartz estimates for higher order Schrödinger equations with Partial regular initial data Figure 1
arXiv preprint2025-08-21

Strichartz estimates for higher order Schrödinger equations with Partial regular initial data

Vishvesh Kumar, Shyam Swarup Mondal, Iswarya Sitiraju, Manli Song

Vishvesh Kumar Department of Mathematics: Analysis, Logic and Discrete Mathematics Ghent University Krijgslaan 281, Building S8, B Ghent, Belgium, Shyam Swarup Mondal Stat-Math UnitIndian Statistical Institute Kolkata BT Road, Baranagar, Kolkata 700108, India, Iswarya Sitiraju Department of Mathematics Indian Institute of Technology Bombay Powai, Mumbai, Maharashtra 40007,India, Manli Song School of Mathematics and Statistics, Northwestern Polytechnical University, Xi’an, Shaanxi 710129, China

6D位姿估计

本文面向高阶/分数阶薛定谔方程中初值只在部分空间变量具备正则性的情形,动机是降低全Sobolev正则假设下的适定性门槛。核心在于建立适配部分正则数据的精细Strichartz估计,并将框架推广到Dunkl–Schrödinger算子,通过构造Dunkl分析中的驻相替代工具克服振荡积分障碍。主要结果给出相应色散半群估计,并用于幂型非线性方程的局部适定性分析;与6D位姿估计关联文中未充分说明。

MExECON: Multi-view Extended Explicit Clothed humans Optimized via Normal integration Figure 1
arXiv preprint2025-08-21

MExECON: Multi-view Extended Explicit Clothed humans Optimized via Normal integration

Fulden Ece Uğur, Rafael Redondo, Albert Barreiro, Stefan Hristov, Roger Marí Eurecat, Centre Tecnològic de Catalunya, Barcelona, Spain fuldenece.ugur@eurecat.org

Eurecat, Centre Tecnològic de Catalunya, Barcelona, Spain

6D位姿估计多视角

针对单视角人体重建易受自遮挡和深度歧义影响、难以恢复完整衣物细节的问题,MExECON在ECON上扩展稀疏多视角输入,用JMBO联合优化所有视角共享的SMPL-X身体先验,并融合前后法线图进行表面细节积分,无需重新训练网络。实验显示其相较单视角ECON提升几何保真度,并与VGGT等少样本三维重建方法表现相当。

Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework Figure 1
arXiv preprint2025-08-21

Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework

Zongqi He, Hanmin Li, Kin-Chung Chan : 1, Yushen Zuo : 1, Hao Xie : 1, Zhe Xiao : 1, Jun Xiao : 1, Kin-Man Lam : 1

Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic UniversitySchool of Intelligent Systems Engineering, Sun Yat-sen University

6D位姿估计三维重建高斯泼溅

该文针对极稀疏视角且相机位姿未知时,传统3DGS依赖SfM初始化导致几何失真和渲染退化的问题,提出SfM-free框架:用稠密立体模块估计位姿并生成全局点云,再通过一致视角插值与视频扩散生成额外监督,结合多尺度拉普拉斯和空间感知几何正则优化细节。实验显示在仅2个训练视角下PSNR较现有3DGS方法提升约2.75dB,失真更少且高频细节保留更好。

A Vision-Based Shared-Control Teleoperation Scheme for Controlling the Robotic Arm of a Four-Legged Robot Figure 1
arXiv preprint2025-10-11

A Vision-Based Shared-Control Teleoperation Scheme for Controlling the Robotic Arm of a Four-Legged Robot

Murilo Vinicius da Silva, Matheus Hipolito Carvalho, Juliano Negri, Thiago Segreto, Gustavo J. G. Lahr, Ricardo V. Godoy, Marcelo Becker

University of São Paulo, São Carlos, Brazil

6D位姿估计机器人操作

面向危险或远程场景中四足机器人机械臂遥操作不直观、易碰撞的问题,论文提出基于RGB-D相机的共享控制方案:用RealSense、ArUco与MediaPipe跟踪操作者手腕,将其映射为末端运动,并结合手势切换/抓取与轨迹规划避障。系统在真实机器人上完成验证,拾放任务中表现出实时、较稳健的控制效果,但定量对比与泛化范围文中未充分说明。

You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimation Figure 1
arXiv preprint2025-08-20

You Only Pose Once: A Minimalist's Detection Transformer for Monocular RGB Category-level 9D Multi-Object Pose Estimation

Hakjin Lee, Junghoon Seo, Jaehoon Sim

6D位姿估计物体位姿类别级位姿

该文针对单目 RGB 类别级多物体 9D 位姿估计中常见的 CAD、伪深度、分割和多阶段依赖,提出 YOPO:把任务改写为 DETR 式集合预测,在检测 Transformer 上加入轻量位姿头、框条件化的中心/深度回归与 6D 感知匹配代价,仅用 RGB 和 9D 标注端到端训练。实验在 REAL275、CAMERA25、HouseCat6D 上刷新 RGB-only 结果,REAL275 达 79.6% IoU50、54.1% 10°10cm,并显著缩小与 RGB-D 方法差距。

CUTE-MRI: Conformalized Uncertainty-based framework for Time-adaptivE MRI Figure 1
arXiv preprint2025-08-20

CUTE-MRI: Conformalized Uncertainty-based framework for Time-adaptivE MRI

Paul Fischer, Jan Nikolas Morshuis, Thomas Küstner, Christian Baumgartner

6D位姿估计

针对固定加速率 MRI 难以兼顾扫描时间与下游诊断可靠性的问题,CUTE-MRI 将概率重建的不确定性传播到软骨体积、心脏射血分数等指标,并用 conformal prediction 校准为置信区间,按预设精度动态停止 k-space 采样。在膝关节和心脏数据上,该策略相较固定协议缩短扫描时间并提供形式化精度保证,但测试集覆盖率未始终达到标称 90%,临床可用性仍受基础模型误差限制。

Heatmap Regression without Soft-Argmax for Facial Landmark Detection Figure 1
arXiv preprint2025-08-19

Heatmap Regression without Soft-Argmax for Facial Landmark Detection

Chiao-An Yang

Department of Computer Science, Purdue University

6D位姿估计

本文针对人脸关键点热图回归中长期依赖 Soft-argmax 以实现端到端训练的问题,指出可微坐标解码并非必要,改用结构化预测框架构造训练目标,并通过沿面部边界的图像感知标签平滑建模标注歧义。在 WFLW、COFW、300W 上取得 SOTA 或竞争性精度,训练收敛约快 2.2 倍;但其与仓库“6D Pose”分类关联较弱。

6-DoF Object Tracking with Event-based Optical Flow and Frames Figure 1
arXiv preprint2025-08-20

6-DoF Object Tracking with Event-based Optical Flow and Frames

Zhichao Li, Arren Glover, Chiara Bartolozzi, Lorenzo Natale

Event-driven Perception for Robotics, Istituto Italiano di Tecnologia, Italy, University of Genoa, Genoa, Italy

6D位姿估计事件相机

针对高速物体6D位姿跟踪中RGB相机帧率低、运动模糊导致估计失效的问题,论文将事件相机逐事件光流用于物体6D速度跟踪,并与低频RGB全局位姿估计器DOPE通过UKF融合;其2-DoF光流观测替代以往1-DoF事件模型,降低对RGB速度通道的依赖。合成与真实实验显示,该方法在慢速场景接近基线,在高速运动下跟踪精度更稳定、更高。

Fusing Monocular RGB Images with AIS Data to Create a 6D Pose Estimation Dataset for Marine Vessels Figure 1
arXiv preprint2025-08-20

Fusing Monocular RGB Images with AIS Data to Create a 6D Pose Estimation Dataset for Marine Vessels

Fabian Holst, Emre Gülsoylu, Simone Frintrop

6D位姿估计数据集/基准

针对海事场景缺少6D位姿数据、单靠AIS又易受设备故障、篡改和延迟影响的问题,论文提出将岸基单目RGB船舶检测与AIS消息匹配,并用PnP而非传统单应性完成图像—世界对齐,自动生成船舶3D框/6D位姿标注。结果显示YOLOX-X在相关船类上mAP@0.5达0.80,PnP投影误差显著低于单应性方法,并发布含3753张6D标注图像的BONK-Pose数据集。

GeMS: Efficient Gaussian Splatting for Extreme Motion Blur Figure 1
arXiv preprint2025-08-20

GeMS: Efficient Gaussian Splatting for Extreme Motion Blur

Gopi Raju Matta, Trisha Reddypalli, Vemunuri Divya Madhuri, Kaushik Mitra

Gopi Raju Matta, Trisha Reddypalli, Vemunuri Divya Madhuri, and Kaushik Mitra, Computational Imaging Lab, Department of Electrical Engineering, IIT Madras, Chennai, India

6D位姿估计三维重建高斯泼溅

针对极端运动模糊下 COLMAP 特征匹配失效、现有 3DGS/去模糊方法常依赖锐图初始化的问题,GeMS 用 VGGSfM 从模糊图直接估计位姿和点云,结合 3DGS-MCMC 概率化初始化,并联合优化相机运动轨迹与高斯参数;有事件数据时 GeMS-E 先用 EDI 去模糊再重建。实验称其在合成与真实数据上优于既有方法,尤其在高模糊强度下更稳。

Distributed Multiple Fault Detection and Estimation in DC Microgrids with Unknown Power Loads Figure 1
arXiv preprint2025-08-20

Distributed Multiple Fault Detection and Estimation in DC Microgrids with Unknown Power Loads

Jingwei Dong, Mahdieh S. Sadabadi, Per Mattsson, André Teixeira

6D位姿估计

面向直流微电网中线路电流不可测、负载功率未知且含噪的多故障诊断难题,论文指出线路故障电流与阶跃负载在测量上会强耦合、弱激励下甚至不可区分;方法上用 DAE 优化滤波估计执行器故障,并提出“先微分后估计”的残差时序规则区分负载突变与线路故障,再以正则最小二乘估计故障电流。仿真显示该分布式方案在多种故障场景下具备较好的估计精度和抗扰性。

Consistent Pose Estimation of Unmanned Ground Vehicles through Terrain-Aided Multi-Sensor Fusion on Geometric Manifolds Figure 1
arXiv preprint2025-08-20

Consistent Pose Estimation of Unmanned Ground Vehicles through Terrain-Aided Multi-Sensor Fusion on Geometric Manifolds

Alexander Raab, Stephan Weiss, Alessandro Fornasier, Christian Brommer, Abdalrahman Ibrahim

of Networked Systems Group, University of Klagenfurt, Austria

6D位姿估计

针对地面无人车在曲面地形上用传统 EKF 定位时容易因三维自由位姿、平面假设或硬约束导致一致性下降的问题,论文提出 M-ESEKF,将位姿降到流形图上的二维位置与切空间航向,并把地形几何融入传播、量测及协方差投影。蒙特卡洛仿真显示其在多传感器动态组合下较经典约束滤波更稳定、一致,且减少场景化调参;但依赖光滑且准确的地形模型,实车验证仍待补充。

Reliable Smoke Detection via Optical Flow-Guided Feature Fusion and Transformer-Based Uncertainty Modeling Figure 1
arXiv preprint2025-08-20

Reliable Smoke Detection via Optical Flow-Guided Feature Fusion and Transformer-Based Uncertainty Modeling

Bioinformatics, Computer Applications, India The Robotics, Mechatronics Group, The Netherlands 223130002@stu.manit.ac.in, m.khan@utwente.nl, pkumarfma@manit.ac.in

Department of Mathematics, Bioinformatics and Computer Applications, Maulana Azad National Institute of Technology Bhopal, India, The Robotics and Mechatronics Group, University of Twente, The Netherlands

6D位姿估计

面向复杂光照、湍流运动和雾尘干扰下的早期烟雾检测,论文用单目视频中的光流运动线索弥补纯外观方法不稳的问题:先以分数阶变分光流生成颜色运动图,再用 GMM 与 RGB 外观融合成烟雾掩码,并训练带多尺度不确定性头的两阶段 Swin/Shifted-Window Transformer。实验称在准确率、F1、校准误差和可靠性分析上优于若干 SOTA,但具体增益中光流数据构建与模型结构各自贡献仍需消融进一步说明。

From Slices to Structures: Unsupervised 3D Reconstruction of Female Pelvic Anatomy from Freehand Transvaginal Ultrasound Figure 1
arXiv preprint2025-08-20

From Slices to Structures: Unsupervised 3D Reconstruction of Female Pelvic Anatomy from Freehand Transvaginal Ultrasound

Max Krähenmann, Sergio Tascon-Morales, Fabian Laumer, Julia E. Vogt, and Ece Ozkan

6D位姿估计手部姿态三维重建

针对经阴道超声三维成像依赖机械探头或外部跟踪、临床部署成本高的问题,本文提出 TVGS,将 Gaussian Splatting 改造为面向超声切片的可微重建框架,用各向异性 3D Gaussian 表示解剖结构,并联合优化切片位姿与体表示,无需标定、轨迹真值或预训练姿态网络。实验在合成与真实临床 TVS 扫描上显示可重建子宫和内膜等结构,对中等手持抖动较稳健;但多视角配准和实时性仍未充分解决。

LookOut: Real-World Humanoid Egocentric Navigation Figure 1
arXiv preprint2025-08-20

LookOut: Real-World Humanoid Egocentric Navigation

Boxiao Pan, Adam W. Harley, C. Karen Liu 1

Stanford University

6D位姿估计

面向人形机器人、AR/辅助导航中的真实第一视角避障,本文将任务定义为从自我中心视频预测未来6D头部位姿,以显式建模转头观察等主动信息获取行为。LookOut把逐帧DINO特征反投影到3D并跨时间聚合,同时用Project Aria采集4小时真实导航数据AND。实验显示其在未见环境中较基线提升位姿预测与静/动态避障,并能产生减速等待、绕行、观察车流等类人行为。

HyperDiff: Hypergraph Guided Diffusion Model for 3D Human Pose Estimation Figure 1
arXiv preprint2025-08-20

HyperDiff: Hypergraph Guided Diffusion Model for 3D Human Pose Estimation

Bing Han, Yuhua Huang, Pan Gao

Nanjing University of Aeronautics and Astronautics, Nanjing, China

6D位姿估计人体姿态

针对单目2D到3D人体姿态提升中的深度歧义、自遮挡以及骨架多尺度结构利用不足,HyperDiff将扩散模型的不确定性建模与HyperGCN去噪器结合,并用关节、部件、身体三级超图捕获高阶关节关系。实验显示其在Human3.6M和MPI-INF-3DHP上达到SOTA,并可通过调整去噪/迭代步数在精度与效率间折中。

Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation Figure 1
arXiv preprint2025-08-20

Learning Point Cloud Representations with Pose Continuity for Depth-Based Category-Level 6D Object Pose Estimation

CUNY Hunter College

Graduate Center, CUNY Hunter College, CUNY Weill Cornell Medicine

6D位姿估计物体位姿类别级位姿点云彩色深度

这篇工作针对类别级6D位姿估计中仅用位姿作监督、特征空间不连续而导致未见姿态泛化差的问题,提出深度-only的HRC-Pose。其核心是将旋转与平移解耦,并用6D位姿感知的层级排序对比学习,在多类别点云中显式保持旋转/平移连续性。实验显示其在REAL275和CAMERA25上优于已有深度-only方法,并具备实时运行能力。

D $^2$ -LIO: Enhanced Optimization for LiDAR-IMU Odometry Considering Directional Degeneracy Figure 1
arXiv preprint2025-08-20

D $^2$ -LIO: Enhanced Optimization for LiDAR-IMU Odometry Considering Directional Degeneracy

Guodong Yao, Hao Wang, Qing Chang

6D位姿估计相机位姿点云

针对隧道、森林等几何特征稀疏场景中 LiDAR-IMU 里程计易出现方向退化、ICP 匹配误差和病态优化的问题,D²-LIO 从退化方向约束入手,引入随点距和平台运动自适应的逐点外点阈值,并在 scan-to-submap 配准中融合 IMU 预积分协方差与退化度量构造加权优化。室内外退化环境实验显示,其在鲁棒性和定位精度上优于多种现有 LiDAR-SLAM/LIO 方法。

Modeling of silver transport in cubic SiC: Integrating molecular dynamics, bounds averaging, and uncertainty quantification Figure 1
arXiv preprint2025-08-20

Modeling of silver transport in cubic SiC: Integrating molecular dynamics, bounds averaging, and uncertainty quantification

Mohamed AbdulHameed, Khadija Mahbuba, Mahmoud Yaseen, Amr Ibrahim, Daniel Moneghan, Benjamin Beeler

Department of Nuclear Engineering, North Carolina State University, Raleigh, NC, Idaho National Laboratory, Idaho Falls, ID, Department of Nuclear Engineering, Pennsylvania State University, University Park, PA, Electric Power Research Institute, West WT Harris Boulevard, Charlotte, NC

6D位姿估计

针对 TRISO 燃料中放射性银穿透完整 3C-SiC 的机制争议,本文将 Σ3/Σ9 晶界分子动力学扩散率、文献数据与晶界分布做界限平均,并用贝叶斯不确定性分析校准 Arrhenius 参数。结果显示单纯晶界均匀化会高估实验扩散率,引入纳米孔可逆俘获修正后能复现实测趋势,且脱附能与 Σ9 晶界扩散率是主导敏感因素。

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos Figure 1
arXiv preprint2025-08-19

LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos

Chin-Yang Lin, Cheng Sun, Fu-En Yang, Min-Hung Chen, Yen-Yu Lin, Yu-Lun Liu

National Yang Ming Chiao Tung University NVIDIA Research

6D位姿估计三维重建高斯泼溅

LongSplat面向手机/运动相机随手拍长视频中的无位姿、大场景与不规则轨迹问题,针对SfM易失败、基础模型长序列漂移和3DGS内存膨胀,提出将相机位姿与高斯表示增量联合优化,并用学习到的3D先验做对应引导位姿估计、用自适应八叉树锚点压缩稠密点云。实验在Tanks and Temples、Free、Hike等数据集上显示其渲染质量、位姿精度和效率优于既有方法。

ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving Figure 1
arXiv preprint2025-09-16

ROVR-Open-Dataset: A Large-Scale Depth Dataset for Autonomous Driving

Xianda Guo, Ruijun Zhang, Yiqun Duan, Ruilin Wang, Matteo Poggi, Keyuan Zhou, Wenzhao Zheng, Wenke Huang, Gangwei Xu, Yanlun Peng, Yuan Si, Qin Zou

6D位姿估计彩色深度数据集/基准

现有自动驾驶深度数据集在场景多样性、跨地域覆盖和可规模化采集上受昂贵多激光雷达平台限制,ROVR转向低成本固态激光雷达与HDR相机等可复现传感方案,发布20万帧跨三洲、昼夜雨天和多道路类型的深度数据及完整标定/隐私/评测流水线。实验显示KITTI等训练的模型迁移到ROVR明显退化,ROVR仍未饱和,并揭示光度崩溃、几何混淆和距离饱和等失败模式,增益可能主要来自scaling/data与更复杂分布。

Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing Figure 1
arXiv preprint2025-08-19

Sketch3DVE: Sketch-based 3D-Aware Scene Video Editing

Feng-Lin Liu, Shi-Yang Li, Yan-Pei Cao, Hongbo Fu, Lin Gao

Institute of Computing Technology, Chinese Academy of Sciences, Hong Kong University of Science and Technology

6D位姿估计

针对现有视频编辑在大幅视角变化下难以做结构性局部修改、且容易改动未编辑区域的问题,Sketch3DVE将首帧草图/掩码编辑与显式3D场景分析结合:用DUSt3R估计点云和相机,借助深度图把2D编辑对齐到点云,并进行3D感知掩码传播,再由视频扩散模型合成各视角结果。实验显示其在物体插入、替换、删除和形状纹理修改中,相比图像到视频或常规视频编辑方法更能保持视角一致性和未编辑区域稳定。

MR6D: Benchmarking 6D Pose Estimation for Mobile Robots Figure 1
arXiv preprint2025-08-19

MR6D: Benchmarking 6D Pose Estimation for Mobile Robots

Anas Gouda, Shrutarv Awasthi, Christian Blesing, Lokeshwaran Manohar, Frank Hoffmann, Alice Kirchheim TU Dortmund, Fraunhofer IML

LAMARR Institute for Machine Learning

6D位姿估计机器人操作数据集/基准

现有6D位姿数据集多面向机械臂近距离抓取小物体,难以反映移动机器人在工业场景中的远距离感知、大物体、自遮挡和多视角问题。MR6D针对这一缺口构建含92个真实场景、16类实例物体的静动态基准,并采用多种标注策略覆盖托盘、料箱等对象。实验显示现有开放物体6D流程在该设置下明显退化,且2D分割质量成为关键瓶颈。

Nonlinear stochastic trajectory optimization Figure 1
Springer proceedings in advanced robotics2025-08-19

Nonlinear stochastic trajectory optimization

1 Introduction

Max Planck Institute for Intelligent Systems, Centre National de la Recherche Scientifique, New York University, University of Trento

6D位姿估计

针对地月 CR3BP 等强非线性航天轨迹中初值敏感、非高斯不确定性难以在优化内处理的问题,本文提出 SODA,将差分代数高阶泰勒传播、自适应高斯混合分解、机会约束转写与混合分量风险分配统一到离散 DDP 框架中。四个两体到地月场景验证表明,L-SODA 在小扰动下接近确定性性能,非线性 SODA 在强非线性下约束满足更紧、鲁棒性更好且计算可承受。

RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidance Figure 1
arXiv preprint2025-08-19

RCGNet: RGB-based Category-Level 6D Object Pose Estimation with Geometric Guidance

Sheng Yu, Di-Hua Zhai, Yuanqing Xia

6D位姿估计物体位姿类别级位姿

RCGNet针对类别级6D位姿估计在缺少深度时精度下降、现有RGB方法常需先补深度或额外训练尺度网络的问题,提出仅用RGB的Transformer框架:以DINOv2预测并融合目标几何特征,用真实几何特征作引导约束,再结合尺度分支与RANSAC-PnP解算位姿。在CAMERA25和REAL275上,其精度超过既有RGB方法,但仍依赖较准确的分割,且与RGB-D方法仍有差距。

Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics Figure 1
arXiv preprint2025-08-19

Learnable SMPLify: A Neural Solution for Optimization-Free Human Pose Inverse Kinematics

Yuchen Yang, Linfeng Dong, Wei Wang, Zhihang Zhong

Fudan University Shanghai Artificial Intelligence Laboratory Zhejiang University

6D位姿估计人体姿态

针对 SMPLify 依赖迭代优化、速度慢且初始化敏感的问题,论文将人体姿态逆运动学改写为单次神经回归:用相邻视频帧构造初始化—目标训练对,引入人体中心归一化与残差预测以缩小解空间。实验显示其较 SMPLify 约快 200 倍,在 AMASS、3DPW、RICH 上保持或提升精度,并可作为后处理插件改进现有图像式估计器。

ROVER: Robust Loop Closure Verification with Trajectory Prior in Repetitive Environments Figure 1
arXiv preprint2025-08-19

ROVER: Robust Loop Closure Verification with Trajectory Prior in Repetitive Environments

Jingwen Yu, Jiayi Yang, Anjun Hu, Jiankun Wang, Ping Tan, Hong Zhang, Life Fellow, IEEE

CKS Robotics Institute, Hong Kong University of Science and Technology, Hong Kong SAR, China, The University of Tokyo, Tokyo, Japan

6D位姿估计

针对重复场景中外观相似导致回环误检、进而破坏SLAM位姿图的问题,ROVER不再只依赖视觉/几何一致性,而是把加入候选回环前后的优化轨迹变化作为先验:正确回环应带来平滑连续的轨迹修正,错误回环会造成异常形变。论文给出相应评分机制,并接入现有SLAM系统;公开基准与真实实验显示其能更稳健地拒绝假回环且保持效率。

Physically Plausible Data Augmentations for Wearable IMU-based Human Activity Recognition Using Physics Simulation Figure 1
arXiv preprint2025-08-18

Physically Plausible Data Augmentations for Wearable IMU-based Human Activity Recognition Using Physics Simulation

Nobuyuki Oishi, Philip Birch, Daniel Roggen, Paula Lago

the Electrical and Computer Engineering Department, Concordia University, Montreal, QC, Canada (e-mail

6D位姿估计

针对可穿戴 IMU 行为识别中标注数据少、传统信号增强易产生物理不合理样本的问题,论文用 WIMUSim 从人体运动、传感器位置和硬件效应出发生成物理可信的 PPDA,而非直接扭曲信号。在 REALDISP、REALWORLD、MM-Fit 上,PPDA 较 STDA 平均提升 macro F1 约 3.7 个百分点、最高 13 个百分点,并在最多减少 60% 训练受试者时保持竞争性能。

Preference Models assume Proportional Hazards of Utilities Figure 1
arXiv preprint2025-08-15

Preference Models assume Proportional Hazards of Utilities

Chirag Nagpal Meta Superintelligence Labs (MSL

Meta Superintelligence Labs (MSL)

6D位姿估计

本文动机是审视偏好建模中 Plackett-Luce/Bradley-Terry 及 DPO 的隐含统计假设。核心洞察是将其排序似然与 Cox 比例风险模型的部分似然对应起来,指出这类偏好模型等价于假设效用满足比例风险。主要结果为理论推导:若真实人类偏好存在群体异质性或违反 PH 假设,模型可能系统性误估偏好;文中未充分说明实验验证。

Rare event sampling for moving targets: extremes of temperature and daily precipitation in a general circulation model Figure 1
Journal of Advances in Modeling Earth Systems2025-08-18

Rare event sampling for moving targets: extremes of temperature and daily precipitation in a general circulation model

Justin Finkel, Paul A. O’Gorman

University of Chicago, Massachusetts Institute of Technology

6D位姿估计事件相机

针对传统气候模拟难以高效估计百年一遇暴雨、热浪等短时极端事件的问题,本文将 TEAMS 稀有事件采样扩展到理想化大气环流模型,核心是在事件发生前选择合适的提前分裂时间,让扰动集合有足够时间发散并保持统计校正。实验显示,该方法可在地表温度和日降水极端回归期估计上获得约 5–10 倍加速,例如用 20 年模拟估计约 150 年事件。

DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation Figure 1
arXiv preprint2025-08-18

DMS:Diffusion-Based Multi-Baseline Stereo Generation for Improving Self-Supervised Depth Estimation

Zihua Liu, Yizhou Li, Songyan Zhang, Japan Sony Semiconductor Solutions Group, Singapore @ok.sc.e.titech.ac.jp, spyderzsy @gmail.com

Institute of Science Tokyo, Japan, Sony Semiconductor Solutions Group, Japan, Nanyang Technological University, Singapore

6D位姿估计彩色深度多视角

针对自监督立体/单目深度在遮挡和出视野区域缺少光度对应、只能依赖上下文传播的问题,DMS微调Stable Diffusion,用“to left/right”方向提示沿极线合成左外、右外及中间视图,构造虚拟多基线以补全显式匹配监督。该方法不需深度标注、可插入现有深度网络,在多个基准上达到SOTA,离群点最多减少约35%。

Stable Diffusion-Based Approach for Human De-Occlusion Figure 1
arXiv preprint2025-08-18

Stable Diffusion-Based Approach for Human De-Occlusion

Seung Young Noh, Ju Yong Chang

Kwangwoon University

6D位姿估计

针对人体被遮挡时下游姿态估计与三维重建易受缺失结构和外观影响的问题,本文将人体去遮挡拆成掩码补全与RGB补全两阶段:先用扩散式人体先验和被遮挡关节热图恢复amodal mask,再以该掩码、VQA生成的人体语义文本和微调Stable Diffusion解码器指导外观生成。实验显示其在掩码与RGB补全上优于既有方法,并能提升2D姿态估计和3D人体重建表现。

Synthesizing Accurate and Realistic T1-weighted Contrast-Enhanced MR Images using Posterior-Mean Rectified Flow Figure 1
arXiv preprint2025-08-18

Synthesizing Accurate and Realistic T1-weighted Contrast-Enhanced MR Images using Posterior-Mean Rectified Flow

Bastian Brandstötter 1 ​ 0009-0002-3752-3051 ^{1\ }, Erich Kobler 1

6D位姿估计

针对增强 T1 MRI 依赖钆剂带来的成本、时间与潜在风险,论文将后验均值校正流用于非增强到增强脑 MRI 合成:先用 3D U-Net 最小化 MSE 得到结构准确但偏平滑的估计,再用时间条件 3D rectified flow 补充真实纹理。在 BraTS 2023–2025 测试集 360 例上,FID 降至 12.46、KID 为 0.007,较后验均值 FID 降约 68.7%,但 MSE 上升约 27%,体现了真实感与失真的折中。

PROD: Palpative Reconstruction of Deformable Objects through Elastostatic Signed Distance Functions Figure 1
arXiv preprint2025-08-18

PROD: Palpative Reconstruction of Deformable Objects through Elastostatic Signed Distance Functions

Hamza El-Kebir

University of Illinois Urbana-Champaign

6D位姿估计三维重建

面向软体物体在受力后形状会变化、仅靠视觉难以同时恢复几何与力学属性的问题,PROD 将受控触诊力/位姿测量纳入 SDF 重建,用弹静力泊松方程和接触力学从变形观测反推未变形形状,并估计杨氏模量等刚度参数。实验主要为仿真,显示其对位姿误差、非垂直施力和曲率误差有一定鲁棒性;真实机器人或组织验证文中未充分说明。

TiP4GEN: Text to Immersive Panorama 4D Scene Generation Figure 1
arXiv preprint2025-08-21

TiP4GEN: Text to Immersive Panorama 4D Scene Generation

Ke Xing, Hanwen Liang, Dejia Xu, Yuyang Yin, Konstantinos N. Plataniotis, Yao Zhao, Yunchao Wei

Institute of Information Science, Beijing Jiaotong University, Visual Intelligence + X International Joint Laboratory, University of Toronto, The University of Texas at Austin

6D位姿估计

面向 VR/AR 中缺少可从任意视角观看的动态全景内容这一问题,TiP4GEN 将文本到全景视频生成与 3DGS 动态场景重建串联:双分支扩散模型用全景分支保全局一致、透视分支补局部细节,并通过双向交叉注意力融合;重建阶段用深度与相机位姿做时空几何对齐。实验显示其在语义丰富度、运动连贯性和几何一致性上优于已有全景/4D 生成方法。

Re-weighting estimator for ab initio path integral Monte Carlo simulations of fictitious identical particles Figure 1
arXiv preprint2025-08-17

Re-weighting estimator for ab initio path integral Monte Carlo simulations of fictitious identical particles

Tobias Dornheim, Pontus Svensson, Paul Hamann, Sebastian Schwalbe, Zhandos A. Moldabekov, Panagiotis Tolias, Jan Vorberger

Center for Advanced Systems Understanding (CASUS), D-02826 Görlitz, Germany, Space and Plasma Physics, Royal Institute of Technology (KTH), Stockholm, SE-100 44, Sweden

6D位姿估计

针对费米子路径积分蒙特卡洛中符号问题及 ξ 外推需额外进行 10–20 次模拟的计算瓶颈,论文提出重加权估计器,可由单次参考 ξ 的 PIMC 采样恢复完整 ξ 依赖。作者在均匀电子气上与既有 ξ 外推和配置 PIMC 基准一致,并给出强压缩铍的新结果;该文实际属于量子多体模拟,和6D位姿估计关联不明显。

Belief-Conditioned One-Step Diffusion: Real-Time Trajectory Planning with Just-Enough Sensing Figure 1
arXiv preprint2025-08-27

Belief-Conditioned One-Step Diffusion: Real-Time Trajectory Planning with Just-Enough Sensing

Gokul Puthumanaillam, Aditya Penumarti, Manav Vora, Paulo Padrao, Jose Fuentes, Leonardo Bobadilla, Jane Shin, @cs.fiu.edu

University of Illinois Urbana-Champaign ( {gokulp2, mkvora2, University of Florida ( {apenumarti, Providence College (, Florida International University (

6D位姿估计

这篇论文针对多传感器机器人在部分可观测环境中“全开传感器耗能、少开又会定位漂移”的矛盾,提出 B-COD:将位姿信念栅格和传感器掩码显式条件化到一步扩散规划器中,用去噪轨迹的分散程度作为可微的定位误差代理,并交给 SAC 在线选择最小传感器集。系统可在约 10 ms 输出短时轨迹、路点方差和误差代理;无人水面艇实测中,在接近 always-on 到达率的同时降低了感知能耗。

Graph Neural Poisson Models for Supply Chain Relationship Forecasting Figure 1
arXiv preprint2025-08-16

Graph Neural Poisson Models for Supply Chain Relationship Forecasting

Ling Xiang label=e1]lingxiang@smail.swufe.edu.cn, Quan Hulabel=e2]quanhu@smail.swufe.edu.cn, Xiang Zhanglabel=e3]xiangzhang@swufe.edu.cn, Wei Lanlabel=e4]lanwei@swufe.edu.cn, Bin Liu label=e5]liubin@swufe.edu.cn

School of Finance, Southwestern University of Finance and Economicspresep=, ]e3

6D位姿估计

论文关注供应链中企业关系随市场波动而动态生成/断裂的问题,将有向供应边事件建模为非齐次泊松过程。核心做法是提出 GDES,把图神经网络与非参数双指数平滑结合,用邻近供应链的强度变化补充单条边历史不足,并提供一定可解释分解。在 87,969 家企业数据上动态链路预测 AUC 达 93.84%,但与仓库“6D Pose”分类明显不匹配。

DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects Figure 1
arXiv preprint2025-08-16

DynamicPose: Real-time and Robust 6D Object Pose Tracking for Fast-Moving Cameras and Objects

Tingbang Liang, Yixin Zeng, JiaTong Xie, Boyu Zhou

Sun Yat-sen University, Southern University of Science and Technology

6D位姿估计物体位姿

DynamicPose针对移动机器人中相机与物体同时快速运动时,传统6D位姿跟踪依赖上一帧ROI和小幅姿态细化而易失效的问题,提出无需重训练的闭环框架:用VIO补偿相机运动导致的ROI偏移,结合深度感知2D跟踪修正物体平移,并以VIO引导卡尔曼滤波和多候选分层细化处理大旋转。仿真与真实实验显示其在相对速度超过1.5 m/s、角速度超过3.0 rad/s场景下优于现有SOTA,并保持实时性。

Extending Straight-Through Estimation for Robust Neural Networks on Analog CIM Hardware Figure 1
arXiv preprint2025-08-16

Extending Straight-Through Estimation for Robust Neural Networks on Analog CIM Hardware

Yuannuo Feng, Wenyong Zhou, Yuexi Lyu, Yixiang Zhang, Zhengwu Liu, Ngai Wong, Wang Kang

School of Integrated Circuit Science and Engineering, Beihang University, Beijing, China, Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, Zhicun Research Lab, Beijing, China

6D位姿估计

该文针对模拟存内计算部署中真实硬件噪声复杂、不可微且训练代价高的问题,将量化中的直通估计扩展到噪声感知训练:前向使用高保真噪声仿真,反向用简化梯度近似以保留更新方向。实验显示其在图像分类最高提升5.3%准确率、文本生成困惑度降低0.72,训练加速2.2倍并减少37.9%峰值显存;与6D位姿估计关联文中未充分说明。

Statistical stability for systems semi-conjugate to pre-piecewise convex or expanding maps with countably many branches Figure 1
arXiv preprint2025-08-16

Statistical stability for systems semi-conjugate to pre-piecewise convex or expanding maps with countably many branches

Rafael Lucena

6D位姿估计

针对含无界导数、不连续性或无限 Markov 分割的动力系统在扰动下统计描述难以控制的问题,本文把不变测度稳定性转化为转移算子单位特征向量的扰动分析,在适当的符号测度空间中给出半共轭于可数分支预分段凸/扩张映射的判据。主要结果证明未扰动不变测度在参数趋零时统计稳定,并给出连续模的定量估计,覆盖 Gauss 与 Lüroth 等例子;与6D位姿估计的直接关联文中未充分说明。

Post-selection inference with a single realization of a network Figure 1
arXiv preprint2025-08-15

Post-selection inference with a single realization of a network

Ethan Ancell, Daniela Witten, Daniel Kessler

Department of Statistics, University of Washington, Department of Biostatistics, University of Washington, Ethan Ancell

6D位姿估计

这篇论文关注单个随机网络中“先用数据选社区/参数、再对该参数推断”导致的双重使用问题。核心做法是把同一邻接矩阵拆成含相同节点的训练与测试网络:高斯/泊松边用 thinning 得到独立副本,伯努利边用 fission 并做条件推断。理论上给出达到名义选择性覆盖率的置信区间,并在仿真和海豚社交网络数据上验证;与6D位姿估计关联不明显。

Anticipatory and Adaptive Footstep Streaming for Teleoperated Bipedal Robots Figure 1
arXiv preprint2025-08-15

Anticipatory and Adaptive Footstep Streaming for Teleoperated Bipedal Robots

Luigi Penco, Beomyeong Park, Stefan Fasano, Nehar Poddar, Stephen McCrory Nicholas Kitchel, Tomasz Bialek, Dexton Anderson, Duncan Calvert, Robert Griffin

the Florida Institute for Human and Machine Cognition, 40 S Alcaniz St, Pensacola, FL 32502, United States

6D位姿估计机器人操作

面向高速双足机器人遥操作中人机步态不同步、直接复制足部位姿易失稳且操作者与机器人地形不一致的问题,论文将用户脚步重定向为机器人可执行的落脚点,而非低层足姿跟随;通过提前估计步长与转向并在落脚过程中持续收敛到实测参考,同时结合机器人本地地形自动调整落脚。Nadia 人形机器人实验表明,该方法能降低踏步延迟并提升不平地形下的稳定执行效果。

Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction Figure 1
arXiv preprint2025-08-15

Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction

Mechatronics Group, Drienerlolaan 5, 7522 NB Enschede, Plesmanlaan 121, 1066 CX, Amsterdam, The Netherlands m.khan@utwente.nl, e.kerkhof@nki.nl, m.fusaglia@nki.nl, k.kuhlmann@nki.nl, t.ruers@nki.nl, f.j.siepel@utwente.nl

The Robotics and Mechatronics Group, University of Twente, Drienerlolaan 5, NB Enschede, The Netherlands, The Department of Surgical Oncology, The Netherlands Cancer Institute-Antoni van Leeuwenhoek, Plesmanlaan 121, CX, Amsterdam, The Netherlands

6D位姿估计彩色深度三维重建

针对单目内窥镜缺少度量深度、组织形变和低纹理导致位姿估计与重建不稳的问题,论文将 Depth Pro/Depth Anything 生成伪度量深度,并用 RAFT+LPIPS 做时序感知细化,再以 WEMA-RTDL 配准伪 RGB-D 帧并 TSDF 融合成网格。在 HEVD 与 SCARED 上的对比和消融显示其优于现有方法,但作为 arXiv 预印本仍待同行评审验证。

Generalized Decoupled Learning for Enhancing Open-Vocabulary Dense Perception Figure 1
arXiv preprint2025-08-15

Generalized Decoupled Learning for Enhancing Open-Vocabulary Dense Perception

Junjie Wang, Keyu Chen, Yulin Li, Bin Chen, Hengshuang Zhao, Xiaojuan Qi, Zhuotao Tian

6D位姿估计未知物体

这篇论文针对 CLIP 直接用于开放词汇密集感知时局部特征判别性和空间一致性不足的问题,指出深层图像 token 难以聚合语义相关区域。作者提出 DeCLIP,将自注意力解耦为 content/context 两类特征,分别用图像裁剪对齐、VFM 区域/语义相关性和扩散模型完整性线索进行无监督微调。实验显示其在2D检测分割、3D实例分割、视频实例分割及6D物体位姿估计等任务上达到SOTA,但6D位姿部分的具体增益来源仍需看任务细节。

A Coarse-to-Fine Human Pose Estimation Method based on Two-stage Distillation and Progressive Graph Neural Network Figure 1
arXiv preprint2025-08-15

A Coarse-to-Fine Human Pose Estimation Method based on Two-stage Distillation and Progressive Graph Neural Network

Zhangjian Ji, Wenjin Zhang, Shaotong Qiao, Kai Feng, Yuhua Qian

Chinese Information Processing of Ministry of Education, Shanxi University

6D位姿估计人体姿态

为在资源受限场景获得准确且轻量的人体姿态估计,论文指出传统蒸馏未充分利用关节拓扑与图像上下文。方法以 SimCC 为基座,先用结构损失和 L1 约束蒸馏关节关系,再通过图像引导的渐进 GCN 细化初始姿态。COCO 与 CrowdPose 实验显示其优于多种现有方法,复杂拥挤场景增益更明显。

ViPE: Video Pose Engine for 3D Geometric Perception Figure 1
arXiv preprint2025-08-12

ViPE: Video Pose Engine for 3D Geometric Perception

Jiahui Huang, Qunjie Zhou, Hesam Rabeti, Aleksandr Korovko, Huan Ling, Xuanchi Ren, Tianchang Shen, Jun Gao, Dmitry Slepichev, Chen-Hsuan Lin, Jiawei Ren, Kevin Xie, Joydeep Biswas, Laura Leal-Taixe, Sanja Fidler

Gao, Dmitry Slepichev, Chen-Hsuan Lin, Jiawei Ren, Kevin Xie, Joydeep Biswas, Laura Leal-Taixe, Sanja Fidler, NVIDIA1

6D位姿估计

面向机器人、AR/VR等空间智能对大规模3D标注的需求,ViPE试图解决野外视频中相机内参、运动与稠密尺度深度难以稳定获取的问题。其核心是将稠密BA/SLAM式优化与学习前端、度量深度先验和动态物体处理更紧耦合,并支持针孔、广角和全景相机。实验中在TUM/KITTI未标定位姿估计上较基线提升18%/50%,单GPU约3–5FPS,并产出约9600万帧带位姿和深度的数据集。

Fuel Consumption in Platoons: A Literature Review Figure 1
arXiv preprint2025-08-14

Fuel Consumption in Platoons: A Literature Review

Oumaima Barhoumi, Ghazal Farhani, Taufiq Rahman, Mohamed H. Zaki, Sofiène Tahar, Fadi Araji

Department of Electrical, Concordia University, National Research Council Canada, Research Centre, Department of Civil, Western University

6D位姿估计

面对交通减排与车队自动化节油需求,本文系统梳理车辆编队燃耗研究,而非提出新的6D位姿方法。其主要洞察是将气动阻力、车距/队列规模、信息流拓扑、车辆负载、交通扰动与队列不稳定性统一到节油分析中,并比较物理、经验和机器学习燃耗估计模型。综述显示短车距和尾车通常收益更高,三卡车CACC实测净节油约5.2%–7.8%,结合气动挂车装置可达14.2%,但真实场景稳定性与泛化仍文中未充分说明。

The SET Perceptual Factors Framework: Towards Assured Perception for Autonomous Systems Figure 1
arXiv preprint2025-08-14

The SET Perceptual Factors Framework: Towards Assured Perception for Autonomous Systems

Troi Williams

6D位姿估计

这篇论文关注自动系统中感知错误如何由天气、遮挡、眩光、传感器限制等因素触发,并影响安全决策。核心贡献是提出 SET 框架,将不确定性来源划分为 Self、Environment、Target,用状态树、因素树和感知因素模型把来源、因素与检测/位姿估计等任务的不确定性连接起来。主要结果是给出一种可解释的风险建模与沟通流程,但文中未充分说明实验验证或量化性能增益。

ViewBridge:Revisiting Cross-View Localization from Image Matching Figure 1
arXiv preprint2025-11-19

ViewBridge:Revisiting Cross-View Localization from Image Matching

Panwang Xia, Qiong Wu, Lei Yu, Yi Liu, Mingtao Xiong, Xudong Lu, Yi Liu Haoyu Guo, Yongxiang Yao, Junjian Zhang, Xiangyuan Cai Hongwei Hu, Zhi Zheng, Yongjun Zhang, Ant Group

Wuhan University Ant Group The Chinese University of Hong Kong

6D位姿估计

针对地面图像与卫星/航拍图像视角差异大、现有回归或BEV对齐难以形成可靠细粒度对应的问题,ViewBridge将跨视角定位重构为图像匹配问题:用Surface Model约束BEV特征投影到物理可见表面,并用SimRefiner结合局部与全局上下文细化相似度分布。实验显示其在极端视角下获得更一致的匹配,并提升3-DoF定位精度与稳定性,同时发布含32,509对像素级标注的CVFM基准。

Lameness detection in dairy cows using pose estimation and bidirectional LSTMs Figure 1
arXiv preprint2025-08-14

Lameness detection in dairy cows using pose estimation and bidirectional LSTMs

Helena Russello, Rik van der Tol, Eldert J. van Henten, Gert Kootstra

Agricultural Biosystems Engineering group, Wageningen University & Research, Wageningen, The Netherlands

6D位姿估计

针对奶牛跛行人工目测评分耗时且依赖手工步态特征的问题,本文用 T-LEAP 无标记提取蹄、头、背等 9 个关键点轨迹,再由 BLSTM 直接学习短时序运动模式进行二分类。该设计在小数据和短视频下减少特征工程,最佳模型准确率达 85%,高于同数据上手工特征方法的 80%,且 1 秒视频即可检测。

EgoMusic-driven Human Dance Motion Estimation with Skeleton Mamba Figure 1
arXiv preprint2025-08-14

EgoMusic-driven Human Dance Motion Estimation with Skeleton Mamba

Quang Nguyen, Nhat Le, Baoru Huang, Minh Nhat Vu, Chengcheng Tang, Van Nguyen, Ngan Le, Thieu Vo

FPT Software AI Center, The University of Western Australia, Meta, University of Arkansas, National University of Singapore, University of Liverpool

6D位姿估计

该文针对第一视角舞蹈中身体常被遮挡、仅靠音乐又难约束真实姿态的问题,提出同时利用自我中心视频与音乐估计全身舞蹈动作。核心贡献是构建含36小时数据的 EgoAIST++,并在扩散框架中引入显式建模关节层级与时序依赖的 Skeleton Mamba,以协调头部视觉线索和身体随音乐运动。实验显示其优于现有方法,并能泛化到真实数据。

eMamba: Efficient Acceleration Framework for Mamba Models in Edge Computing Figure 1
arXiv preprint2025-08-14

eMamba: Efficient Acceleration Framework for Mamba Models in Edge Computing

Jiyong Kim, Jaeho Lee, Jiahao Lin, Alish Kanani, Miao Sun, Umit Y. Ogras, Jaehyun Park

University of Ulsan, Department of Electrical, Electronic and Computer Engineering, University of Wisconsin-Madison, Department of Electrical and Computer Engineering, Umit Y. Ogras

6D位姿估计

面向边缘端部署 Mamba 时,标准归一化、SiLU、指数运算和递归 SSM 会带来硬件开销,限制其在线感知/姿态任务应用。eMamba 的核心是把 Mamba 改造成硬件友好的端到端加速框架:用轻量归一化与分段近似替代昂贵算子,结合量化、近似感知 NAS 和流水展开。其在 Fashion-MNIST、CIFAR-10 与 MARS 人体姿态数据上以 1.63–19.9 倍更少参数保持相近精度,并在 FPGA/22nm ASIC 上显著降低延迟、面积、功耗与能耗。

Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones Figure 1
arXiv preprint2025-08-14

Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones

Yujie Zhao

6D位姿估计

本文针对手机端视线落点个性化校准在头部姿态变化下易失效的问题,构建含静态与动态姿态采集的 MobilePoG 基准,系统比较校准点数量与姿态多样性的影响。核心洞察是增加校准时的头姿覆盖比单纯增加注视点更关键,并据此提出用户盯点同时移动手机的动态校准策略;实验显示该策略能降低已校准 PoG 模型对头姿变化的敏感性。

LaajMeter: A Framework for LaaJ Evaluation Figure 1
arXiv preprint2025-08-13

LaajMeter: A Framework for LaaJ Evaluation

Samuel Ackerman, Gal Amram, Ora Nova Fandina, Eitan Farchi, Shmulik Froimovich, Raviv Gal, Wesam Ibraheem, Avi Ziv

6D位姿估计

本文关注低资源、强领域任务中“谁来评估 LLM 评委”的难题:缺少标注与专家时,常用一致性或相关性指标是否有效并无依据。LaaJMeter 的核心创新是用仿真生成不同质量的虚拟模型与虚拟评委,受控检验元评估指标的区分能力并估计合格阈值。作者在遗留语言代码翻译场景展示,不同指标对评委质量的敏感性差异明显,常用指标存在局限,但真实任务上的外部验证文中仍未充分说明。

A Personalized Exercise Assistant using Reinforcement Learning (PEARL): Results from a four-arm Randomized-controlled Trial Figure 1
arXiv preprint2025-08-12

A Personalized Exercise Assistant using Reinforcement Learning (PEARL): Results from a four-arm Randomized-controlled Trial

Amy Armento Lee, Narayan Hegde, Nina Deliu, Emily Rosenzweig, Arun Sai Suggala, Sriram Lakshminarasimhan, Qian He, John Hernandez, Martin Seneviratne, Rahul Singh, Pradnesh Kalkar, Karthikeyan Shanmugam, Aravindan Raghuveer, Abhimanyu Singh, Hariharan Manoharan, My Nguyen, James Taylor, Jatin Alla, Sofia Villar, Hulya Emir-Farinas

Google, Mountain View, CA, MRC Biostatistics Unit, Cambridge Institute of Public Health, School of Clinical Medicine, University of, MEMOTEF Department, Sapienza University of Rome, Rome, Italy

6D位姿估计

针对可穿戴健康干预中静态规则难以适应个体状态变化的问题,PEARL将行为改变理论与强化学习结合,在Fitbit应用中动态选择运动提醒的内容和时机。四臂RCT纳入13,463名用户、7,711人进入主分析;RL组1个月日均步数较对照、随机、固定组分别多约296、218、238步,2个月相对对照仍多约210步,说明增益可能来自在线自适应而非单纯规则个性化。

Masquerade: Learning from In-the-wild Human Videos using Data-Editing Figure 1
arXiv preprint2025-08-13

Masquerade: Learning from In-the-wild Human Videos using Data-Editing

Marion Lepert, Jiaying Fang

Stanford University

6D位姿估计

机器人操作受限于真实示教稀缺,而野外人类视频又存在人机外观与动作形态差异。Masquerade通过估计手部3D位姿、抹除人臂并叠加双臂机器人,将人类视频“机器人化”,再用未来2D关键点预训练并与扩散策略联合微调。仅每任务50条机器人示教时,在三类长时程双手厨房任务和未见场景中较基线提升约5–6倍,消融显示机器人叠加与联合训练是关键。

Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System Figure 1
arXiv preprint2025-08-13

Predictive Uncertainty for Runtime Assurance of a Real-Time Computer Vision-Based Landing System

Romeo Valentin14, Sydney M. Katz1, Artur B. Carneiro1, Don Walker2, Mykel J. Kochenderfer1

Stanford Intelligent Systems Laboratory, Stanford University, Stanford, CA, 2A 3 by Airbus LLC, Sunnyvale, CA

6D位姿估计

面向自动着陆中视觉位姿估计难以满足航空安全与运行时可用性验证的问题,论文将跑道关键点检测与6D位姿前端结合:用空间Soft Argmax实现轻量亚像素概率回归,以NLL训练校准预测不确定性,并把GNSS中的残差RAIM改造为视觉输出故障检测。LARD实验显示其精度优于基线,能给出较尖锐且校准良好的不确定性,并支持实时推理与异常关键点剔除。

Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors Figure 1
arXiv preprint2025-08-13

Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors

Giorgos Karvounas gkarv@ics.forth.gr, Nikolaos Kyriazis kyriazis@ics.forth.gr, Iason Oikonomidis oikonom@ics.forth.gr, Georgios Pavlakos pavlakos@cs.utexas.edu, Antonis A. Argyros argyros@ics.forth.gr, ICS-FORTH

University of Texas at Austin, University of Crete

6D位姿估计手部姿态三维重建

单目手部三维重建中,几何预测常与图像外观错位,尤其在遮挡和自视角下仅靠姿态监督不够。本文将纹理从“渲染附属品”转为训练信号:把可见像素投到 UV 空间,用 Transformer 从稀疏 UV-RGB 观测补全纹理,并通过可微渲染施加密集光度对齐损失。接入 HaMeR 后,测试时无额外开销,在 HInt 重遮挡帧 PCK 最高提升 2.7%,FreiHAND、HO-3D 也有较小但一致增益。

Waymo-3DSkelMo: A Multi-Agent 3D Skeletal Motion Dataset for Pedestrian Interaction Modeling in Autonomous Driving Figure 1
arXiv preprint2025-08-13

Waymo-3DSkelMo: A Multi-Agent 3D Skeletal Motion Dataset for Pedestrian Interaction Modeling in Autonomous Driving

Guangxun Zhu, Shiyu Fan, Hang Dai, Edmond S. L. Ho

University of Glasgow, Wuhan University

6D位姿估计数据集/基准

面向自动驾驶中细粒度行人交互建模,现有多依赖单目 RGB 或稀疏 LiDAR 估计,易受遮挡与时序不连续影响。Waymo-3DSkelMo 从 Waymo 原始 LiDAR 中引入 SMPL 人体形状先验与 Neural Motion Field 运动先验,生成时序一致的 3D 骨架序列和交互语义;数据覆盖 800+ 场景、1.4 万秒、平均 27 个智能体,并建立不同密度下的 3D 姿态预测基准。

A Nitsche method for Navier--Stokes/generalized poroelasticity interface problems Figure 1
arXiv preprint2025-08-12

A Nitsche method for Navier--Stokes/generalized poroelasticity interface problems

Aparna Bansal, Nicolás A. Barnafi, Dwijendra Narain Pandey, Ricardo Ruiz-Baier

6D位姿估计

面向自由流体与可变形多孔介质耦合中界面条件难稳定、拉格朗日乘子会引入额外未知量的问题,本文将 Nitsche 弱施加界面连续性与隐式单体有限元结合,用于含非线性对流项的 Navier–Stokes/广义孔弹模型。作者证明离散问题适定、稳定并给出先验误差估计,数值实验验证收敛率,并展示二维障碍通道与三维微流控血流场景;与仓库“6D Pose”标签关联不明显。

How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy Figure 1
arXiv preprint2025-09-30

How Safe Will I Be Given What I Saw? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy

Mrinall Eashaan Umasudhan, Ivan Ruchkin

6D位姿估计

针对端到端视觉控制机器人缺少显式低维状态、且长时域预测易因分布偏移导致风险估计失准的问题,论文提出基于世界模型的校准安全预测框架:用VAE与循环预测器预测潜在轨迹,比较单体与组合式管线,并结合无监督域自适应和 conformal calibration 给出置信保证。赛车、倒立摆和 Donkey Car 实验显示,UDA 评估器在偏移下保持较高准确率并降低误报,组合式世界模型长时域优于单体模型。

Value Function Initialization for Knowledge Transfer and Jump-start in Deep Reinforcement Learning Figure 1
arXiv preprint2025-08-12

Value Function Initialization for Knowledge Transfer and Jump-start in Deep Reinforcement Learning

Soumia Mehimeh

6D位姿估计

本文针对深度强化学习中难以复用表格式价值函数初始化的问题,动机是在连续状态动作空间和终身学习场景下提升新任务的早期学习效率。核心方法 DQInit 将历史任务的 Q 值压缩为离散/聚类表格知识库,并用基于 knownness 的自适应权重只在当前任务未充分探索区域注入先验,避免保存多个网络或固定时间衰减。实验在多种连续控制任务上显示其相较常规初始化、JSRL 和蒸馏基线提升 jump-start 表现、稳定性与总体性能,但与 6D 位姿估计的直接关系文中未充分说明。

Physics-Constrained Fine-Tuning of Flow-Matching Models for Generation and Inverse Problems Figure 1
arXiv preprint2025-08-05

Physics-Constrained Fine-Tuning of Flow-Matching Models for Generation and Inverse Problems

Jan Tauberschmidt, Sophie Fellenz, Sebastian J. Vollmer, Andrew B. Duncan DSA, Imperial College London

DSA, German Research Centre for Artificial Intelligence (DFKI), Department of Computer Science, University of Kaiserslautern–Landau (RPTU), Department of Mathematics, Imperial College London

6D位姿估计

针对仅有观测场、缺少物理参数标签时生成模型容易违反 PDE 约束的问题,本文将流匹配模型的后训练微调表述为带弱形式残差奖励的随机控制/Adjoint Matching,并加入潜变量参数预测器联合生成解与参数。在 Darcy、弹性、波传播和不可压流等任务中,方法显著降低物理残差并能从稀疏或噪声观测中恢复隐含系数,但与 6D 位姿估计的直接关联文中未充分说明。

Efficient Statistical Estimation for Sequential Adaptive Experiments with Implications for Adaptive Designs Figure 1
arXiv preprint2025-08-17

Efficient Statistical Estimation for Sequential Adaptive Experiments with Implications for Adaptive Designs

Wenxin Zhang, Berkeley

Division of Biostatistics, University of California, Berkeley

6D位姿估计

本文关注序贯自适应实验中因处理分配随历史数据变化而破坏独立同分布假设、导致因果估计推断困难的问题。核心提出基于自适应设计似然的 ADL-TMLE,将效率界与“平均设计”关联,从而只需平均设计满足正性与稳定性,并据此设计面向估计方差最小化的自适应方案。理论证明其渐近正态与半参数有效,仿真显示较既有方法方差更低。

Nonparametric Bayesian Multi-Treatment Mixture Cure Survival Model with Application in Pediatric Oncology Figure 1
arXiv preprint2025-10-28

Nonparametric Bayesian Multi-Treatment Mixture Cure Survival Model with Application in Pediatric Oncology

Peter Chang, John Kairalla, Gainesville, USA

University of Florida, Gainesville, USA

6D位姿估计

该文面向儿科肿瘤多臂化疗试验中治疗成分重叠、且存在长期缓解/治愈患者的问题,提出协变量依赖的非参数贝叶斯多治疗混合治愈生存模型,通过潜在链接函数在线性或神经网络形式下共享治疗间结构,并用基于边际似然的梯度 MCMC 推断。仿真显示其在多种设定下更稳健;在 AALL0434 数据上揭示甲氨蝶呤方案间及协变量相关的生存差异。

DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation Figure 1
arXiv preprint2025-08-12

DiffPose-Animal: A Language-Conditioned Diffusion Framework for Animal Pose Estimation

WFLA Shanghai, China tian_wei@tongji.edu.cn

Guanghua Cambridge International School, Shanghai, China, Shanghai World Foreign Language Academy, WFLA, School of Automotive Studies, Tongji University

6D位姿估计

针对动物跨物种形态差异大、遮挡复杂且标注稀缺导致关键点估计不稳的问题,DiffPose-Animal将姿态预测改写为扩散去噪过程,并用LLM生成物种级解剖先验与关键点语义,经交叉注意力融合视觉特征,逐步细化热图。实验称其在多个公开动物姿态数据集上提升了复杂场景下的泛化与鲁棒性,但具体增益幅度文中未充分说明。

Bridging the Gap: A Framework for Real-World Video Deepfake Detection via Social Network Compression Emulation Figure 1
arXiv preprint2025-09-12

Bridging the Gap: A Framework for Real-World Video Deepfake Detection via Social Network Compression Emulation

Andrea Montibeller, Dasara Shullani, Daniele Baracchi, Alessandro Piva, Giulia Boato

University of Trento and, University of Florence, University of Trento

6D位姿估计

本文关注深伪视频检测从实验室到社交网络部署时的性能落差,指出平台私有的重压缩与缩放会抹去低层取证线索且难以大规模复现。其核心做法是用少量上传视频估计各平台重编码参数,构建本地压缩仿真器来生成接近真实分享后的训练数据。在 FaceForensics++ 及多平台实验中,仿真退化模式接近真实上传,基于仿真视频微调的检测器达到与真实社交媒体数据训练相近的效果。

XR Reality Check: What Commercial Devices Deliver for Spatial Tracking Figure 1
arXiv preprint2025-08-12

XR Reality Check: What Commercial Devices Deliver for Spatial Tracking

Tianyi Hu, Tianyuan Du, Zhehan Qu, Maria Gorlatova

Department of Electrical and, Duke University, Department of Computer Science

6D位姿估计

针对商用XR设备空间跟踪不透明、难以公平比较的问题,论文构建同步多设备测试床,在相同环境与运动条件下评测5款设备的6D位姿跟踪,并关联视觉特征、IMU与SLAM状态。结果显示无纹理环境可使单设备误差最高增加101%,设备间差异达2.8倍;Apple Vision Pro的相对误差可作近似参考,但绝对位姿相关性不足。

QoE-Aware Service Provision for Mobile AR Rendering: An Agent-Driven Approach Figure 1
arXiv preprint2025-08-12

QoE-Aware Service Provision for Mobile AR Rendering: An Agent-Driven Approach

Conghao Zhou1, Lulu Sun1, Xiucheng Wang1, Peng Yang2, Feng Lyu3, Sihan Lu4, Xuemin (Sherman) Shen5

School of Telecommunications Engineering, Xidian University, China, School of Computer Science and Engineering, Central South University, China, State Power Investment Corporation Limited, China, Department of Electrical and Computer Engineering, University of Waterloo, Canada

6D位姿估计

面向边缘辅助移动 AR 中设备 6D 位姿预测与渲染对带宽、时延和用户体验的耦合需求,论文指出网络侧难以获取 OTT 应用机制和个体运动模式。其核心是用 LLM 驱动的服务代理通过 MCP 调用 MAR 功能,在不暴露原始用户数据的情况下建立用户级 QoE 模型,并据此动态分配通信资源。轨迹仿真显示,该方法相比常规 LLM 式 QoE 供给在建模精度和资源效率上更优。

Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors Figure 1
SIGGRAPH '25: ACM SIGGRAPH 2025 Conference Conference Papers, Article 107, pages1-11, July 20252025-08-11

Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors

Mutian Tong, Rundi Wu, Changxi Zheng

Columbia University

6D位姿估计

面向 AR/视频合成中室内 HDR 光照随位置和时间变化、单目/视频估计高度欠定的问题,论文将光照表示为连续 6D 时空光场 MLP,并用经多铬球联合补全训练的 2D 扩散先验来蒸馏优化,实现多位置一致的光照推断。实验显示其在单图和视频室内光照估计上优于基线,并能在野外视频中保持时空一致性;但户外强日照和蒸馏带来的过平滑仍是限制。

The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs Figure 1
arXiv preprint2025-08-13

The Illusion of Progress: Re-evaluating Hallucination Detection in LLMs

Denis Janiak, Jakub Binkowski, Albert Sawczyn, Bogdan Gabrys Ravid Shwartz-Ziv

Wroclaw University of Science and Technology, University of Technology Sydney, New York University

6D位姿估计

本文针对LLM幻觉检测评估中过度依赖ROUGE的问题,指出词面重合指标与人类事实性判断严重错位。作者通过人工标注验证LLM-as-Judge更贴近人类评估,并重评多种无监督检测方法,发现用人类对齐指标后性能最高下降45.9%;同时,简单的回答长度启发式可接近复杂方法,说明既有进展可能被评估指标系统性高估。

Towards Heterogeneity-Aware and Energy-Efficient Topology Optimization for Decentralized Federated Learning in Edge Environment Figure 1
arXiv preprint2025-08-01

Towards Heterogeneity-Aware and Energy-Efficient Topology Optimization for Decentralized Federated Learning in Edge Environment

Yuze Liu, Tiehua Zhang, Zhishu Shen, Libing Wu, Shiping Chen, Jiong Jin

6D位姿估计

面向边缘环境中的去中心化联邦学习,论文针对设备算力/通信能力差异带来的能耗不均与非 IID、动态数据导致的精度下降,提出 Hat-DFed,将通信拓扑构建建模为兼顾精度与累计能耗的 NP-hard 联合优化问题,并用效用指标指导两阶段拓扑选择与重要性感知聚合。实验在 Fashion-MNIST、CIFAR-10 上显示,平均精度提升 1.9%,总能耗降低 36.7%。

3D Human Mesh Estimation from Single View RGBD Figure 1
arXiv preprint2025-08-12

3D Human Mesh Estimation from Single View RGBD

Ozhan Suat, Bedirhan Uguz, Batuhan Karagoz, Muhammed Can Keles, Ankara, Turkey Helmholtz Munich, Germany @metu.edu.tr

Department of Computer Engineering and METU-ROMER Robotics Center, Middle East Technical University, Ankara, Turkey

6D位姿估计点云彩色深度

该文针对单目 RGBD 人体网格估计中深度信息利用不足、成对 RGBD-网格标注稀缺的问题,提出 M³:用 MoCap/AMASS 网格经虚拟相机生成单视角部分网格,训练基于 Transformer 的 masked autoencoder 补全不可见人体表面;推理时结合 DensePose UV 与深度匹配到 SMPL 顶点形成部分网格。结果在 SURREAL、CAPE 上 PVE 为 16.8/22.0 mm,BEHAVE 为 70.9 mm,较 RGB 方法 TokenHMR 低 18.4 mm。

Can LLMs Detect Their Confabulations? Estimating Reliability in Uncertainty-Aware Language Models Figure 1
arXiv preprint2025-08-11

Can LLMs Detect Their Confabulations? Estimating Reliability in Uncertainty-Aware Language Models

Sweden tzho@kth.se &Johanne Medina QCRI, HBKU Doha, Qatar jomedina@hbku.edu.qa &Sanjay Chawla QCRI, Qatar schawla@hbku.edu.qa

KTH Royal Institute of Technology

6D位姿估计

这篇论文关注多轮/RAG/智能体场景中,错误上下文会被模型吸收并导致“自信地胡编”的可靠性风险。作者构造受控上下文设置,比较无上下文、正确上下文和误导上下文下的输出与不确定性,并提出用token级偶然/认知不确定性筛选关键token、聚合其隐藏状态训练探针来预测回答可靠性。实验显示,正确上下文提升准确率和置信度,而误导上下文常诱发高置信错误;该不确定性引导探针优于直接使用不确定性指标。

S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix Figure 1
arXiv preprint2025-08-11

S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix

Peng Dai, Feitong Tan, Qiangeng Xu, Yihua Huang, David Futschik, Ruofei Du, Sean Fanello, Yinda Zhang, Xiaojuan Qi

Feitong Tan, Qiangeng Xu, David Futschik, Ruofei Du, Sean Fanello, Yinda Zhang are with Google, USA. {\dagger}

6D位姿估计多视角

针对VR/AR中缺少高质量双目与空间视频、而多视角视频数据和稳定相机位姿难以获得的问题,S²VG将单目生成视频经深度预变换后,用“帧矩阵”把时间与视角维度联合去噪补全,并通过遮挡边界重注入降低潜空间伪影;生成的多视角序列可组成双目视频或优化为4D Gaussian。实验在Sora、Lumiere、WALT、Zeroscope等输入上较既有方法提升一致性与质量。

Nadirashvili' Conjecture for Elliptic PDEs and its Applications Figure 1
arXiv preprint2025-08-15

Nadirashvili' Conjecture for Elliptic PDEs and its Applications

Jiahuan Li, Junyuan Wang, Zhichen Ying

6D位姿估计

本文并非6D位姿估计工作,而是研究椭圆型PDE中零点集体积如何反向控制解的大小。动机是回答Nadirashvili关于调和函数的猜想:若单位球内零点集测度有界,则半球上的上确界可由中心有限阶导数控制。核心思路结合Logunov零点集下界、小量传播与椭圆估计,证明该猜想,并推广到光滑系数的一般椭圆方程;对较低正则系数给出弱版本及若干应用。

Forecasting Continuous Non-Conservative Dynamical Systems in SO(3) Figure 1
arXiv preprint2025-08-11

Forecasting Continuous Non-Conservative Dynamical Systems in SO(3)

Lennart Bastian, Mohammad Rashed, Nassir Navab

Technical University of Munich, Munich Center of Machine Learning, Imperial College London

6D位姿估计

本文针对噪声、稀疏观测下SO(3)旋转外推难以处理未知惯量与外力、且常速或守恒假设不适用的问题,提出用SO(3) Savitzky-Golay路径作为控制信号驱动Neural CDE,在流形上同时去噪并学习潜在非保守动力学。实验覆盖多种模拟外力场及真实跟踪/6D位姿估计输入,显示其在外推误差与抗噪性上优于常见基线,并可作为现有位姿管线模块使用。

Global weak solutions to a doubly degenerate nutrient taxis system on the whole real line Figure 1
Nonlinear Analysis2025-08-10

Global weak solutions to a doubly degenerate nutrient taxis system on the whole real line

Federico Herrero-Hervás

6D位姿估计

本文动机是解释细菌在营养趋化中出现的聚集/分枝模式,并补足双重退化模型在整条实线上的适定性理论。核心做法不是数值实验,而是将无界 Cauchy 问题转化为随 ε 扩张的有界区间正则化问题,建立与区域无关的先验估计,并用 Aubin-Lions 紧性传递极限。主要结果是在适当正则与可积初值下证明一维系统存在全局弱解。

Generic Calibration: Pose Ambiguity/Linear Solution and Parametric-hybrid Pipeline Figure 1
arXiv preprint2025-08-10

Generic Calibration: Pose Ambiguity/Linear Solution and Parametric-hybrid Pipeline

Yuqi Han, Qi Cai

6D位姿估计

针对参数化相机标定依赖模型选择、通用标定流程复杂且外参会受位姿歧义影响的问题,论文指出通用标定中的位姿歧义会传导到后续 SfM/SLAM/PnP,并提出线性求解、非线性消歧及结合位姿图的通用-参数混合全局优化。仿真和真实实验显示,该方法在不同镜头与噪声下提升外参、重建精度和参数稳定性,尤其缓解模型与镜头不匹配导致的过拟合和数值不稳定。

Unbiased Insights: Optimal Streaming Algorithms for $\ellp$ Sampling, the Forget Model, and Beyond Figure 1
arXiv preprint2025-10-17

Unbiased Insights: Optimal Streaming Algorithms for $\ellp$ Sampling, the Forget Model, and Beyond

a CMU Paul

Carnegie Mellon University, Computer Science Department, Carnegie Mellon University

6D位姿估计

论文面向大规模数据流中频率矩与ℓp采样的空间瓶颈,动机是插入流及带“遗忘”删除的非线性更新难以用传统线性 sketch 无偏处理。核心做法是构造近最优的一遍ℓp采样器,并用其形成低偏/近无偏估计。结果将p∈(0,2)空间降至Õ(log n log(1/δ)),p=2为Õ(log²n log(1/δ)),并解决遗忘模型中Fp估计的开放问题。

VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions Figure 1
arXiv preprint2025-08-09

VOccl3D: A Video Benchmark Dataset for 3D Human Pose and Shape Estimation under real Occlusions

Yash Garg, Saketh Bachu, Arindam Dutta, Rohit Lal, Sarosij Bose, Calvin-Khang Ta, M. Salman Asif, Riverside @ucr.edu

Yash Garg, Saketh Bachu, Arindam Dutta, Rohit Lal, M. Salman Asif, Amit Roy-Chowdhury, University of California, Riverside

6D位姿估计人体姿态数据集/基准

现有单目3D人体姿态与形状估计在真实重遮挡场景下训练与评测不足,常依赖贴片式遮挡数据。VOccl3D用3D Gaussian Splatting重建真实背景并渲染合成人体视频,提供约25万帧、400段序列、关节遮挡标签、多服装与动作。作者用其微调CLIFF/BEDLAM-CLIFF和YOLO11,在VOccl3D、3DPW、OCMotion及高遮挡变体上取得更好姿态估计和检测表现,增益可能主要来自更贴近真实遮挡的数据覆盖。

Robust-Sub-Gaussian Model Predictive Control for Safe Ultrasound-Image-Guided Robotic Spinal Surgery Figure 1
arXiv preprint2025-08-08

Robust-Sub-Gaussian Model Predictive Control for Safe Ultrasound-Image-Guided Robotic Spinal Surgery

Yunke Ao, Manish Prajapat, Yarden As, Yassine Taoudi-Benchekroun, Fabio Carrillo, Hooman Esfandiari, Benjamin F. Grewe, Andreas Krause, Philipp Fürnstahl

6D位姿估计机器人操作高斯泼溅医学/手术

针对超声等高维术中观测带来未知、非零均值估计误差,使脊柱机器人手术难以给出安全保证的问题,本文将误差建模为有界偏置加次高斯随机项,并提出结合鲁棒集合传播与方差代理传播的MPC框架,用于超声引导椎弓根钻孔。仿真集成人体解剖、机器人动力学、超声模拟及呼吸/钻削力体内数据,结果显示在满足安全约束的同时可达到较高临床性能;真实手术与软组织形变仍未充分验证。

OM2P: Offline Multi-Agent Mean-Flow Policy Figure 1
arXiv preprint2025-08-08

OM2P: Offline Multi-Agent Mean-Flow Policy

Zhuoran Li, Xun Wang, Hai Zhong, Qingxin Xia, Lihua Zhang, Longbo Huang

Institute for Interdisciplinary Information Sciences (IIIS), Tsinghua University, ByteDance Inc

6D位姿估计

针对离线多智能体强化学习中扩散/流策略需多步采样、训练和推理开销高的问题,OM2P将mean-flow引入策略建模,通过奖励感知的mean-flow匹配、Q函数监督、广义时间步采样与无导数均速估计,实现一步动作生成。在MPE和Multi-Agent MuJoCo上取得接近或优于基线的性能,GPU显存最多降至约1/3.8,训练最多加速10.1倍。

DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Camera Figure 1
IEEE Transactions on Visualization and Computer Graphics2025-08-08

DiffCap: Diffusion-based Real-time Human Motion Capture using Sparse IMUs and a Monocular Camera

Shaohua Pan, Xinyu Yi, Yan Zhou, Weihua Jian, Yuan Zhang, Pengfei Wan, Feng Xu

Tsinghua University

6D位姿估计人体姿态

DiffCap面向单目相机易遮挡/出视野、稀疏IMU长期漂移且现有融合需手工置信度切换的问题,将动捕表述为条件扩散生成:把整段2D关键点编码为鲁棒视觉条件,同时逐帧注入IMU,并用关节位置与姿态两阶段扩散约束人体运动先验。实验在AIST++、TotalCapture、3DPW及遮挡场景取得SOTA,并展示实时演示。

UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization Figure 1
arXiv preprint2025-08-08

UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization

Yachun Mi, Xingyang He, Shixin Sun, Yu Li, Yanting Li, Zhixuan Li, Jian Jin, Chen Hui, Shaohui Liu

Harbin Institute of Technology, Nanyang Technological University

6D位姿估计机器人操作

针对图像篡改定位依赖大量人工像素标注、受限设置下自动标注流程又复杂的问题,UGD-IML将无约束IML与有原图对的CIML统一到扩散生成框架中,通过类别嵌入、共享编码器和端到端去噪预测在两种输入模式间切换。多数据集实验显示其F1较SOTA在IML和CIML上平均提升9.66%与4.36%,并报告更好的不确定性估计和鲁棒性。

Absolute Parameters of Young Stars: NO Puppis Figure 1
arXiv preprint2025-08-07

Absolute Parameters of Young Stars: NO Puppis

Ahmet Erdem, Volkan Bakış, John Southworth, Michael D. Rhodes, Filiz Kahraman Aliçavuş, Edwin Budding, Mark Blackford, Timothy Banks, Murray Alexander

Astrophysics Group, Keele University, Staffordshire, ST5 BG, UK, Brigham Young University, Provo, Utah 84602, USA, Department of Physical Science & Engineering, Harper College, 1200 W Algonquin Rd, Palatine, IL 60067, USA, Physics Department, University of Winnipeg, Portage Avenue, Winnipeg R3B 2E9, Canada

6D位姿估计

这篇论文并非机器人6D位姿估计研究,而是针对年轻食双星 NO Puppis 的基本恒星参数重定标。作者为解释其短周期近距系统仍保有显著偏心率这一异常现象,联合 TESS 多扇区光变、地基 BVR 光度、高分辨率光谱与天体测量,并用不同曲线拟合程序评估模型不确定性。主要结果给出 Aa/Ab 的质量、半径和温度、约 20 Myr 年龄、172 pc 距离,指出 Ab 可能产生低振幅 δ Scuti 振荡,偏心率保留机制仍未充分说明。

Cross-View Localization via Redundant Sliced Observations and A-Contrario Validation Figure 1
ISPRS Journal of Photogrammetry and Remote Sensing2025-08-07

Cross-View Localization via Redundant Sliced Observations and A-Contrario Validation

Yongjun Zhang, Mingtao Xiong, Yi Wan, Gui-Song Xia

Wuhan University, Wuhan Business University

6D位姿估计

针对跨视角定位通常只输出单一相机位姿、难以按测量冗余原则判断失败的问题,论文提出 Slice-Loc:将地面全景切成多个子图分别估计 3-DoF 位姿,用几何刚性与 RANSAC 合并内点,并以 a-contrario/NFA 评估结果可靠性。实验显示其能剔除粗差,10 m 以上错误降至 3% 以下,DReSS 跨城平均定位误差由 4.47 m 降至 1.86 m、朝向误差由 3.42° 降至 1.24°。

A Multi-view Landmark Representation Approach with Application to GNSS-Visual-Inertial Odometry Figure 1
arXiv preprint2025-08-07

A Multi-view Landmark Representation Approach with Application to GNSS-Visual-Inertial Odometry

Tong Hua, Jiale Han, Wei Ouyang

School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China (e-mail, College of Surveying and Geo-Informatics, Tongji University, Shanghai, 200092, China (

6D位姿估计相机位姿多视角

针对IEKF式视觉/惯性/GNSS融合中联合估计相机位姿与路标会带来状态维度膨胀、延迟更新和线性化误差的问题,本文提出多视角pose-only路标表示,将特征深度写成多帧位姿与观测的闭式函数,并构造不显式估计地图点的视觉量测模型。作者进一步分析其在不变滤波框架下的零空间与可观性,并用于GVIO特征管理;仿真和真实实验显示该方法在计算效率和定位精度上优于对比方案。

Pseudo Depth Meets Gaussian: A Feed-forward RGB SLAM Baseline Figure 1
arXiv preprint2025-08-06

Pseudo Depth Meets Gaussian: A Feed-forward RGB SLAM Baseline

Linqing Zhao, Xiuwei Xu, Yirui Wang, Hao Wang, Wenzhao Zheng, Yansong Tang, Haibin Yan, Jiwen Lu

Yansong Tang is with the Shenzhen International Graduate School, Tsinghua University, Shenzhen 518071, China

6D位姿估计相机位姿彩色深度高斯泼溅

本文面向无位姿 RGB 视频的在线实尺度三维重建,试图摆脱 RGB-D 传感器和测试时优化带来的速度瓶颈。核心洞察是伪深度虽细节不准,但 3D Gaussian 映射可通过可优化表示吸收其不确定性;同时用基于光流的前馈循环位姿预测和局部图渲染替代迭代跟踪。Replica、TUM-RGBD 与实机演示中,效果接近 SplaTAM,跟踪时间减少 90% 以上。

A Comprehensive Framework for Uncertainty Quantification of Voxel-wise Supervised Models in IVIM MRI Figure 1
arXiv preprint2025-08-07

A Comprehensive Framework for Uncertainty Quantification of Voxel-wise Supervised Models in IVIM MRI

Nicola Casali, Alessandro Brusaferri, Giuseppe Baselli, Stefano Fumagalli, Edoardo Micotti, Gianluigi Forloni, Riaz Hussein, Giovanna Rizzo, Alfonso Mastropietro

Department of Acute Brain and Cardiovascular Injury, \orgname, Department of Neuroscience, \orgname

6D位姿估计

该文针对 IVIM 扩散 MRI 参数反演病态、对噪声尤其灌注项敏感的问题,引入 Deep Ensembles 结合 Mixture Density Networks 做体素级监督拟合,同时分解偶然与认知不确定性。实验在合成与在体数据上比较传统/贝叶斯/高斯概率网络,MDN 对 D 和 f 给出更校准且更尖锐的分布,D* 仍略过度自信;在体认知不确定性升高揭示训练模拟与真实采集存在域差异。

One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion Figure 1
arXiv preprint2025-11-20

One Model for All: Unified Try-On and Try-Off in Any Pose via LLM-Inspired Bidirectional Tweedie Diffusion

Jinxi Liu, Zijian He, Guangrun Wang, Guanbin Li, Processing X-Era AI Lab @mail2.sysu.edu.cn, liguanbin@mail.sysu.edu.cn, linliang@ieee.org, wanggrun@gmail.com

Sun Yat-sen University Guangdong Key Laboratory of Big Data Analysis and Processing, X-Era AI Lab

6D位姿估计

针对虚拟试衣依赖干净服装图、分割掩码且难以改变姿态的问题,OMFA 将试穿与脱衣统一为潜空间目标补全任务,用双向 Tweedie Diffusion 选择性去噪,并引入 SMPL-X 姿态条件实现单图任意姿态、多视角生成。文中称在 VITON-HD 与 DeepFashion-Multimodal 上试穿/脱衣均达到 SOTA,但具体增益来源仍需结合消融进一步判断。

Surf3R: Rapid Surface Reconstruction from Sparse RGB Views in Seconds Figure 1
arXiv preprint2025-08-06

Surf3R: Rapid Surface Reconstruction from Sparse RGB Views in Seconds

Haodong Zhu, Changbai Li, Yangyang Ren, Zichao Feng, Xuhui Liu, Hanlin Chen, Xiantong Zhen, Baochang Zhang

6D位姿估计三维重建

Surf3R针对传统多视图重建依赖相机标定、SfM/MVS预处理耗时的问题,提出无需位姿估计的前馈稀疏RGB表面重建框架。其核心是多参考分支解码、跨视图注意与跨分支融合,并用基于3D Gaussian的D-Normal正则提升全局几何一致性和细节。实验在ScanNet++、Replica上取得SOTA或有竞争力结果,整场景重建低于10秒。

RiemanLine: Riemannian Manifold Representation of 3D Lines for Factor Graph Optimization Figure 1
the AAAI Conference on Artificial Intelligence 20262025-08-06

RiemanLine: Riemannian Manifold Representation of 3D Lines for Factor Graph Optimization

Yan Li, Ze Yang, Keisuke Tateno, Federico Tombari, Liang Zhao, Gim Hee Lee

National University of Singapore, Peking University, Google (United States), University of Edinburgh

6D位姿估计

针对线特征 SLAM/位姿优化中传统 3D 线表示难以紧凑表达平行结构、需额外约束的问题,RiemanLine 将线分解为共享消失方向与局部缩放法向量,在黎曼流形上统一表示单线和平行线组,并嵌入因子图 BA;在 ICL-NUIM、TartanAir 和合成数据上提升位姿估计与线重建精度,同时减少参数量并改善收敛稳定性。

Near-Field Spatial non-Stationary Channel Estimation: Visibility-Region-HMM-Aided Polar-Domain Simultaneous OMP Figure 1
arXiv preprint2025-08-06

Near-Field Spatial non-Stationary Channel Estimation: Visibility-Region-HMM-Aided Polar-Domain Simultaneous OMP

Thibaut Ceulemans, Cel Thys, Robbert Beerten, Zhuangzhuang Cui, KU Leuven, 3001 Leuven, Belgium Email: thibaut.ceulemans@student.kuleuven.be

Department of Electrical Engineering (ESAT), KU Leuven, Leuven, Belgium

6D位姿估计

面向ELAA近场信道中球面波传播与空间非平稳导致的估计失效问题,论文将非二值可见区域掩码引入物理信道模型,并提出VR-HMM-P-SOMP:在极域SOMP迭代中用HMM与Viterbi逐路径估计天线级可见区域,动态遮蔽导向向量。仿真显示其在低SNR和稀疏路径场景下较现有贪婪估计方法精度更高,同时保持较低复杂度。

Optimal Design of Broadband Absorbers with Multiple Plasmonic Nanoparticles via Reduced Basis Method Figure 1
arXiv preprint2025-08-06

Optimal Design of Broadband Absorbers with Multiple Plasmonic Nanoparticles via Reduced Basis Method

Yu Gao, Hai Zhang, Kai Zhang

Department of Mathematics, The Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong SAR, China, School of Mathematics, Jilin University, Changchun, China

6D位姿估计

面向纳米光吸收中多等离激元颗粒宽带设计的高成本与非凸优化难题,论文将形状参数化积分方程、基于 Neumann–Poincaré 算子特征函数的自适应降基模型,以及弱耦合物理初始化结合,避免显式形状导数并加速正/伴随求解。数值实验显示该框架能在多种几何配置下更高效、较准确地匹配目标吸收谱,但与机器人6D位姿估计关联不明显。

Radar-Based NLoS Pedestrian Localization for Darting-Out Scenarios Near Parked Vehicles with Camera-Assisted Point Cloud Interpretation Figure 1
arXiv preprint2025-08-06

Radar-Based NLoS Pedestrian Localization for Darting-Out Scenarios Near Parked Vehicles with Camera-Assisted Point Cloud Interpretation

Hee-Yeun Kim, Byeonggyu Park, Byonghyok Choi, Hansang Cho, Byungkwan Kim, Soomok Lee, Mingu Jeon, Seung-Woo Seo, Seong-Woo Kim

Seoul National University, Samsung Electro-Mechanics Co., Ltd, Chungnam National University

6D位姿估计点云

针对路侧停放车辆造成的非视距盲区中行人突然窜出的安全风险,论文提出用单目图像解析停车车辆并结合2D毫米波雷达点云的定位框架:先分割车辆、估计粗深度,再用雷达距离校正反射面并分析反射路径,从而定位被遮挡行人。真实城市道路实验显示该方法可提前发现行人并改善定位,但具体量化增益在给定片段中未充分说明。

OmniShape: Zero-Shot Multi-Hypothesis Shape and Pose Estimation in the Real World Figure 1
arXiv preprint2025-08-05

OmniShape: Zero-Shot Multi-Hypothesis Shape and Pose Estimation in the Real World

Katherine Liu, Sergey Zakharov, Dian Chen, Takuya Ikeda, Greg Shakhnarovich, Adrien Gaidon, Rares Ambrus

Toyota Research Institute, Los Altos, CA 94022, USA, Woven by Toyota, Chuo City, Tokyo 103-0022, Japan, Toyota Technological Institute at Chicago, Chicago, IL 60637, USA

6D位姿估计

OmniShape面向开放世界机器人感知中“单次观测、未知类别/模型”下形状与6D位姿同时不确定的问题。其核心是把联合估计拆成NORF中可见点/位姿对应分布与三平面神经场形状先验分布,并分别用条件扩散采样多假设。实验显示其在真实数据上可通过best-of-N提升几何精度,注册内点数也可辅助假设选择,但细节结构和真实噪声法线仍是弱点。

FPG-NAS: FLOPs-Aware Gated Differentiable Neural Architecture Search for Efficient 6DoF Pose Estimation Figure 1
arXiv preprint2025-08-05

FPG-NAS: FLOPs-Aware Gated Differentiable Neural Architecture Search for Efficient 6DoF Pose Estimation

Nassim Ali Ousalah1, Peyman Rostami1, Anis Kacem1, Enjie Ghorbel12 Emmanuel Koumandakis3 Djamila Aouada1

SnT, University of Luxembourg, Luxembourg, Cristal Lab, ENSI, Manouba University, Tunisia

6D位姿估计

面向受限算力下的单目6DoF位姿估计,FPG-NAS将可微NAS专门改造为关键点检测+PnP管线:构建包含轻量算子和可搜索多尺度融合的任务搜索空间,用门控替代单一argmax以保留多候选组合,并加入FLOPs正则约束。论文在LINEMOD和SPEED+上显示其搜索到的模型在严格FLOPs预算下优于既有手工轻量方法,但具体增益中门控、搜索空间与算力约束各自贡献仍需消融支撑。

Vision-based Perception System for Automated Delivery Robot-Pedestrians Interactions Figure 1
arXiv preprint2025-08-05

Vision-based Perception System for Automated Delivery Robot-Pedestrians Interactions

Ergi Tushe, Bilal Farooq Cite as: Tushe E, Farooq, Patras, Greece, October 2025

Laboratory of Innovations in Transportation (LiTrans) and Data Science Program, Toronto Metropolitan University

6D位姿估计机器人操作

面向配送机器人在人群密集街区中安全、合乎社会规范地通行,论文构建了单目视觉感知流水线,将行人检测与跟踪、人体姿态和单目深度结合,用预训练 YOLO、DeepSORT、Depth-Anything 在 MOT17 上验证。结果显示姿态与深度线索可改善遮挡和拥挤下的身份保持与轨迹判断,IDF1 最高提升约10%、MOTA 提升约7%,检测精度保持在85%以上,并可辅助识别弱势行人群体。

Semantic Mosaicing of Histo-Pathology Image Fragments using Visual Foundation Models Figure 1
arXiv preprint2025-08-05

Semantic Mosaicing of Histo-Pathology Image Fragments using Visual Foundation Models

Stefan Brandstätter, Maximilian Köller, Philipp Seeböck, Alissa Blessing, Felicitas Oberndorfer, Svitlana Pochepnia, Helmut Prosch, Georg Langs

Computational Imaging Research Lab, Christian Doppler Laboratory for Machine Learning Driven Precision Imaging, Comprehensive Center for Artificial Intelligence in Medicine, Department of Pathology, Medical University Vienna, Vienna, Austria

6D位姿估计

针对病理组织样本常被切成多片、传统依赖边界形状的拼接易受组织缺失、形变、染色差异和破损边缘影响的问题,论文提出 SemanticStitcher:沿碎片边界采样图像块,用病理视觉基础模型提取语义特征匹配相邻区域,再以 RANSAC 估计旋转和平移并迭代生成整张 WMS。三组病理数据实验显示,其在正确边界匹配和整体拼接鲁棒性上优于现有 PythoStitcher 等方法。

BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devices Figure 1
arXiv preprint2025-08-05

BaroPoser: Real-time Human Motion Tracking from IMUs and Barometers in Everyday Devices

Libo Zhang, Xinyu Yi, Feng Xu

School of Software and BNRist, Tsinghua University

6D位姿估计

针对日常手机/手表仅有稀疏 IMU 时难以恢复准确全身姿态、且多局限于平地运动的问题,BaroPoser 引入两设备内置气压计估计高度变化,并用大腿局部坐标系解耦局部姿态与全局运动。在公开基准和真实采集数据上,该方法相较相同硬件配置的纯 IMU SOTA 提升了姿态与全局平移估计,尤其有利于非平坦地形。

MVTOP: Multi-View Transformer-based Object Pose-Estimation Figure 1
arXiv preprint2025-08-05

MVTOP: Multi-View Transformer-based Object Pose-Estimation

Lukas Ranftl, Felix Brendel, Bertram Drost, Carsten Steger MVTec Software GmbH

MVTec Software GmbH, Technical University of Munich

6D位姿估计物体位姿多视角

MVTOP针对单视角或后融合多视角方法难以消除的6D位姿歧义,提出在Transformer中早期融合各视角RGB特征,并用相机内参与相对位姿生成的视线信息显式建模多视几何。方法端到端训练、无需深度,且视角顺序可变。论文还构建MV-ball数据集验证这类歧义,结果优于单视角和现有多视角方法,并在YCB-V上达到竞争性表现。

Monocular Depth Estimation with Global-Aware Discretization and Local Context Modeling Figure 1
arXiv preprint2025-08-05

Monocular Depth Estimation with Global-Aware Discretization and Local Context Modeling

PAGE 1, Heng Wu, Qian Zhang, Guixu Zhang

School of Computer Science and Technology, East China Normal University, Shanghai, China

6D位姿估计彩色深度

针对单目RGB恢复深度缺少几何先验、局部卷积或窗口注意力难以同时建模细节与全局结构的问题,论文在Swin Transformer式编码解码框架中加入门控大核注意力GLKAM以扩展多尺度感受野,并用GBPM预测全局深度bin来约束回归。在NYU-V2和KITTI上,方法在多项指标上优于近期基线,消融支持两个模块有效。

COFFEE: A Shadow-Resilient Real-Time Pose Estimator for Unknown Tumbling Asteroids using Sparse Neural Networks Figure 1
arXiv preprint2025-08-05

COFFEE: A Shadow-Resilient Real-Time Pose Estimator for Unknown Tumbling Asteroids using Sparse Neural Networks

Arion Zimmermann, Soon-Jo Chung, Electrical Engineering, EPFL, Lausanne, Switzerland Division of Engineering, Applied Science, Pasadena, USA

Department of Electronic and Electrical Engineering, EPFL, Lausanne, Switzerland, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, USA

6D位姿估计

面向翻滚小行星近距离自主导航,论文指出自投影阴影会随旋转漂移,导致传统特征匹配产生位姿偏置。COFFEE利用航天器太阳敏感器给出的太阳相位角,将显著轮廓与阴影关联,提取对阴影运动不敏感的稀疏关键点,并用稀疏CNN描述子和注意力GNN匹配。实验显示其在合成数据和Apophis渲染上较SIFT/ORB/AKAZE更准、位姿偏置更低,并比深度学习基线快至少3倍。

Bayesian Sensitivity Analyses for Policy Evaluation with Difference-in-Differences under Violations of Parallel Trends Figure 1
arXiv preprint2025-08-05

Bayesian Sensitivity Analyses for Policy Evaluation with Difference-in-Differences under Violations of Parallel Trends

Seong Woo Han, Nandita Mitra, Gary Hettinger, Arman Oganisian

Nandita Mitra

6D位姿估计

针对DiD政策评估中平行趋势常被预处理动态、外部冲击破坏的问题,本文将偏离程度显式建模为敏感性参数,并用含时间相关的AR(1)先验及固定、全贝叶斯、经验贝叶斯多种设定比较后验处理效应。费城含糖饮料税案例显示,不同先验下估计可系统检验结论稳健性,但与6D位姿估计无直接关联。

H(curl)-based approximation of the Stokes problem with weakly enforced no-slip boundary conditions Figure 1
arXiv preprint2025-08-04

H(curl)-based approximation of the Stokes problem with weakly enforced no-slip boundary conditions

Wietse M. Boon, Wouter Tonnon, Enrico Zampa

NORCE Norwegian Research Centre, Bergen 5008, Norway, SAM, ETH Zürich, CH-8092 Zürich, Switzerland, Department of Mathematics, University of Vienna, Vienna, Austria

6D位姿估计

本文面向保持结构的 Navier–Stokes 与磁流体离散中常用的 H(curl) 速度空间,研究 Stokes 流无滑移边界如何可靠施加。核心洞察是:即便切向迹在 H(curl) 中有定义,将无滑移作为强本质条件仍会导致离散问题不适定;因此提出 Nitsche 型弱施加方案,并给出稳定性与先验误差分析。数值实验验证了速度场的最优收敛阶,但其与 6D 位姿估计关联不明显。

PyCAT4: A Hierarchical Vision Transformer-based Framework for 3D Human Pose Estimation Figure 1
arXiv preprint2025-08-04

PyCAT4: A Hierarchical Vision Transformer-based Framework for 3D Human Pose Estimation

Zongyou Yang, Jonathan Loo, Yinghan Hou

6D位姿估计人体姿态

针对单帧3D人体姿态难以保持运动连续性、现有模型对时序与多尺度信息利用不足的问题,PyCAT4在PyMAF框架上引入坐标注意力、Swin Transformer骨干、FPN+ASPP多尺度融合及类PoseFormer的时序融合,并实现实时OpenCV演示。文中在COCO和3DPW上报告检测能力提升,但摘要未给出具体幅度,增益来源仍需依赖消融结果判断。

PMGS: Reconstruction of Projectile Motion Across Large Spatiotemporal Spans via 3D Gaussian Splatting Figure 1
the AAAI Conference on Artificial Intelligence 20262025-11-11

PMGS: Reconstruction of Projectile Motion Across Large Spatiotemporal Spans via 3D Gaussian Splatting

Yijun Xu, Jingrui Zhang, Yuhan Chen, Dingwen Wang, Lei Yu, Chu He

Wuhan University, Chongqing University

6D位姿估计三维重建高斯泼溅

PMGS针对高速抛射体在大时空跨度下易出现轨迹断裂、几何漂浮且缺少物理约束的问题,将动态场景分解为目标建模与逐帧SE(3)运动恢复,并把牛顿加速度一致性、基于运动状态的动态模拟退火和Kalman多源融合引入3D高斯泼溅优化。实验显示其在高速非线性刚体运动重建上优于主流动态重建方法。

InfoSyncNet: Information Synchronization Temporal Convolutional Network for Visual Speech Recognition Figure 1
arXiv preprint2025-08-04

InfoSyncNet: Information Synchronization Temporal Convolutional Network for Visual Speech Recognition

Junxiao Xue, Xiaozhen Liu, Xuecheng Wu, Fei Yu, Jun Wang

School of Cyber Science and Engineering, Zhengzhou University, Zhengzhou, Henan, China, School of Computer Science, and Technology, Xi’an Jiaotong University, Xi’an, Shaanxi, China, Research Center for Space, Zhejiang Lab, Hangzhou, Zhejiang, China

6D位姿估计

该文关注无声视频唇读中不同说话习惯、光照和视角导致的时序信息非均匀问题。InfoSyncNet在视觉编码器与时序解码器之间加入非均匀量化/注意力模块,使模型优先同步关键唇部帧,并结合Time Masking、Mixup等训练策略提升鲁棒性;在LRW和LRW1000上分别达到92.0%与60.7% Top-1准确率。

SGAD: Semantic and Geometric-aware Descriptor for Local Feature Matching Figure 1
arXiv preprint2025-08-09

SGAD: Semantic and Geometric-aware Descriptor for Local Feature Matching

Xiangzeng Liu, Chi Wang, Guanglu Shi, Xiaodong Zhang, Qiguang Miao

Xidian University

6D位姿估计

针对A2PM局部特征匹配中像素级比较和图匹配开销大、区域合并易引入错误的问题,SGAD用SAM提取区域、DINOv2语义特征叠加几何位置编码,并通过自/交叉注意力学习可直接匹配的区域描述子,配合分类+排序监督和HCRF去冗余。在室外/室内位姿估计中可替换多种点匹配器,较MESA运行时间从60.23s降至0.82s,SGAD+LoFTR也优于DKM,SGAD+ROMA提升AUC@5°。

Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes Figure 1
arXiv preprint2025-08-04

Unified Category-Level Object Detection and Pose Estimation from RGB Images using 3D Prototypes

Tom Fischer, Xiaojie Zhang : 1

Saarland University, University of Technology Nuremberg

6D位姿估计类别级位姿

针对类别级6D位姿估计中RGB-D依赖强、RGB方法多为检测与姿态分离两阶段且易受检测误差影响的问题,本文用神经网格作为类别3D原型,联合学习图像特征与网格特征,并通过2D/3D匹配、多模型RANSAC PnP及位姿细化在单一框架内同时完成多目标检测和位姿估计。在REAL275上,RGB-only类别级位姿的尺度无关指标平均较现有最佳提升22.9%,且对图像退化比两阶段基线更稳健。

YOLOv1 to YOLOv11: A Comprehensive Survey of Real-Time Object Detection Innovations and Challenges Figure 1
arXiv preprint2025-08-04

YOLOv1 to YOLOv11: A Comprehensive Survey of Real-Time Object Detection Innovations and Challenges

Manikanta Kotthapalli, Deepika Ravipati, Reshma Bhatia

6D位姿估计数据集/基准综述

面向机器人等低时延视觉场景中检测精度、速度与部署成本的权衡,本文梳理 YOLO 从 v1 到 v9 并简述 v10/v11 的演进,将创新归纳为 backbone、neck、检测头、损失/分配和训练策略五类。主要结果是对 VOC、COCO 等基准的 mAP/FPS 与边缘部署特性进行横向整理,并指出小目标、域偏移、anchor-free 稳定性和可解释性仍是瓶颈;标题声称覆盖 v11,但核心证据主要集中在 v1–v9。

StarPose: 3D Human Pose Estimation via Spatial-Temporal Autoregressive Diffusion Figure 1
arXiv preprint2025-08-09

StarPose: 3D Human Pose Estimation via Spatial-Temporal Autoregressive Diffusion

Haoxin Yang, Weihong Chen, Xuemiao Xu, Cheng Xu, Peng Xiao, Cuifeng Sun, Shaoyu Huang, Shengfeng He

6D位姿估计人体姿态

针对单目2D到3D人体姿态提升中的深度歧义、遮挡以及扩散方法忽视帧间连续性的问题,StarPose将姿态生成建模为自回归扩散过程,用HPIM融合历史3D预测与当前2D输入,并以可插拔STPG约束重投影、骨骼对称、骨长和运动变化。实验在Human3.6M与MPI-INF-3DHP上优于已有方法,提升精度与时间一致性,但严重遮挡下仍受上游2D检测质量限制。

CVD-SfM: A Cross-View Deep Front-end Structure-from-Motion System for Sparse Localization in Multi-Altitude Scenes Figure 1
arXiv preprint2025-08-03

CVD-SfM: A Cross-View Deep Front-end Structure-from-Motion System for Sparse Localization in Multi-Altitude Scenes

Yaxuan Li, Yewei Huang, Bijay Gaudel, Hamidreza Jafarnejadsani, Brendan Englot

Stevens Institute of Technology

6D位姿估计

针对地面、无人机与卫星等多高度稀疏图像重叠少、视角差异大导致传统 SfM 匹配和重建易失败的问题,CVD-SfM 在 SfM 前引入跨视角 Transformer,将卫星图像提供的几何先验用于3-DoF初始化与BA约束,并结合 DISK+LightGlue 深度前端实现地理参考6-DoF位姿估计。论文还发布两套多高度GPS真值数据集,实验显示其在精度、鲁棒性和覆盖率上优于传统SfM及现有方法。

IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognition Figure 1
arXiv preprint2025-08-03

IMUCoCo: Enabling Flexible On-Body IMU Placement for Human Pose Estimation and Activity Recognition

Haozhe Zhou, Riku Arakawa, Yuvraj Agarwal, Mayank Goel

Carnegie Mellon University

6D位姿估计人体姿态

本文针对现有 IMU 姿态估计依赖固定佩戴位置、换到衣袋/臂带/背部等位置就需重训的问题,提出 IMUCoCo:用传感器在人体表面的连续空间坐标,将可变数量、任意位置 IMU 信号映射到统一特征空间,并借助合成 IMU 与自监督学习建模身体运动的关节关联。实验显示其在常规和非常规佩戴位置上均能进行较准确的姿态估计,并支持按场景移动或推荐传感器位置。

ChairPose: Pressure-based Chair Morphology Grounded Sitting Pose Estimation through Simulation-Assisted Training Figure 1
arXiv preprint2025-08-03

ChairPose: Pressure-based Chair Morphology Grounded Sitting Pose Estimation through Simulation-Assisted Training

Lala Shakti Swarup Ray, Vitor Fortes Rey, Bo Zhou, Paul Lukowicz, Sungho Suh

Korea University

6D位姿估计

针对久坐健康监测中摄像头易遮挡/涉隐私、可穿戴设备不舒适且难部署的问题,ChairPose用可铺在不同椅子上的薄压力传感垫估计全身坐姿,并将椅子形态显式纳入两阶段生成模型,配合物理仿真扩增提升跨人跨椅泛化。在8名用户、4种椅子实验中,用户和椅子均未见时MPJPE为89.4 mm。

A Simple Algebraic Solution for Estimating the Pose of a Camera from Planar Point Features Figure 1
arXiv preprint2025-08-03

A Simple Algebraic Solution for Estimating the Pose of a Camera from Planar Point Features

Tarek Bouazza I3S, CNRS, France bouazza@i3s.unice.fr, Tarek Hamel I3S, Université Côte d’Azur, Insitut Universitaire de France Sophia Antipolis, France thamel@i3s.unice.fr, Claude Samson INRIA Sophia Antipolis, I3S Sophia Antipolis, France csamson@i3s.unice.fr

Centre National de la Recherche Scientifique

6D位姿估计

针对机器人/无人机在平面标靶上进行相机位姿估计时,通用 PnP 对共面点易退化或噪声敏感的问题,论文提出按“平面法向—位置与距离—姿态”逐级恢复的代数解,并用平滑平均增强法向估计稳定性。实验中该方法相对 EPnP 和 LM 在远距离时姿态噪声更小、位置 RMSE 最低,姿态精度总体相近。

Towards Zero-Shot Terrain Traversability Estimation: Challenges and Opportunities Figure 1
arXiv preprint2025-08-03

Towards Zero-Shot Terrain Traversability Estimation: Challenges and Opportunities

Ida Germann, Mark O. Mints, Peer Neubert

the Intelligent Autonomous Systems Group, Institute of Computational Visualisitics, University of Koblenz, Germany

6D位姿估计数据集/基准

面向非结构化环境中仅凭几何或固定语义规则难以判断水坑等地形可通行性的痛点,论文构建195张图、508个机器人相关标注的水域可通行性小基准,并用分割实例加VLM提示生成代价图的零样本流程分析问题本身。结果显示人类虽有主观分歧但存在一定共识,而LLaVA、MiniCPM-V和GPT-4o表现不稳定,最高类F1约0.51,尚不适合实际部署。

No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views Figure 1
arXiv preprint2025-08-02

No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Views

Ranran Huang, Krystian Mikolajczyk Imperial College London @imperial.ac.uk

Imperial College London

6D位姿估计三维重建高斯泼溅

稀疏视角三维重建常依赖 SfM 或训练时真值位姿,遇到低重叠、无标注数据时成本高且不稳。SPFSplat 的核心是用共享骨干在规范空间内一次前向同时预测 3D Gaussian 与相机位姿,并用估计位姿的渲染损失结合像素重投影约束,缓解位姿误差与几何学习的相互放大。论文报告其在无位姿监督下的新视角合成达到 SOTA,并在相对位姿估计上超过使用几何先验监督的方法。

R-Index: A Robust Metric for IVIM Parameter Estimation on Clinical MRI Scanners Figure 1
arXiv preprint2025-08-01

R-Index: A Robust Metric for IVIM Parameter Estimation on Clinical MRI Scanners

I. Introduction

6D位姿估计

这篇论文关注临床低 SNR MRI 下 IVIM 双指数模型参数拟合不稳定、重复性差的问题,核心洞察是 f 与 Dt 等参数存在强共线性,单独解释易受噪声扰动。作者提出将相关参数线性组合为 R-index,以抵消共线性并降低估计方差;在 SNR=20 仿真中其标准差为 0.064,低于单个归一化参数的 0.107–0.269,志愿者重复扫描也观察到显著负相关。

Biorthogonal Neural Network Approach to Two-Dimensional Non-Hermitian Systems Figure 1
arXiv preprint2025-08-01

Biorthogonal Neural Network Approach to Two-Dimensional Non-Hermitian Systems

Massimo Solinas, Brandon Barton, Yuxuan Zhang, Jannes Nys, Juan Carrasquilla

Institute for Theoretical Physics, ETH Zürich, 8093, Switzerland, Vector Institute, W1140-College Street, Schwartz Reisman Innovation Campus Toronto, Ontario M5G 0C6, Canada

6D位姿估计

这篇论文实际关注非厄米二维量子多体系统,而非6D位姿估计;动机是传统VMC/DMRG等方法难以处理复能谱、非正交本征态和例外点。作者提出尊重左右本征态双正交结构的神经网络波函数与自洽方差最小化优化,并结合对称性和伪厄米性。在二维非厄米横场Ising模型上,方法在PT对称与破缺相中均取得高精度,并在标准变分优化失效区域保持较可靠收敛。

Deep Learning-Based Rate-Adaptive CSI Feedback for Wideband XL-MIMO Systems in the Near-Field Domain Figure 1
arXiv preprint2025-08-01

Deep Learning-Based Rate-Adaptive CSI Feedback for Wideband XL-MIMO Systems in the Near-Field Domain

Zhenyu Liu, Yi Ma, Rahim Tafazolli 6GIC, Guildford, GU2 7XH Emails: (zhenyu.liu, y.ma, r.tafazolli)@surrey.ac.uk

GIC, Institute for Communication Systems, University of Surrey, Guildford, UK, GU2 XH

6D位姿估计

面向6G宽带近场XL-MIMO中CSI维度高、球面波传播和波束分裂导致反馈压缩困难的问题,论文提出WideNLNet-CA:用轻量级多尺度编码器—解码器提取信道结构,并通过按目标压缩率调制的特征重要性模块实现单模型变码率反馈。仿真显示其在不同压缩率和带宽下优于压缩感知及既有深度方法,同时保持较低存储与较快推理;结果仍主要基于仿真验证。

GeoMoE: Divide-and-Conquer Motion Field Modeling with Mixture-of-Experts for Two-View Geometry Figure 1
arXiv preprint2025-08-01

GeoMoE: Divide-and-Conquer Motion Field Modeling with Mixture-of-Experts for Two-View Geometry

Jiajun Le, Jiayi Ma

6D位姿估计

GeoMoE针对复杂场景中视角、尺度和深度突变导致的异质运动场,认为统一平滑/一致性建模会混淆不同运动模式。其核心是用内点概率先验将运动场软分解为结构一致的子场,再通过空间与通道双路径增强,并由MoE路由到专门专家做细粒度校正。实验显示其在相对位姿与单应估计上超过已有方法,并具备较好泛化性。

CoProU-VO: Combining Projected Uncertainty for End-to-End Unsupervised Monocular Visual Odometry Figure 1
Lecture notes in computer science2025-08-01

CoProU-VO: Combining Projected Uncertainty for End-to-End Unsupervised Monocular Visual Odometry

Jingchao Xie, Oussema Dhaouadi, Weirong Chen Johannes Meier, Jacques Kaiser, Daniel Cremers

Munich Center for Machine Learning

6D位姿估计相机位姿

该工作针对无监督单目视觉里程计在动态物体、遮挡和非静态一致性破坏下位姿易漂移的问题,提出 CoProU-VO:将目标帧不确定性与投影到目标帧的参考帧不确定性按概率形式融合,用跨帧传播生成更可靠的训练掩码,并结合 ViT/DepthAnything 特征联合学习深度、不确定性和相机位姿。KITTI 与 nuScenes 实验显示其优于既有端到端两帧无监督方法,在高速公路等动态场景更稳健,消融验证主要增益来自跨帧不确定性传播。

Text-Attributed Graph Anomaly Detection via Multi-Scale Cross- and Uni-Modal Contrastive Learning Figure 1
arXiv preprint2025-08-01

Text-Attributed Graph Anomaly Detection via Multi-Scale Cross- and Uni-Modal Contrastive Learning

Yiming Xu, Xu Hua, Zhen Peng, Bin Shi, Jiarun Chen, Xingbo Fu, Song Wang, Bo Dong

School of Computer Science and Technology, Xi’an Jiaotong University, Shaanxi Provincial Key Laboratory of Big Data Knowledge Engineering, Xi’an Jiaotong University, School of Distance Education, Xi’an Jiaotong University, University of Virginia

6D位姿估计

该文针对文本属性图异常检测中“先用浅层文本特征、再做图域检测”导致文本表示与异常目标脱节的问题,提出 CMUCL,以语言模型和 GNN 端到端联合编码原始文本与拓扑,并通过跨模态、单模态多尺度对比一致性挖掘异常不一致性。作者还发布 8 个 TAGAD 数据集;在 11 个基线对比中平均 AUC 提升 4.68%、AP 提升 11.13%。

Effect of Matter Accretion on Lithium Enhancement of Giants Figure 1
arXiv preprint2025-08-01

Effect of Matter Accretion on Lithium Enhancement of Giants

Xue-Feng Li, Jian-Rong Shi, Yan Li, Hong-Liang Yan, Jing-Hua Zhang, Fei Guo

University of Chinese Academy of Sciences, CAS Key Laboratory of Optical Astronomy, National Astronomical Observatories, Beijing 100101, China, University of Chinese Academy of Sciences, Beijing 100049, China, Center for Astronomical Mega-Science, Chinese Academy of Sciences, Beijing 100012, China, Institute for Frontiers in Astronomy and Astrophysics, Beijing Normal University, Beijing 102206, China, South-Western Institute for Astronomy Research, Yunnan University, Chenggong District, Kunming 650500, China, Yunnan Normal University, Kunming 650500, China

6D位姿估计

论文针对低质量红巨星异常富锂成因,检验“吸积周星物质增质量”是否能解释表面锂保留。作者用 MESA 从主序转折演化到红巨支顶端,显式加入吸积与质量损失,并区分吸积质量和锂丰度的作用。结果显示,富锂吸积物可减弱首次 dredge-up 的稀释,增质量也会降低对流包底温度、抑制锂耗尽,弱吸积可使锂丰度上限约达 2.5 dex,但所需质量增量在真实天体环境中可能难以实现。

Unlocking New Paths for Science with Extreme-Mass-Ratio Inspirals: Machine Learning-Enhanced MCMC for Accurate Parameter Inversion Figure 1
arXiv preprint2025-08-26

Unlocking New Paths for Science with Extreme-Mass-Ratio Inspirals: Machine Learning-Enhanced MCMC for Accurate Parameter Inversion

Bo Liang, Chang Liu, Hanlin Song, Zhenwei Lyu, Minghui Du, Peng Xu, Ziren Luo, Sensen He, Haohao Gu, Tianyu Zhao, Manjia Liang, Yuxiang Xu, Li-e Qiang, Mingming Sun, Wei-Liang Qian

Taiji Laboratory for Gravitational Wave Universe (Beijing/Hangzhou), University of Chinese Academy of Sciences (UCAS), Beijing 100049, China, National Space Science Center, Chinese Academy of Sciences, Beijing 100190, China, School of Physics, Peking University, Beijing 100871, China, Leicester International Institute, Dalian University of Technology, Panjin 124221, China, Lanzhou Center of Theoretical Physics, Lanzhou University, Lanzhou 730000, China, Center for Gravitational Wave Experiment, National Microgravity Laboratory, Institute of Mechanics, Chinese Academy of Sciences, Beijing 100190, China, Key Laboratory of Gravitational Wave Precision Measurement of Zhejiang Province, Hangzhou Institute for Advanced Study, UCAS, Hangzhou 310024, China, AGI Lab, Beijing Institute of Mathematical Sciences and Applications, Beijing, China

6D位姿估计

针对EMRI引力波参数反演中似然面高维、多峰且受仪器噪声干扰,传统MCMC易陷入局部极值并产生偏差的问题,论文提出FM-MCMC,将连续归一化流用于快速定位高似然区域,再以并行温度MCMC精细采样。实验在Taiji类噪声注入信号上显示,SNR>60时可将真实内禀参数恢复到1σ可信区间,而常规PTMCMC在宽先验初始化下出现显著偏差。

AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer Figure 1
arXiv preprint2025-11-15

AniMer+: Unified Pose and Shape Estimation Across Mammalia and Aves via Family-Aware Transformer

Liang An, Jin Lyu, Li Lin, Pujin Cheng, Yebin Liu, Xiaoying Tang

6D位姿估计

本文针对跨物种动物单目姿态与形状恢复中模型容量不足、鸟类等3D标注稀缺的问题,提出 AniMer+:在高容量 ViT 中引入按哺乳类/鸟类划分的 MoE 专家与共享层,并用扩散式条件生成构建 CtrlAni3D、CtrlAVES3D 合成3D数据。结合真实与合成数据训练后,方法在哺乳类、鸟类及 Animal Kingdom 等域外基准上优于既有方法,消融表明架构与数据均有贡献。

Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localization Figure 1
arXiv preprint2025-08-26

Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localization

Maxime Pietrantoni, Gabriela Csurka, Torsten Sattler

Czech Technical University in Prague

6D位姿估计相机位姿三维重建高斯泼溅

面向云端视觉定位中图像特征可能泄露隐私的问题,论文将3D Gaussian Splatting的显式几何与隐式特征场结合为GSFF,通过自监督对比学习对齐2D编码器和尺度感知3D特征,并利用3D结构聚类把特征量化为分割标签以支持隐私保护的位姿细化。实验在多个真实数据集上显示,特征版和分割版定位均优于相关隐私与非隐私方法。

3D-MOOD: Lifting 2D to 3D for Monocular Open-Set Object Detection Figure 1
arXiv preprint2025-07-31

3D-MOOD: Lifting 2D to 3D for Monocular Open-Set Object Detection

Yung-Hsu Yang, Luigi Piccinelli, Mattia Segu, Siyuan Li, Rui Huang, Yuqian Fu, Marc Pollefeys, Hermann Blum, Zuria Bauer

ETH Zürich Tsinghua University INSAIT, Sofia University Microsoft University of Bonn

6D位姿估计

针对单目3D检测通常依赖封闭类别与同域场景、难以服务机器人在新环境中识别新物体的问题,3D-MOOD将开放集2D检测通过可微3D框头提升到3D,并用相机内参、深度先验生成几何感知查询,配合规范化图像空间缓解跨数据集尺度与内参差异。实验在Omni3D闭集及Omni3D到Argoverse 2、ScanNet开放集迁移中均达到新的SOTA,显示其开放类别与跨场景泛化能力。

Online Estimation of Table-Top Grown Strawberry Mass in Field Conditions with Occlusions Figure 1
arXiv preprint2025-07-31

Online Estimation of Table-Top Grown Strawberry Mass in Field Conditions with Occlusions

Jinshan Zhen, 2 1 ^ { ^ } start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT start_FLOATSUPERSCRIPT, 2 end_FLOATSUPERSCRIPT, Yuanyue Ge, Tiaoxiao Zhu, 3 1 ^ { ^ } start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT start_FLOATSUPERSCRIPT, 3 end_FLOATSUPERSCRIPT, Hui Zhao, Ya Xiong

Beijing Academy of Agricultural and Forestry Sciences, Tianjin University of Science and Technology

6D位姿估计

面向采摘机器人在田间遮挡和姿态变化下难以无损、在线估计桌面栽培草莓质量的问题,论文将RGB-D感知、YOLOv8-Seg分割、CycleGAN遮挡补全和倾角校正结合,用几何投影特征回归质量。实验中无遮挡与遮挡样本平均误差分别为8.11%和10.47%,且CycleGAN在遮挡恢复上明显优于LaMa。

Mitigating Resolution-Drift in Federated Learning: Case of Keypoint Detection Figure 1
arXiv preprint2025-07-31

Mitigating Resolution-Drift in Federated Learning: Case of Keypoint Detection

Taeheon Lim, Joohyung Lee, Kyungjae Lee, Jungchan Cho

6D位姿估计

面向边端联邦学习中的关键点/高分辨率回归任务,论文指出不同客户端图像分辨率会引发不同于类别非IID的“resolution-drift”,导致全局模型偏向特定分辨率。作者提出RAF,用高分辨率热图作为教师、低分辨率输出作学生进行多分辨率知识蒸馏,并结合卷积式位置嵌入以适配ViT多尺度输入。实验和理论分析显示该方法可缓解漂移、提升人体姿态估计性能,并能接入现有FL框架。

FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Models Figure 1
arXiv preprint2025-11-12

FASTopoWM: Fast-Slow Lane Segment Topology Reasoning with Latent World Models

Yiming Yang, Hongbin Lin, Yueru Luo, Suzhong Fu, Chao Zheng &Xinrui Yan, Shuqi Mei, Kun Tang, Shuguang Cui, Zhen Li FNii, CUHK-Shenzhen, SSE, T Lab, Tencent @cuhk.edu.cn

FNii, CUHK-Shenzhen SSE, CUHK-Shenzhen 3 T Lab, Tencent

6D位姿估计

针对车道拓扑推理中单帧方法缺乏时序一致性、流式方法过度依赖历史查询且易受位姿估计失败影响的问题,FASTopoWM构建快慢双通路:快分支保障单帧可用性,慢分支利用时序信息,并通过统一监督历史与新初始化查询、引入基于动作潜变量的Query/BEV潜在世界模型增强传播。在OpenLane-V2上,车道段检测mAP从33.6%提升至37.4%,中心线OLS从41.5%提升至46.3%。

A Certifably Correct Algorithm for Generalized Robot-World and Hand-Eye Calibration Figure 1
arXiv preprint2025-07-30

A Certifably Correct Algorithm for Generalized Robot-World and Hand-Eye Calibration

Emmett Wise affiliationmark, Pushyami Kaveti affiliationmark, Qilong Cheng affiliationmark, Wenhao Wang affiliationmark, Hanumant Singh affiliationmark, Jonathan Kelly affiliationmark, David M. Rosen affiliationmark, and Matthew Giamou affiliationmark

Space & Terrestrial Autonomous Robotic Systems Laboratory, University of Toronto Institute for Aerospace Studies, Toronto, ON, Canada, Institute for Experiential Robotics, Northeastern University, Boston, MA, USA, Autonomous Robotics and Convex Optimization Laboratory, McMaster University, Hamilton, ON, Canada

6D位姿估计手部姿态机器人操作

针对多传感器机器人外参标定依赖人工经验、易陷入局部最优且错误会破坏下游感知的问题,本文将广义机器人-世界/手眼标定建模为可经 SDP 松弛求解的 QCQP,支持多传感器、多目标及单目尺度不确定情形,并给出可辨识性条件和低噪声下全局最优可认证保证。仿真与真实实验显示其较局部优化和双四元数方法更稳健准确,代码已开源。

Prediction of Significant Creatinine Elevation in First ICU Stays with Vancomycin Use: A retrospective study through Catboost Figure 1
arXiv preprint2025-07-30

Prediction of Significant Creatinine Elevation in First ICU Stays with Vancomycin Use: A retrospective study through Catboost

Junyi Fan, Li Sun, Shu‐Heng Chen, Yong Si, Minoo Ahmadi, Greg Placencia, Elham Pishgar, Kamiar Alaei, Maryam Pishgar

6D位姿估计

针对 ICU 万古霉素用药后肾损伤难以及早识别的问题,本文在 MIMIC-IV 1万余例首次 ICU 住院患者上,以给药后肌酐时序变化按 KDIGO 定义结局,避免既有 AKI 标签的时间泄漏;再用两阶段特征筛选、CatBoost 与 SHAP/ALE/贝叶斯不确定性进行可解释风险预测。结果显示 CatBoost AUROC 为0.818,阴性预测值0.900,磷、胆红素、镁及共病/严重度评分是主要预测因子。

Wall Shear Stress Estimation in Abdominal Aortic Aneurysms: Towards Generalisable Neural Surrogate Models Figure 1
arXiv preprint2025-07-30

Wall Shear Stress Estimation in Abdominal Aortic Aneurysms: Towards Generalisable Neural Surrogate Models

Patryk Rygiel, Julian Suk, Christoph Brune, Kak Khee Yeung, Jelmer M. Wolterink

6D位姿估计

该文针对腹主动脉瘤血流 CFD 计算耗时、限制临床使用的问题,提出基于 LaB-GATr 的 E(3) 等变几何深度学习代理模型,用投影几何代数和稳健几何描述符直接在血管壁网格上估计瞬态壁面剪切应力。模型在100例训练、118例外部测试上验证,能较好泛化到边界条件变化、病程导致的形变、未见过的分支拓扑和不同网格分辨率;但 OSI 等高频/湍流相关指标仍偏平滑,表明表面监督存在局限。

Ambiguity-Aware Segmented Estimation of Mutual Coupling in Large RIS: Algorithm and Experimental Validation Figure 1
IEEE Transactions on Communications2025-07-30

Ambiguity-Aware Segmented Estimation of Mutual Coupling in Large RIS: Algorithm and Experimental Validation

Philipp del Hougne

Centre National de la Recherche Scientifique

6D位姿估计

面向大规模 RIS 中互耦参数随单元数二次增长、且远程估计存在不可消除歧义的问题,论文提出歧义感知的分段估计:先标定一组及负载,再用重叠组对齐其余组,最后并行估计组间互耦。100 单元 RIS 实验中,5867 参数模型达到 40.5 dB 精度,显著优于弱/无互耦模型;但互耦感知对最终优化性能提升有限,主要改善模型预测可靠性。

A Dual-Feature Extractor Framework for Accurate Back Depth and Spine Morphology Estimation from Monocular RGB Images Figure 1
arXiv preprint2025-07-30

A Dual-Feature Extractor Framework for Accurate Back Depth and Spine Morphology Estimation from Monocular RGB Images

Yuxin Wei, Yue Zhang, Moxin Zhao, Chang Liang Shi, Jason Pui Yin Cheung, Teng Zhang, Nan Meng

University of Hong Kong

6D位姿估计彩色深度

针对青少年特发性脊柱侧弯筛查中 X 光有辐射且设备受限、单目 RGB 又缺乏稳定几何信息的问题,本文提出 GAMA-Net 从裸背 RGB 图像估计细微背部深度,并将其与表面纹理共同用于脊柱形态重建。核心是双编码器分别建模局部 patch 与全局特征,经 PBHA 交互,再用 AMFF 自适应多尺度融合。实验中深度估计三项指标约达 78.2%、93.6%、97.5%,融合深度后的脊柱曲线生成最高约 97%。

Quantum Krylov Subspace Diagonalization via Time Reversal Symmetries Figure 1
arXiv preprint2025-07-30

Quantum Krylov Subspace Diagonalization via Time Reversal Symmetries

Nicola Mariella, Enrique Rico, Adam Byrne, Sergiy Zhuk

IBM Quantum, IBM Research Europe, Trinity Business School, Dublin, D02 F6N2 (Ireland), DIPC - Donostia International Physics Center, Paseo Manuel de Lardizabal 4, San Sebastián, Spain, European Organization for Nuclear Research (CERN), Theoretical Physics Department, CH-Geneva, Switzerland, School of Mathematics, Trinity College Dublin, Ireland

6D位姿估计

针对近端量子硬件中 Krylov 量子对角化依赖受控演化、线路深度高的问题,本文提出 Krylov Time Reversal,利用哈密顿量时间反演对称性和对称时间演化恢复实值 Krylov 矩阵元,从而减少受控操作与总演化时间。数值实验在横场 Ising 模型和格点规范理论上显示其谱估计与标准 KQD、DMRG 接近,但与仓库“6D 位姿估计”分类不匹配。

Towards Practical Quantum Phase Estimation: A Modular, Scalable, and Adaptive Approach Figure 1
arXiv preprint2025-11-15

Towards Practical Quantum Phase Estimation: A Modular, Scalable, and Adaptive Approach

Alok Shukla, Prakash Vedula

6D位姿估计

针对标准量子相位估计在NISQ设备上需要大量相干辅助量子位、深电路且迭代法易误差传播的问题,论文提出AWQPE:用多个小窗口并行估计多位相位,并以LSB到MSB的经典歧义消解修正边界结果。数值模拟显示其在精度、鲁棒性与资源/运行时间之间取得更实用折中;但该文与6D位姿估计分类不匹配。

From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras Figure 1
arXiv preprint2025-07-30

From Sharp to Blur: Unsupervised Domain Adaptation for 2D Human Pose Estimation Under Extreme Motion Blur Using Event Cameras

Youngho Kim, Hoonhee Cho, Kuk-Jin Yoon KAIST @kaist.ac.kr

KAIST

6D位姿估计人体姿态事件相机仿真到现实

针对快速运动和低光导致的严重运动模糊会使在清晰图像上训练的人体姿态模型失效,论文用事件相机的高时间分辨率运动信息作为“桥梁”,生成运动感知的模糊增强样本,并结合图像/事件双模态教师与学生-教师伪标签迭代、互不确定性掩码来做无监督域适应。实验显示该方法优于常规域适应基线,在无目标域标注下接近使用目标域标注训练的 oracle 表现。

UAVScenes: A Multi-Modal Dataset for UAVs Figure 1
ICCV 20252025-07-30

UAVScenes: A Multi-Modal Dataset for UAVs

Sijie Wang, Siqi Li, Yawei Zhang, Shangshu Yu, Shenghai Yuan, Rui She, Quanjiang Guo, JinXuan Zheng, Ong Kang Howe, Leonrich Chandra, Shrivarshann Srijeyan, Aditya Sivadas, Toshan Aggarwal, Heyuan Liu, Hongming Zhang, Chujie Chen, Junyu Jiang, Lihua Xie, Wee Peng Tay

Nanyang Technological University, School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China, Beihang University, University of Electronic Science and Technology of China

6D位姿估计数据集/基准航天器

面向无人机在低空城市任务中需要实时、多模态场景理解,而现有数据集多偏向相机、SLAM或仅地图级标注,UAVScenes在MARS-LVIG基础上补充逐帧图像与LiDAR语义标注、精确6-DoF位姿和重建地图。数据规模超过12万帧,并对分割、深度估计、6DoF定位、地点识别和新视角合成等至少六类任务建立基准。

Resilient State Recovery using Prior Measurement Support Information Figure 1
arXiv preprint2025-07-30

Resilient State Recovery using Prior Measurement Support Information

Yu Zheng, Olugbenga Moses Anubi, Warren E. Dixon

Department of Electrical and Computer Engineering, Florida State University, Tallahassee, FL 32310, USA, Department of Mechanical and Aerospace Engineering, University of Florida, Gainesville FL, 32611-6250, USA

6D位姿估计

面向网络物理/机器人感知中传感器被稀疏攻击导致的状态恢复失效问题,本文将恢复视为纠错,并引入由数据驱动得到的受攻击测量支撑先验,在加权ℓ1观测器中调节疑似攻击通道权重。核心洞察是建立先验精度、权重设计与可恢复攻击比例/估计误差之间的解析关系,从而突破传统少于50%测量节点受损的保守限制;数值仿真和一个应用案例验证了理论趋势,但具体到6D位姿任务的实验增益文中未充分说明。

PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstruction Figure 1
arXiv preprint2025-07-29

PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstruction

Jiahui Ren, Mochu Xiang : 1, Jiajun Zhu, Yuchao Dai School of Electronics, Information, Processing, Xi’an, Shaanxi, China

School of Electronics and Information, Northwestern Polytechnical University and, Shaanxi Key Laboratory of Information Acquisition and Processing, Xi’an, Shaanxi, China

6D位姿估计三维重建

针对现有宽基线全景重建依赖精确相机位姿、在真实场景中易受位姿获取成本和噪声限制的问题,PanoSplatt3R将透视图像领域的基础重建预训练迁移到全景域,并用RoPE rolling建模全景图水平周期性,再结合Gaussian Splatting生成新视角。实验显示其在无位姿输入下仍优于依赖位姿的现有方法,提升新视角合成质量和深度估计精度。

Divergence and Model Adequacy, A Semiparametric Case Study Figure 1
arXiv preprint2025-07-29

Divergence and Model Adequacy, A Semiparametric Case Study

Michel Broniatowski, Justin Steward Moutsouka

6D位姿估计

这篇论文关注半参数矩约束模型中,散度最小化推断何时既有数学上的良定性、又能给出一致估计。核心洞察是把“模型—推断方法适配性”形式化为投影问题可解与参数估计一致两项条件,并在光滑密度假设下讨论 L2、KL 及幂散度的适用边界。主要结果是给出散度选择与模型正则性之间的条件化刻画,并用简短仿真作说明;与 6D 位姿估计的关联文中未充分说明。

The impact of large-scale EV charging on the real-time operation of distribution systems: A comprehensive review Figure 1
arXiv preprint2025-07-29

The impact of large-scale EV charging on the real-time operation of distribution systems: A comprehensive review

Zhe Yu, Chuang Yang, Qin Wang

6D位姿估计

面向电动车大规模接入导致配电网实时运行不确定性上升的问题,本文综述了无序充电对电压、谐波、过载、稳定性与成本的影响,并将缓解路径归纳为智能充电、能量协同、车网互动和辅助服务。核心洞察是把 EV 从扰动源转化为可控负荷/储能资源;主要结果是梳理了实时状态估计与充电管理框架,但文中未充分说明统一量化增益。

Adaptive Prior Scene-Object SLAM for Dynamic Environments Figure 1
arXiv preprint2025-07-29

Adaptive Prior Scene-Object SLAM for Dynamic Environments

Haolan Zhang, Thanh Nguyen Canh, Chenghao Li, Nak Young Chong

Japan Advanced Institute of Science and Technology

6D位姿估计相机位姿

针对动态物体和突发视角变化使传统视觉 SLAM 产生定位漂移的问题,本文在 ORB-SLAM3 上引入场景-对象可靠性评估:结合目标置信度、空间分布、特征与深度质量,并相对可靠参考帧自适应更新基准;当帧不可靠时,再利用可靠帧信息做直接法位姿细化。TUM RGB-D 实验显示其在动态场景下提高了相机定位精度和系统鲁棒性。

Regression Analysis of Reciprocity in Directed Networks Figure 1
arXiv preprint2025-07-29

Regression Analysis of Reciprocity in Directed Networks

PAGE 1, Rui Feng∗

6D位姿估计

针对有向网络中互惠关系常受节点/二元协变量影响、但传统 p1 类模型难以同时处理稀疏性、节点异质性和高维干扰参数的问题,本文提出 R2-Model,将互惠强度建模为基线项加协变量回归项,并通过条件似然消去出入度异质性参数。理论上给出一致性、渐近正态性和 minimax 最优性,仿真与两个真实网络应用显示估计在有限样本下较稳健。

Event-Based De-Snowing for Autonomous Driving Figure 1
arXiv preprint2025-07-25

Event-Based De-Snowing for Autonomous Driving

Manasi Muglikar, Nico Messikommer, Marco Cannici, Davide Scaramuzza

6D位姿估计事件相机

本文面向自动驾驶中大雪遮挡导致图像去雪依赖幻觉补全、视频方法受帧率和对齐限制的问题,引入事件相机的微秒级时序信息。核心洞察是雪花在事件时空体中形成稳定条纹,方法用注意力沿条纹判断背景点的遮挡与显露,并融合图像恢复强度;同时构建含同步图像/事件与真值的 DSEC-Snow。实验显示重建 PSNR 较现有去雪方法提升约 3 dB,并使深度、光流等下游任务性能提升约 20%。

PixelNav: Towards Model-based Vision-Only Navigation with Topological Graphs Figure 1
arXiv preprint2025-07-28

PixelNav: Towards Model-based Vision-Only Navigation with Topological Graphs

Technology, Sber Robotics Center Moscow sergey.bakulin@skoltech.ru, Technology Moscow timur.akhtyamov@skoltech.ru, Technology Moscow denis.fatykhoph@skoltech.ru, Technology Moscow german.devchich@skoltech.ru, Technology Moscow g.ferrer@skoltech.ru

Skolkovo Institute of Science and Technology, Sber Robotics Center, Skolkovo Institute of Science and Technology

6D位姿估计

针对端到端视觉导航依赖大量数据且可解释性、可认证性不足的问题,PixelNav将拓扑图作为稀疏环境表示,结合VPR重定位、姿态估计、可通行区域分割与MPC,在像素空间选择子目标并构造控制代价。真实机器人实验显示其性能接近主流端到端模型,并能应对拓扑图中未出现的新障碍;具体量化增益和消融贡献文中片段未充分说明。

Uncertainty-aware Planning with Inaccurate Models for Robotized Liquid Handling Figure 1
arXiv preprint2025-07-28

Uncertainty-aware Planning with Inaccurate Models for Robotized Liquid Handling

Marco Faroni, Carlo Odesco, Andrea M. Zanchettin, Paolo Rocco

6D位姿估计手部姿态机器人操作

针对液体倾倒等机器人操作中模型由少量示教或仿真迁移导致预测不准的问题,论文将高斯过程方差等模型认知不确定性嵌入 MCTS,在搜索时偏向低不确定性的状态—动作转移,而非追求更精细流体建模。实验表明,在仅约 5 个训练点的倾倒模型下仍能保持较高成功率,基线随模型变差明显退化;但更复杂容器和完整运动规划仍待验证。

Beyond Line-of-Sight: Cooperative Localization Using Vision and V2X Communication Figure 1
arXiv preprint2025-07-28

Beyond Line-of-Sight: Cooperative Localization Using Vision and V2X Communication

Annika Wong, Zhiqi Tang, Frank J. Jiang, Karl Henrik Johansson, Jonas Mårtensson

KTH Royal Institute of Technology

6D位姿估计

面向城市路口等 GNSS 不可靠且遮挡频繁的车联网场景,论文将视觉方位观测与 V2X 邻车位姿通信结合,提出可在车辆自身相机坐标系下工作的分布式观测器,同时估计多车位置与朝向,并扩展 BPE 条件到更实际的视场受限情形。作者证明在最小可观条件下估计误差局部指数稳定,并通过 1/10 实车与大规模仿真验证遮挡下的鲁棒性和可扩展性。

KASportsFormer: Kinematic Anatomy Enhanced Transformer for 3D Human Pose Estimation on Short Sports Scene Video Figure 1
arXiv preprint2025-07-28

KASportsFormer: Kinematic Anatomy Enhanced Transformer for 3D Human Pose Estimation on Short Sports Scene Video

Zhuoer Yin, Calvin Yeung, Tomohiro Suzuki, Ryota Tanaka, Keisuke Fujii

Nagoya University

6D位姿估计人体姿态

该文针对单目3D人体姿态在体育短视频中易受高速运动、遮挡、域偏移及关键动作持续帧数少影响的问题,提出KASportsFormer。核心思路是在时空Transformer中显式引入运动解剖先验,用BoneExt提取骨骼方向与长度,再由LimbFus聚合为肢体token并进行多模态交互,以增强短时动作理解。在SportsPose和WorldPose上分别达到58.0mm、34.3mm MPJPE,报告为SOTA。

Higher regularity in nonlocal free boundary problems Figure 1
arXiv preprint2025-07-28

Higher regularity in nonlocal free boundary problems

PAGE 1, BEGO˜NA BARRIOS, XAVIER ROS-OTON, AND MARVIN WEIDNER

6D位姿估计

本文并非6D位姿估计论文,而是研究非局部自由边界问题中边界光滑性的数学工作。动机是回答非局部 Bernoulli/一相问题与 Poisson 核光滑性是否能推出自由边界更高正则。核心创新是建立新的分部积分公式、带局部 Neumann 条件的边界 Hölder 估计和 Liouville 工具。主要结果证明一般2s阶积分微分算子下,C^{2,α}自由边界可提升为C∞,并给出过定问题与障碍问题的相应高正则结论。

Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Features Figure 1
arXiv preprint2025-07-28

Automated 3D-GS Registration and Fusion via Skeleton Alignment and Gaussian-Adaptive Features

Shiyang Liu, Dianyi Yang, Yu Gao, Bohan Ren, Yi Yang, Mengyin Fu

School of Automation, Beijing Institute of Technology, Beijing, China

6D位姿估计高斯泼溅

针对多视角机器人建图中多个 3D-GS 子图仍依赖人工选模板、点云配准且硬阈值融合易丢细节的问题,论文提出自动化框架:先抽取几何骨架并用高斯骨架距离初始化/优化配准,再以椭球感知的 Gaussian-Adaptive 卷积利用协方差、不透明度等属性,最后用多因子评分选择高斯元融合。在 ScanNet-GSReg 和 Coord 上,复杂场景 RRE 降低 41.9%,融合 PSNR 提升 10.11 dB。

PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks Figure 1
arXiv preprint2025-07-27

PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks

Clinton Ansun Mo, Kun Hu, Chengjiang Long, Dong Yuan, Wan-Chi Siu, Zhiyong Wang School of Computer Science, NSW 2006, Bunkyo City, Tokyo, Japan School of Science, WA 6027, Australia Meta Reality Labs, Burlingame, Hong Kong, China clinton.mo@weblab.t.u-tokyo.ac.jp, k.hu@ecu.edu.au, clong1@meta.com @sydney.edu.au, enwcsiu@polyu.edu.hk

School of Computer Science, The University of Sydney, NSW 2006, Australia, The University of Tokyo, Bunkyo City, Tokyo, Japan, School of Science, Edith Cowan University, WA 6027, Australia, Meta Reality Labs, Burlingame, CA, USA, Hong Kong Polytechnic University, Hong Kong, China

6D位姿估计

针对不同角色骨架结构和比例不一致导致运动合成难以跨骨架复用的问题,PUMPS将人体运动转为时间点云表征,并用两阶段预训练学习骨架无关的潜空间;其关键在于用高斯噪声作为点身份采样标识、配合线性分配重建,避免昂贵点级时空注意力。实验显示其在预测、过渡和关键帧插值等运动补全任务达到或接近SOTA,并可微调到去噪与2D到3D估计。

Circuit simulation of readout process toward large-scale superconducting quantum circuits Figure 1
arXiv preprint2025-07-27

Circuit simulation of readout process toward large-scale superconducting quantum circuits

Tetsufumi Tanamoto, Hiroshi Fuketa, Toyofumi Ishikawa, Shiro Kawabata

Department of Data Science, Teikyo University, National Institute of Advanced Industrial Science and Technology (AIST), Tsukuba, Hosei University

6D位姿估计

面向超导量子芯片扩展到上万乃至更多量子位时器件参数波动会显著影响读出保真度的问题,本文将 transmon 读出结构简化为 LCR 电路,并用 SPICE 结合 Bloch–Redfield 退相干与保真度公式做早期粗粒度评估。结果显示普通笔记本可在数分钟模拟 1000 量子位、约 2 小时模拟 10000 量子位,并分析电容、电阻等工艺偏差对保真度的影响;实验校准与真实增益仍文中未充分说明。

ModShift: Model Privacy via Designed Shifts Figure 1
arXiv preprint2025-07-26

ModShift: Model Privacy via Designed Shifts

Nomaan A. Kherani, Urbashi Mitra

University of Southern California, Urbashi Mitra

6D位姿估计

该文针对联邦学习中所有客户端—服务器链路均被窃听时,全局模型可由更新反推出的问题。核心思路是把窃听者的学习视为参数估计,设计客户端更新的模型偏移并通过秘密信道告知服务器,使其费舍尔信息矩阵趋于奇异,同时不破坏 FedAvg 收敛。实验显示,相比加噪方案,该方法带来更大的模型偏移、通过篡改检测测试,并减少秘密信道带宽需求。

A Structure-aware and Motion-adaptive Framework for 3D Human Pose Estimation with Mamba Figure 1
arXiv preprint2025-07-26

A Structure-aware and Motion-adaptive Framework for 3D Human Pose Estimation with Mamba

Ye Lu, Jie Wang, Jianjun Gao, Rui Gong, Chen Cai, Kim-Hui Yap

Nanyang Technological University Beijing Institute of Technology

6D位姿估计人体姿态

针对现有 Mamba 2D-to-3D 人体姿态提升方法将骨架展平成序列、且对各关节运动一视同仁的问题,本文提出 SAMA:用 SSI 将可学习骨架拓扑和全局关节关系注入特征与状态空间,用 MSM 按关节局部运动调节状态时间尺度。在 Human3.6M 与 MPI-INF-3DHP 等基准上,方法以更少参数和 MACs 超过既有 SOTA,消融显示两个模块具备一定泛化性。

A Bayesian Additive Regression Trees Model for zero and one inflated data for Predicting Individual Treatment Effects in Alcohol Use Disorder Trials Figure 1
arXiv preprint2025-07-26

A Bayesian Additive Regression Trees Model for zero and one inflated data for Predicting Individual Treatment Effects in Alcohol Use Disorder Trials

Pamela Solano, M Lee Van Horn, Kyle Walters, Philipp Besendorfer, Alena Kuhlemeier, Manel Martínez-Ramón, Thomas Jaki

Faculty for Informatics and Data Science, Regensburg University, Germany, University of New Mexico, USA, MRC Biostatistics Unit, University of Cambridge, UK

6D位姿估计

针对酒精使用障碍试验中个体疗效差异大、重饮天数比例同时在0和1处集中而难以建模的问题,论文提出HOBZ-BART,用序贯hurdle将戒酒、部分饮酒和持续重饮分解,并以共享BART捕捉非线性协变量—治疗交互。仿真和Project MATCH分析显示,其较传统ZOIB在预测、计算效率和个体治疗效应估计上更优,可比较CBT、MET、TSF的个性化适配。

Asymptotic behavior of the spectral radius of locally constant strongly irreducible cocycles Figure 1
International Mathematics Research Notices2025-07-25

Asymptotic behavior of the spectral radius of locally constant strongly irreducible cocycles

Nicolás Martínez Ramos

Pennsylvania State University

6D位姿估计

本文关注随机矩阵/线性 cocycle 中谱半径增长率何时不只满足 limsup,而能几乎处处收敛到最高 Lyapunov 指数这一问题,回应 Markov 随机乘积情形的条件缺口。核心在于为有限型子移位上的局部常值强不可约 cocycle 建立适用的大偏差估计,并引入适配非独立情形的强不可约定义。主要结果证明在最高指数有间隙,或所有外幂 cocycle 强不可约时,谱半径的指数增长率几乎处处收敛到最高 Lyapunov 指数。

Efficient Lines Detection for Robot Soccer Figure 1
arXiv preprint2025-07-25

Efficient Lines Detection for Robot Soccer

João G. Melo, João P. Mafaldo, Edna Barros

6D位姿估计机器人操作

面向机器人足球中低算力平台的实时自定位需求,论文针对场地线/边界检测在精度与速度间的矛盾,提出在 ELSED 线段检测后加入基于 RGB 绿到白颜色梯度相似度的场地线分类,并用少量标注样本通过 PSO 自动校准阈值。实验显示其精度接近 YOEO 等深度模型,但在低功耗设备上处理速度更快,且更易适配比赛环境。

Fast Learning of Non-Cooperative Spacecraft 3D Models through Primitive Initialization Figure 1
arXiv preprint2025-07-25

Fast Learning of Non-Cooperative Spacecraft 3D Models through Primitive Initialization

Pol Francesch Huc, Emily Bates : 1, and Simone D’Amico

PhD Candidate, Department of Aeronautics and Astronautics, Stanford University, Stanford, CA, Associate Professor, Department of Aeronautics and Astronautics, Stanford University, Stanford, CA

6D位姿估计航天器

面向非合作航天器近距离交会中单目重建需已知位姿且3DGS训练开销过高的问题,本文用CNN从单张图像预测粗粒度基元装配和相对位姿,并以此初始化3D Gaussian Splatting,支持噪声或隐式位姿监督。SPE3R实验表明,该初始化可将所需训练迭代和输入图像至少降低一个数量级,仍能学习较高保真的航天器3D表示。

Distributions of wide binary stars in theory and in Gaia data: II. Reconstruction of sample probability density of true orbit sizes Figure 1
The Astronomical Journal2025-07-25

Distributions of wide binary stars in theory and in Gaia data: II. Reconstruction of sample probability density of true orbit sizes

Valeri V. Makarov

6D位姿估计三维重建

本文针对 Gaia 宽双星目录只能观测投影分离、而弱引力检验更关心真实半长轴分布的问题,构建从观测分离反推轨道尺度概率密度的逆重建框架。核心做法是结合偏心率、取向和相位的统计投影,用直接 Monte Carlo 映射与无正则脉冲更新反滤波两条路线交叉验证。结果显示极宽轨道尾部分布在对数尺度上仅缓慢下降,并暗示极宽双星仍有有限存活率。

Untriangular factorization of holomorpic symplectic matrices Figure 1
arXiv preprint2025-07-25

Untriangular factorization of holomorpic symplectic matrices

Gaofeng Huang, Frank Kutzschebauch, Phan Quoc Bao Tran

University of Bern

6D位姿估计

尽管仓库标为6D位姿估计,论文实际研究复几何/K理论中的辛矩阵分解问题,动机是为Stein空间上全纯辛矩阵的幺三角分解给出可控因子数。核心做法是改用反对角辛形式并结合Oka原理与分层椭圆子沉浸,证明任意全纯辛矩阵可分解,且该形式下的幺三角因子至多由7个标准辛形式幺三角因子表示,从而解决HKS22问题并给出因子数估计。

A Fast and Light-weight Non-Iterative Visual Odometry with RGB-D Cameras Figure 1
arXiv preprint2025-07-25

A Fast and Light-weight Non-Iterative Visual Odometry with RGB-D Cameras

Zheng Yang : 1, Kuan Xu : 2, Shenghai Yuan : 3, Lihua Xie : 4

School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore

6D位姿估计相机位姿点云彩色深度

针对传统 RGB-D 视觉里程计依赖特征提取、匹配和迭代优化导致算力开销大、低纹理场景易退化的问题,论文提出 NIDEVO:利用连续帧重叠平面法向量非迭代估计旋转,再用 KCC 估计平移,实现旋转/平移解耦。实验显示其在低端 i5 CPU 上可达 71Hz,并在低纹理环境中优于若干 SOTA 方法。

Neural Correction Operator: A Reliable and Fast Approach for Electrical Impedance Tomography Figure 1
arXiv preprint2025-07-25

Neural Correction Operator: A Reliable and Fast Approach for Electrical Impedance Tomography

are listed in alphabetical order

Amit Bhat

6D位姿估计

针对 EIT 从边界电压/电流恢复电导率时高度病态、直接神经算子学习不稳定的问题,论文将逆映射拆成“少步 L-BFGS 粗重建 + 神经校正”两阶段,并用 CNN/条件扩散实现校正器。多个仿真数据集显示其重建质量优于长迭代 L-BFGS 和同架构直接学习方法,对噪声更稳且推理更快,但与 6D 位姿主题关联不明显。

Diffusion-FS: Multimodal Free-Space Prediction via Diffusion for Autonomous Driving Figure 1
arXiv preprint2025-07-24

Diffusion-FS: Multimodal Free-Space Prediction via Diffusion for Autonomous Driving

Keshav Gupta, Tejas S. Stanley, Pranjal Paul, Arun K. Singh, K. Madhava Krishna

Robotics Research Center, IIIT-Hyderabad, India, The University of Tartu, Estonia

6D位姿估计

本文针对自动驾驶中可通行走廊而非整片道路区域的预测问题,动机是摆脱依赖 BEV、障碍物精确定位和密集标注的传统设定。核心做法是用未来自车轨迹与前视图像自监督生成走廊样本,并提出 ContourDiff 在轮廓点空间进行扩散去噪,以建模多模态可导航区域。实验在 nuScenes 与 CARLA 上显示其能生成更结构化、可解释且安全的多候选行驶走廊。

Towards Scalable Spatial Intelligence via 2D-to-3D Data Lifting Figure 1
arXiv preprint2025-07-24

Towards Scalable Spatial Intelligence via 2D-to-3D Data Lifting

Xingyu, Miao, Haoran, Duan, Quanhao, Qian, Jiuniu, Wang, Yang, Long, Ling, Shao, Deli, Zhao, Ran, DAMO Academy, Alibaba Group, UCAS-Terminus AI Lab 🖂, Co-corresponding Author, Project Lead

Durham University, DAMO Academy, Alibaba Group, Tsinghua University, UCAS-Terminus AI Lab

6D位姿估计

针对机器人与空间智能缺少大规模真实3D数据、传感采集昂贵且仿真存在域差的问题,论文提出将单张2D图像经深度估计、相机与尺度标定提升为点云、位姿、深度和伪RGB-D的流水线,并从COCO、Objects365生成约200万真实外观的3D场景。实验显示这些数据可提升3D分割、指代表达分割、3D问答与密集描述等任务,增益可能主要来自大规模数据扩展。

Unposed 3DGS Reconstruction with Probabilistic Procrustes Mapping Figure 1
arXiv preprint2025-07-24

Unposed 3DGS Reconstruction with Probabilistic Procrustes Mapping

Chong Cheng, Zijian Wang, Sicheng Yu, Yu Hu, Nanjie Yao, Technology (Guangzhou) @connect.hkust-gz.edu.cn yusch@mail2.sysu.edu.cn, nanjiey@uci.edu, haowang@hkust-gz.edu.cn

The Hong Kong University of Science and Technology (Guangzhou)

6D位姿估计三维重建高斯泼溅

面向数百张无位姿户外图像的3DGS重建,论文针对MVS/前馈方法随视角增多出现显存瓶颈、尺度不一致和配准漂移的问题,采用分组重建再全局合并的思路,将子地图对齐建模为带不确定性剔除的概率Procrustes映射,并结合置信锚点初始化与3DGS-位姿联合优化。在Waymo、KITTI上报告了更好的重建质量和轨迹精度,达到无位姿3DGS重建的新SOTA。

Towards Large Scale Geostatistical Methane Monitoring with Part-based Object Detection Figure 1
arXiv preprint2025-07-24

Towards Large Scale Geostatistical Methane Monitoring with Part-based Object Detection

Adhemar de Senneville, Xavier Bou, Thibaud Ehret, Rafael Grompone Jean-Louis Bonne, Nicolas Dumelie, Thomas Lauvaux, Gabriele Facciolo Université Paris-Saclay, CNRS, ENS Paris-Saclay, Centre Borelli, France AMIAD, Pole Recherche, France Université de Reims Champagne-Ardenne

Université Paris-Saclay, CNRS, ENS Paris-Saclay, Centre Borelli, France

6D位姿估计

针对小型甲烷排放源难以被现有遥感直接测量、官方清单易缺漏的问题,论文以法国沼气消化设施为对象,构建含部件标注的大规模卫星数据集,并用部件式检测与概率后处理、难负样本挖掘提升大范围稀有目标检出精度。模型能在未见区域发现未登记设施,SPOT 1.5m 被认为是性能与效率折中,并进一步估计区域甲烷产量。

INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data Figure 1
arXiv preprint2025-07-24

INLA-RF: A Hybrid Modeling Strategy for Spatio-Temporal Environmental Data

Mario Figueira, Michela Cameletti, Luca Patelli

6D位姿估计

针对传统时空地统计模型难以刻画环境数据中的非线性、变量交互和突变,而机器学习又缺少可解释不确定性的矛盾,论文提出 INLA-RF,将 INLA-SPDE 潜高斯模型与随机森林迭代耦合,并通过残差反馈、不确定性传播及 KLD 停止准则控制更新。两组仿真和空气污染案例显示,该方法在非线性关系或时间不连续场景下优于单独 INLA 或 RF,同时保留较一致的不确定性估计;与仓库的 6D 位姿分类关联不明显。

NLML-HPE: Head Pose Estimation with Limited Data via Manifold Learning Figure 1
arXiv preprint2025-07-24

NLML-HPE: Head Pose Estimation with Limited Data via Manifold Learning

Mahdi Ghafourian, Federico M. Sukno

Department of Engineering, Universitat Pompeu Fabra, Spain

6D位姿估计

针对头部姿态数据标注噪声大、完整姿态组合稀缺且传统流形优化推理慢的问题,NLML-HPE将人脸关键点的yaw/pitch/roll通过Tucker分解拆到独立低维子空间,并用轻量编码器加三个MLP头直接回归角度;作者还由FaceScape三维头模渲染姿态一致训练集。实验在BIWI和AFLW2000上报告达到实时推理和接近或优于现有精度,但增益可能部分来自合成数据的精确标注与分布设计。

HumanMaterial: Human Material Estimation from a Single Image via Progressive Training Figure 1
arXiv preprint2025-07-24

HumanMaterial: Human Material Estimation from a Single Image via Progressive Training

Yu Jiang, Jiahao Xia, Jiongming Qin, Yusen Wang, Tuo Cao, Chunxia Xiao

School of Computer Science, Wuhan University, Wuhan, China (e-mail

6D位姿估计

该文针对单张全身人像反演 PBR 材质时多材质图约束不足、皮肤渲染不真实的问题,构建含位移与次表面散射的 OpenHumanBRDF 数据集,并提出 HumanMaterial:用三个先验模型分阶段估计不同材质图,再联合微调;CPR 损失通过控制非优化材质突出当前监督信号。实验显示其在合成与真实数据上优于已有方法,可支持重光照和材质编辑。

State of Health Estimation of Batteries Using a Time-Informed Dynamic Sequence-Inverted Transformer Figure 1
arXiv preprint2025-11-17

State of Health Estimation of Batteries Using a Time-Informed Dynamic Sequence-Inverted Transformer

Janak M. Patel Applied Research, Quantiphi Marlborough, MA 01752, USA janak.patel@quantiphi.com, Milad Ramezankhani Applied Research, USA milad.ramezankhani@quantiphi.com, Anirudh Deodhar Applied Research, USA anirudh.deodhar@quantiphi.com, Dagnachew Birru Applied Research, USA dagnachew.birru@quantiphi.com

Applied Research, Quantiphi

6D位姿估计

针对真实电池放电数据采样间隔不均、循环长度变化导致传统特征提取或截断丢失时序信息的问题,论文提出 TIDSIT,在倒置 Transformer 中结合连续时间嵌入、变量嵌入和带掩码的时间注意力,直接处理完整多变量放电序列。NASA 数据集上其预测误差较基线降低超过 50%,SoH 误差低于 0.58%,但跨数据集与实际工况泛化仍需更多验证。

AF-RLIO: Adaptive Fusion of Radar-LiDAR-Inertial Information for Robust Odometry in Challenging Environments Figure 1
arXiv preprint2025-07-24

AF-RLIO: Adaptive Fusion of Radar-LiDAR-Inertial Information for Robust Odometry in Challenging Environments

Chenglong Qian, Yang Xu, Xiufang Shi, Jiming Chen, Liang Li

College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China

6D位姿估计相机位姿点云

针对烟雾、隧道等场景中 LiDAR 退化、GPS 异常导致里程计不稳的问题,AF-RLIO以 IMU 为中心自适应选择雷达或激光点云进行 IESKF 紧耦合,并用雷达辅助动态点剔除与 GPS 外点检测,在后端按权重融合 GPS。多数据集和实机实验显示其在烟雾、相似几何和室内外切换中比现有方法更稳健。

PS-GS: Gaussian Splatting for Multi-View Photometric Stereo Figure 1
Computers & Graphics2025-07-24

PS-GS: Gaussian Splatting for Multi-View Photometric Stereo

Yixiao Chen, Bin Liang, Hanzhi Guo, Yongqing Cheng, Jiayi Zhao, Dongdong Weng

Beijing Institute of Technology, China Guangzhou Analysis and Testing Center, Beijing Research Institute of Mechanical and Electrical Technology

6D位姿估计多视角三维重建高斯泼溅

PS-GS针对多视角光度立体中的逆渲染精度与效率难以兼顾的问题,将2D Gaussian Splatting作为显式几何初始化,并在完整物理渲染方程下联合优化几何、材质和光照;其关键在于用未标定光度立体法线约束表面细节,并用适配单向光的2D高斯光线追踪约束入射光。合成与真实实验显示,该方法在重建质量、重光照和编辑任务上优于既有MVPS逆渲染方法,且训练时间和显存更低,稀疏5视角下仍能保持较好结果。

Autonomous UAV Navigation for Search and Rescue Missions Using Computer Vision and Convolutional Neural Networks Figure 1
Mechanisms and machine science2025-07-24

Autonomous UAV Navigation for Search and Rescue Missions Using Computer Vision and Convolutional Neural Networks

Luka Šiktar, Branimir Ćaran, Bojan Šekoranja, Marko Švaco

University of Zagreb

6D位姿估计航天器

面向搜救中降低人员风险、让无人机自动发现并跟随目标,论文将ROS2下的YOLOv11行人检测、dlib人脸识别与YOLOv11-pose人体关键点跟踪结合,并用IMU数据辨识DJI Tello动力学、调参三个PD控制器以保持相对距离和视角。室内外实验显示系统可实时运行,检测约30Hz、姿态约15Hz、控制15Hz,但受Wi‑Fi丢帧和光照限制,受试者数量表述前后不完全一致。

Modular Robot and Landmark Localisation Using Relative Bearing Measurements Figure 1
arXiv preprint2025-07-24

Modular Robot and Landmark Localisation Using Relative Bearing Measurements

Behzad Zamani, Jochen Trumpf, Chris Manzie

University of Melbourne

6D位姿估计机器人操作

面向SLAM、协同定位等由多个子系统组成的机器人系统,论文关注联合滤波状态维度大、模块维护困难且跨相关难跟踪的问题。其核心是把非线性最小二乘滤波模块化,并用协方差交集避免估计信息在有环通信中被重复计数,应用到SE(2)机器人与地标的相对方位定位。随机仿真显示,该方法相对单体联合滤波在精度与通信/计算开销间形成可调权衡,降带宽变体性能可平滑退化。

Emotion Recognition from Skeleton Data: A Comprehensive Survey Figure 1
arXiv preprint2025-07-24

Emotion Recognition from Skeleton Data: A Comprehensive Survey

Haifeng Lu, Jiuyi Chen, Zhen Zhang, Ruida Liu, Runhao Zeng, Xiping Hu

Shenzhen MSU-BIT University

6D位姿估计综述

针对表情、语音和生理信号在隐私、接触式采集与远距离感知上的限制,本文系统梳理基于2D/3D骨架的情绪识别。核心洞察是将姿态与步态统一为同源骨架数据下的时序差异问题,并按Traditional、Feat2Net、FeatFusionNet、End2EndNet归纳方法。结果显示公开数据集上深度时空建模,尤其GCN及注意力/多尺度变体表现突出,步态数据集上已有方法报告超过90%准确率,但跨数据集泛化、标注一致性与小样本问题仍未充分解决。

RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction Figure 1
arXiv preprint2025-07-23

RemixFusion: Residual-based Mixed Representation for Large-scale Online RGB-D Reconstruction

Yuqing Lan, Chenyang Zhu, Shuaifeng Zhi, Jiazhao Zhang, Zhoufeng Wang, Renjiao Yi, Yijie Wang, Kai Xu

National Key Laboratory of Parallel and Distributed Computing, National University of Defense Technology, Peking University, National University of Defense Technology and Xiangjiang Laboratory

6D位姿估计点云彩色深度三维重建

面向大规模在线 RGB-D 重建中显式 TSDF 费内存、纯隐式表示细节不足且训练慢的问题,RemixFusion 用粗 TSDF 网格承载低频结构、神经模块学习高频残差,并将残差思想扩展到 BA 中只优化位姿变化,配合自适应梯度放大和局部移动体提升收敛与效率。实验显示其在大场景建图质量和相机跟踪精度上优于显式或隐式 SOTA,且相对纯隐式方法帧率更高。

Physics-based Human Pose Estimation from a Single Moving RGB Camera Figure 1
arXiv preprint2025-07-23

Physics-based Human Pose Estimation from a Single Moving RGB Camera

Ayce Idil Aytekin, Chuqiao Li, Diogo Luvizon, Rishabh Dabral, Martin Oswald Marc Habermann

Max Planck Institute for Informatics, University of Tübingen, University of Amsterdam

6D位姿估计人体姿态

本文针对单目人体姿态在相机运动、非平坦场景中易产生抖动、穿模和脱离地面的痛点,提出含真实动态相机轨迹、场景几何、全局人体运动与接触标注的 MoviCam 基准,并用 4DHumans+DROID-SLAM 初始化,再以场景感知物理优化器细化 PhysDynPose。实验显示现有方法在该设定下明显失效,本文能更稳健地恢复世界坐标下的人体与相机位姿。

Toward a Real-Time Framework for Accurate Monocular 3D Human Pose Estimation with Geometric Priors Figure 1
arXiv preprint2025-07-21

Toward a Real-Time Framework for Accurate Monocular 3D Human Pose Estimation with Geometric Priors

Mohamed Adjel

6D位姿估计人体姿态

针对单目3D人体姿态在实时场景中因深度歧义、标注稀缺和模型过重而难以上边缘设备的问题,本文提出用实时2D关键点检测加几何感知2D-to-3D lifting,并显式注入相机内参和个体骨段长度等先验;训练侧通过受限IK和SKEL生物力学模型清洗MoCap/合成数据,再模拟透视视角生成2D-3D对,并用轻量Transformer回归3D姿态。论文更像框架提案,文中未充分说明定量实验结果或实际速度精度增益。

Adaptive Relative Pose Estimation Framework with Dual Noise Tuning for Safe Approaching Maneuvers Figure 1
arXiv preprint2025-07-22

Adaptive Relative Pose Estimation Framework with Dual Noise Tuning for Safe Approaching Maneuvers

Murat Berke Oktay, Simone Servadio

6D位姿估计相机位姿

面向失效卫星主动清除中的安全接近,论文针对单目视觉角点检测噪声、遮挡和未建模机动导致的相对位姿不稳定问题,将CNN角点观测与UKF融合,并在线联合调节测量噪声R和过程噪声Q,另引入带深度偏置建模的合成LiDAR辅助。ENVISAT高保真仿真和蒙特卡洛结果显示,该方法在测量中断等场景下较既有方法和变分贝叶斯调噪更稳、更准且计算效率更高。

TONUS: Neuromorphic human pose estimation for artistic sound co-creation Figure 1
arXiv preprint2025-07-21

TONUS: Neuromorphic human pose estimation for artistic sound co-creation

1 Jules Lecomte, 2 Konrad Zinner, 3 Michael Neumeier, 4 Axel von Arnim

6D位姿估计人体姿态

面向艺术装置中的自然人机交互,TONUS用事件相机与脉冲神经网络做人体姿态估计,将身体关节与神经活动映射到声音和灯光反馈。核心创新是设计可适配 Loihi 2 的多头HPE编码器,并结合自采数据与卡尔曼滤波提升交互稳定性。结果显示其精度低于部分SOTA,但运算量、稀疏性和硬件可移植性更优,已完成声音装置原型;实时全芯片部署仍受I/O和解码层限制。

Dense-depth map guided deep Lidar-Visual Odometry with Sparse Point Clouds and Images Figure 1
arXiv preprint2025-07-21

Dense-depth map guided deep Lidar-Visual Odometry with Sparse Point Clouds and Images

Junying Huang, Ao Xu, Dongyong Sun Yuanfeng Wang, Qi Qin

6D位姿估计相机位姿点云彩色深度

针对纯视觉里程计易受尺度、光照和遮挡影响,纯 LiDAR 又受稀疏点云和噪声限制的问题,论文提出 D3LVO:先用深度补全从稀疏点云与图像生成稠密深度,再以 RGB-D、多尺度注意力、深度感知光流和层级位姿细化联合估计相机运动。在 KITTI 里程计上,其精度和鲁棒性达到或超过多种视觉/激光里程计方法,但实时性与跨场景泛化仍需更多说明。

3-Dimensional CryoEM Pose Estimation and Shift Correction Pipeline Figure 1
arXiv preprint2025-07-20

3-Dimensional CryoEM Pose Estimation and Shift Correction Pipeline

Bombay Mumbai, India

Indian Institute of Technology, Bombay

6D位姿估计

针对低信噪比 cryo-EM 粒子图像中姿态与平移误差会放大三维重建失真的问题,论文将公共线几何与 MDS 表示结合,提出基于 ℓ1 鲁棒目标的联合旋转轴/面内向量优化,并用投影坐标下降严格满足单位范数与正交约束;同时通过全局最小二乘迭代校正面内位移。实验在合成与真实数据上显示其欧拉角误差更低、FSC 重建质量优于若干公共线/同步基线,但极端噪声下公共线可靠性仍是限制。

An Evaluation of DUSt3R/MASt3R/VGGT 3D Reconstruction on Photogrammetric Aerial Blocks Figure 1
arXiv preprint2025-07-20

An Evaluation of DUSt3R/MASt3R/VGGT 3D Reconstruction on Photogrammetric Aerial Blocks

Xinyi, Landgraf, Steven, Ulrich, Markus, Qin, Rongjun

aGeospatial Data Analytics Lab, The Ohio State University, Columbus, OH, USA, bDepartment of Civil, Environmental and Geodetic Engineering, The Ohio State University, Columbus, OH, USA, cDepartment of Electrical and Computer Engineering, The Ohio State University, Columbus, OH, USA, dInstitute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology, Karlsruhe, Germany, eTranslational Data Analytics Institute, The Ohio State University, Columbus, OH, USA

6D位姿估计三维重建航天器

针对 DUSt3R、MASt3R、VGGT 在航空摄影测量影像块中是否能替代传统 SfM/MVS 尚不清楚的问题,论文在 UseGeo 数据集上系统评估位姿估计与稠密重建。核心洞察是,这类预训练 Transformer 更适合作为极稀疏、低分辨率输入下的补充工具:少于 10 张、最长边 518 像素图像时点云精度和完整性较 COLMAP 最高提升约 50%,其中 VGGT 在速度、可扩展性和相机位姿稳定性上更优;但在高分辨率、大规模或几何复杂场景中可靠性明显下降,仍难取代标准高重叠摄影测量流程。

AI-Enhanced Precision in Sport Taekwondo: Increasing Fairness, Speed, and Trust in Competition (FST.ai) Figure 1
arXiv preprint2025-07-22

AI-Enhanced Precision in Sport Taekwondo: Increasing Fairness, Speed, and Trust in Competition (FST.ai)

Dr. Keivan Shariatmadar Luxembourg Referee Chair, Fraunhofer IZFP

Luxembourg Referee Chair, htw Saar University of Applied Science, Fraunhofer IZFP, htw Saar University of Applied Science, Fraunhofer IZFP

6D位姿估计

针对跆拳道头部踢击判罚依赖人工回放、易受视角与主观影响且常造成约90秒延迟的问题,FST.ai将姿态估计、时序动作识别、冲击分析与边缘推理结合,在保留裁判最终确认的前提下自动识别头踢、区分旋转动作并给出3/5分建议。论文称决策可由分钟级缩短到数秒级、提升一致性与透明度,但检测精度、数据规模和对照实验细节文中未充分说明。

PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations Figure 1
arXiv preprint2025-07-21

PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations

Yu Wei, Jiahui Zhang, Xiaoqin Zhang, Ling Shao

Nanyang Technological University, Zhejiang University of Technology, UCAS-Terminus AI Lab, University of Chinese Academy of Sciences

6D位姿估计三维重建高斯泼溅

PCR-GS针对无COLMAP 3D高斯泼溅在相邻视角大幅旋转、平移时相对位姿易失准、联合优化陷入局部最优的问题,提出位姿协同正则:用DINO语义特征重投影约束相邻帧位姿,并以小波高频差异强化旋转矩阵优化。多组真实复杂轨迹场景实验显示,其在无位姿先验下提升了相机位姿估计与新视角合成质量。

MaskHOI: Robust 3D Hand-Object Interaction Estimation via Masked Pre-training Figure 1
arXiv preprint2025-07-18

MaskHOI: Robust 3D Hand-Object Interaction Estimation via Masked Pre-training

Yuechen Xie, Haobo Jiang, Jian Yang, Yigong Zhang, Jin Xie

6D位姿估计手部姿态

MaskHOI面向单目RGB手-物交互中深度歧义与严重互遮挡导致的手部和物体6D/3D姿态估计不稳问题,将MAE预训练改造成任务相关的遮挡推理学习:按手与刚体复杂度分配不同mask比例,并用骨架引导遮挡指尖、手指等关键区域,同时引入Masked SDF重建强化全局3D几何感知。实验报告其在HOI姿态估计上显著优于现有方法,但具体增益拆分需看消融细节。

$π^3$ : Scalable Permutation-Equivariant Visual Geometry Learning Figure 1
arXiv preprint2025-07-17

$π^3$ : Scalable Permutation-Equivariant Visual Geometry Learning

Yifan Wang, Jianjun Zhou : 1, Haoyi Zhu, Wenzheng Chang, Yang Zhou Zizun Li, Junyi Chen, Jiangmiao Pang, Chunhua Shen, Technology of China

Shanghai Jiao Tong University Shanghai AI Laboratory Shanghai Innovation Institute, Zhejiang University University of Science and Technology of China Fudan University

6D位姿估计

π³针对多视角视觉几何中固定参考帧带来的顺序敏感和重建不稳定问题,提出完全置换等变的前馈架构,不再选参考视角,而以每视图相对方式预测仿射不变相机位姿与尺度不变局部点图。实验显示其在相机位姿、视频深度和稠密点图重建上达到或超过SOTA,如Sintel位姿ATE由VGGT的0.167降至0.074,并以57.4 FPS保持较高效率。

Revisiting Reliability in the Reasoning-based Pose Estimation Benchmark Figure 1
arXiv preprint2025-07-17

Revisiting Reliability in the Reasoning-based Pose Estimation Benchmark

Junsu Kim, Naeun Kim, Jaeho Lee, Incheol Park, Dongyoon Han, Seungryul Baek

NVIDIA Foundation Models Lab, MODULABS, NAVER AI Lab

6D位姿估计数据集/基准

本文针对RPE已成为姿态感知MLLM评测标准但难以复现的问题,指出其图像索引与3DPW原始标注不一致,且存在图像冗余、场景失衡、姿态过简和文本歧义等质量缺陷。作者通过逐例视觉匹配重新对齐并开源GT标注,使MPJPE、PA-MPJPE等定量评测更一致;主要贡献是修复基准可靠性而非提出新模型。

DINO-VO: A Feature-based Visual Odometry Leveraging a Visual Foundation Model Figure 1
arXiv preprint2025-07-17

DINO-VO: A Feature-based Visual Odometry Leveraging a Visual Foundation Model

Maulana Bisyir Azhari, David Hyunchul Shim

the School of Electrical Engineering, Korea Advanced, Institute of Science and Technology, Daejeon 305701, South Korea (e-mail

6D位姿估计相机位姿

针对单目视觉里程计在弱纹理、光照变化和跨域场景中鲁棒性与泛化不足的问题,DINO-VO将DINOv2引入稀疏特征VO,并用适配粗粒度ViT特征的显著关键点检测器、轻量CNN几何描述子、Transformer匹配和可微位姿层提升可定位性。实验显示其在TartanAir、KITTI优于既有帧间VO,在EuRoC具竞争力,并以单GPU 72 FPS、低于1GB显存运行。

AthleticsPose: Authentic Sports Motion Dataset on Athletic Field and Evaluation of Monocular 3D Pose Estimation Ability Figure 1
arXiv preprint2025-07-17

AthleticsPose: Authentic Sports Motion Dataset on Athletic Field and Evaluation of Monocular 3D Pose Estimation Ability

Tomohiro Suzuki, Ryota Tanaka, Calvin Yeung, Keisuke Fujii

Nagoya University

6D位姿估计数据集/基准

面向体育训练中动捕昂贵、单目3D姿态在真实高速运动中可靠性不清的问题,论文发布 AthleticsPose:在田径场用8台同步相机采集23名运动员真实田径动作,并用其评测单目3D姿态模型。结果显示,真实数据训练相比模仿动作数据可使 MPJPE 约降75%,但精度受视角和人体尺度影响;膝角等指标有应用潜力,高速速度类指标仍存在偏差。

From Neck to Head: Bio-Impedance Sensing for Head Pose Estimation Figure 1
arXiv preprint2025-07-17

From Neck to Head: Bio-Impedance Sensing for Head Pose Estimation

Mengxi Liu, Lala Shakti Swarup Ray, Sizhen Bian, Ko Watanabe, Ankur Bhatt, Joanna Sorysz, Russel Torah, Bo Zhou, Paul Lukowicz

German Research Center for Artificial Intelligence, University of Southampton

6D位姿估计

针对视觉头姿跟踪易受遮挡与隐私限制、IMU漂移、EMG依赖主动收缩的问题,论文提出项链式 NeckSense,用5个柔性干电极采集颈部多通道生物阻抗,并以带解剖约束的 Transformer 将阻抗序列映射到头/颈/下颌3D姿态。在7人留一交叉验证中,系统在自然头部动作上达到约25.9 mm MPVE;但监督信号来自视觉模型伪真值,真实精度仍受该基准误差影响。

SpatialTrackerV2: 3D Point Tracking Made Easy Figure 1
arXiv preprint2025-07-19

SpatialTrackerV2: 3D Point Tracking Made Easy

Yuxi Xiao, Jianyuan Wang, Nan Xue, Nikita Karaev, Yuri Makarov, Bingyi Kang Xing Zhu, Hujun Bao, Yujun Shen, Xiaowei Zhou, Oxford, Ant Group, Pixelwise AI, Bytedance Seed

Zhejiang University Oxford Ant Group Pixelwise AI Bytedance Seed

6D位姿估计

本文针对现有前馈式3D点跟踪依赖少量带真值轨迹数据、且将深度、相机运动与物体运动分开处理导致误差耦合的问题,提出SpatialTrackerV2,将视频深度、相机自运动和像素级物体运动分解并在可微框架中联合优化,引入前后端结构、尺度对齐与SyncFormer双分支建模。模型可利用17个异构数据集训练,在TAPVid-3D上显著超过DELTA,并达到动态重建方法相近精度且推理快约50倍。

Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI Figure 1
arXiv preprint2025-07-16

Spontaneous Spatial Cognition Emerges during Egocentric Video Viewing through Non-invasive BCI

Weichen Dai, Yuxuan Huang, Li Zhu, Dongjun Liu, Yu Zhang, Qibin Zhao, Andrzej Cichocki, Fabio Babiloni, Ke Li, Jianyu Qiu, Gangyong Jia

6D位姿估计

该文关注自然被动观看中,大脑是否会自发形成可被EEG观测的精细空间表征。作者将机器人定位中的6D位姿回归引入非侵入式BCI,从第一人称视频诱发的EEG中解码三维位置与朝向,并用梯度归因分析通道贡献。实验显示,只有保持时序连续的视觉输入才能产生有意义解码,100 ms/帧效果更好,且位置与方向依赖不同但互补的脑电通道。

Efficient Calisthenics Skills Classification through Foreground Instance Selection and Depth Estimation Figure 1
arXiv preprint2025-07-16

Efficient Calisthenics Skills Classification through Foreground Instance Selection and Depth Estimation

Antonio Finocchiaro, Giovanni Maria Farinella, Antonino Furnari

6D位姿估计彩色深度

针对街头健身静态技能识别中骨架姿态估计推理慢、易受遮挡和复杂背景影响的问题,论文绕开关键点提取,比较全图 RGB、单目深度、YOLOv10 运动员前景裁剪及裁剪后深度四种输入,用 Depth Anything V2 提供深度线索以削弱背景干扰。结果显示,RGB 前景块相对骨架方法推理快 38.3 倍,深度块准确率提升到 0.837(对比 0.815),说明主要收益来自前景实例选择与深度表征。

UniLGL: Learning Uniform Place Recognition for FOV-limited/Panoramic LiDAR Global Localization Figure 1
IEEE Transactions on Robotics2025-07-16

UniLGL: Learning Uniform Place Recognition for FOV-limited/Panoramic LiDAR Global Localization

Hayley H. Shen, Xun Chen, Yulin Hui, Zhenyu Wu, Wei Wang, Qiyang Lyu, Tianchen Deng, D.W. Wang

Nanyang Technological University, Tianjin University, Shanghai Jiao Tong University

6D位姿估计点云

针对现有 LiDAR 全局定位常只用几何或面向同类传感器、难以兼顾 FoV 受限与全景雷达的问题,UniLGL 将点云编码为空间/强度双 BEV,并用多 BEV 融合网络与视角不变监督学习统一描述子和局部特征;同时借助视觉基础模型少量微调提升泛化,并由 BEV-点云映射直接求 SE(3) 全局位姿。实测基准中性能达到或接近 SOTA,并已在卡车、MAV 的港口和森林场景部署验证。

BRUM: Robust 3D Vehicle Reconstruction from 360 Sparse Images Figure 1
arXiv preprint2025-07-16

BRUM: Robust 3D Vehicle Reconstruction from 360 Sparse Images

Davide Di Nucci, Matteo Tomei, Guido Borghi, Luca Ciuffreda, Roberto Vezzani, Rita Cucchiara

University of Modena and Reggio Emilia, Prometeia

6D位姿估计三维重建

面向车辆巡检、车队维护等场景,论文关注少量环视图像下的车辆三维重建,避免 NeRF/GS 对密集视角的依赖。BRUM 用深度将稀疏视图投影到合成相机位姿以扩充训练,并以 DUSt3R 替代易失效的 COLMAP,同时只在高置信重投影像素上计算光度损失。实验显示其在 Carpatch、KRONC 及新建公交车数据集上用 4–8 张图即可达到或超过现有方法。

SGLoc: Semantic Localization System for Camera Pose Estimation from 3D Gaussian Splatting Representation Figure 1
arXiv preprint2025-07-16

SGLoc: Semantic Localization System for Camera Pose Estimation from 3D Gaussian Splatting Representation

Beining Xu, Siting Zhu, Hesheng Wang

Shanghai Jiao Tong University

6D位姿估计相机位姿三维重建高斯泼溅

SGLoc针对3DGS定位依赖初始位姿、低纹理或光照变化下特征匹配不稳的问题,引入语义一致性做2D查询图像与全局3DGS语义表示的检索,先获得粗位姿,再用3DGS渲染图与查询图差异进行迭代细化,形成无需先验的多级6DoF位姿回归流程。在12Scenes和7Scenes上优于多类基线,结果表明语义检索能改善全局初始化并提升复杂场景定位鲁棒性。

SEPose: A Synthetic Event-based Human Pose Estimation Dataset for Pedestrian Monitoring Figure 1
arXiv preprint2025-07-16

SEPose: A Synthetic Event-based Human Pose Estimation Dataset for Pedestrian Monitoring

Kaustav Chanda, Aayush Atul Verma, Arpitsinh Vaghela, Yezhou Yang

Arizona State University

6D位姿估计人体姿态事件相机仿真到现实数据集/基准

面向交通路口中高速、强光照变化和异常行人动作带来的低延迟感知需求,SEPose用CARLA合成固定交通相机视角的事件相机人体姿态数据,覆盖城乡、天气、昼夜、拥挤度及人车交互,并提供约35万行人关键点标注、事件流和33ms事件帧。作者用RVT、YOLOv8训练后在真实事件数据上测试,显示一定仿真到现实泛化能力,但具体增益幅度文中未充分说明,效果可能主要来自数据规模与场景覆盖。

GKNet: Graph-based Keypoints Network for Monocular Pose Estimation of Non-cooperative Spacecraft Figure 1
arXiv preprint2025-07-15

GKNet: Graph-based Keypoints Network for Monocular Pose Estimation of Non-cooperative Spacecraft

Weizhao Ma, Dong Zhou, Yuhui Hu, Zipeng He

Zipeng He is with China Academy of Space Technology, Beijing, China

6D位姿估计航天器

面向在轨服务中非合作航天器单目6D位姿估计,论文针对现有关键点检测易受结构对称与局部遮挡影响的问题,提出GKNet,将航天器关键点建模为图并用图卷积分支引入几何约束,再与上采样解码分支融合后接PnP求姿态;同时发布含3类目标、9万张仿真图的SKD数据集。实验与消融显示其关键点检测和位姿估计优于现有检测器。

Joint angle model based learning to refine kinematic human pose estimation Figure 1
arXiv preprint2025-07-15

Joint angle model based learning to refine kinematic human pose estimation

Peng Chang, Yifei Zhou, Huifeng Xi, Shiqing Huang, C. L. Philip Chen, Jian Yang, Bao Yang, Zhenyu Jiang

> REPLACE THIS LINE WITH YOUR MANUSCRIPT ID NUMBER (DOUBLE-CLICK HERE TO EDIT) <

6D位姿估计人体姿态

针对视频人体姿态估计在运动场景中易出现关键点误检与轨迹抖动、且人工标注数据限制细化模型训练的问题,论文提出 JAR:用关节角与肢段长度约束重建姿态,并以高阶傅里叶级数生成更连续的训练真值,再用带注意力的 BiGRU 作为 HRNet 后处理。实验显示其能更好修正离群关节、平滑时序轨迹,在花滑、霹雳舞等复杂动作中优于 SmoothNet。

Raci-Net: Ego-vehicle Odometry Estimation in Adverse Weather Conditions Figure 1
arXiv preprint2025-07-14

Raci-Net: Ego-vehicle Odometry Estimation in Adverse Weather Conditions

Mohammadhossein Talebi, Pragyan Dahal, Davide Possenti, Stefano Arrigoni, Francesco Braghin

Michigan State University, East Lansing, MI, USA

6D位姿估计相机位姿

面向自动驾驶在雨雪、低照等恶劣天气下相机里程计易退化的问题,Raci-Net将视觉、IMU与毫米波雷达联合用于自车6D位姿/里程计估计,并引入基于环境可靠性动态调节各模态贡献的融合策略及改进雷达编码器。Boreas数据集实验显示,其在晴朗与退化场景、不同轨迹段长度上均提升了鲁棒性和估计精度。

Kaleidoscopic Background Attack: Disrupting Pose Estimation with Multi-Fold Radial Symmetry Textures Figure 1
arXiv preprint2025-07-14

Kaleidoscopic Background Attack: Disrupting Pose Estimation with Multi-Fold Radial Symmetry Textures

Xinlong Ding, Hongwei Yu, Jiawei Li, Feifan Li, Yu Shang Bochao Zou, Huimin Ma, Technology Beijing, China

University of Science and Technology Beijing, China Tsinghua University, China

6D位姿估计

针对稀疏视角、物体中心场景中位姿估计模型过度依赖大面积背景纹理的问题,论文提出 KBA:用重复扇形纹理构成多重径向对称“万花筒”背景,并通过投影方向一致性损失优化纹理,使不同视角下背景保持相似从而误导相机朝向估计。实验显示,自然纹理已能干扰多种模型,优化后在数字与物理场景中攻击效果和稳定性进一步增强。

ProGait: A Multi-Purpose Video Dataset and Benchmark for Transfemoral Prosthesis Users Figure 1
arXiv preprint2025-07-14

ProGait: A Multi-Purpose Video Dataset and Benchmark for Transfemoral Prosthesis Users

Abrar Alamri Goeran Fiedler Wei Gao

University of Pittsburgh

6D位姿估计人体姿态数据集/基准

现有视觉步态模型多由健全人数据训练,难以识别经股假肢的外观与异常运动,限制低成本康复评估。ProGait针对这一缺口发布4名大腿截肢者、412段多视角行走视频,含分割、2D姿态和9类步态分析标注,并覆盖不同假肢配置与场景。基于该数据微调的YOLO11、RTMPose较零样本SOTA在VOS提升约9%、HPE提升10–30%,矢状面步态分类准确率达81.2%,增益可能主要来自专门数据。

VST-Pose: A Velocity-Integrated Spatiotem-poral Attention Network for Human WiFi Pose Estimation Figure 1
arXiv preprint2025-07-13

VST-Pose: A Velocity-Integrated Spatiotem-poral Attention Network for Human WiFi Pose Estimation

PAGE 1

6D位姿估计

针对视觉姿态估计在遮挡、弱光和隐私场景下受限,以及现有 WiFi-CSI 方法多依赖单帧导致连续骨架抖动的问题,VST-Pose 用短序列 CSI 建模人体运动,引入双流时空注意力骨干 ViSTA-Former,并加入关键点速度分支以捕捉细微位移。在自建居家护理 2D 数据集上 PCK@50 达 92.2%,较已有方法提升 8.3%,并在 MMFi 上验证了 3D 姿态估计效果。

EHPE: A Segmented Architecture for Enhanced Hand Pose Estimation Figure 1
arXiv preprint2025-07-13

EHPE: A Segmented Architecture for Enhanced Hand Pose Estimation

Bolun Zheng, Xinjie Liu, Qianyu Zhang, Canjin Wang, Fangni Chen, Mingen Xu

Hangzhou Dianzi University, Zhejiang, Xinhua Zhiyun Technology Co., Ltd

6D位姿估计手部姿态

EHPE针对现有3D手部姿态估计中指尖远端关节误差最大且会向整体姿态累积的问题,提出先局部估计TIP与腕部、再以结构先验引导其余关节回归的分段框架;PG阶段结合动态图注意/结构推理分支与视觉增强分支。论文在两个常用基准上报告超过既有方法,表明显式建模指尖—腕部先验有助于降低全手关节误差。

PoseLLM: Enhancing Language-Guided Human Pose Estimation with MLP Alignment Figure 1
arXiv preprint2025-07-12

PoseLLM: Enhancing Language-Guided Human Pose Estimation with MLP Alignment

Dewen Zhang, Tahir Hussain, Wangpeng An, Hayaru Shouno

6D位姿估计人体姿态

传统人体姿态估计依赖固定关键点先验,语言引导方法虽能零样本泛化,但 LocLLM 的线性视觉-语言投影限制了精细定位。PoseLLM 将其替换为两层 GELU MLP连接器,以非线性对齐图像patch与关键点文本描述。仅用 COCO 训练时在 COCO val 达到 77.8 AP,较 LocLLM 提升 0.4 AP,并在 Human-Art、MPII 上保持零样本泛化。

RegGS: Unposed Sparse Views Gaussian Splatting with 3DGS Registration Figure 1
arXiv preprint2025-07-10

RegGS: Unposed Sparse Views Gaussian Splatting with 3DGS Registration

Chong Cheng, Yu Hu, Sicheng Yu, Beizhen Zhao, Zijian Wang, Hao Wang, Technology (Guangzhou, ccheng735, yhu847@connect.hkust-gz.edu.cn, yusch@mail2.sysu.edu.cn, bzhao610, zwang886@connect.hkust-gz.edu.cn, haowang@hkust-gz.edu.cn

The Hong Kong University of Science and Technology (Guangzhou)

6D位姿估计三维重建高斯泼溅

RegGS面向无位姿稀疏视角下3DGS重建易受先验不足、前馈方法输入视图数受限的问题,核心思路是将前馈网络生成的局部高斯增量配准为全局一致场景;方法以熵正则Sinkhorn近似求解GMM间MW2距离,并结合光度一致性和深度几何在Sim(3)中粗到细优化相机位姿。RE10K和ACID实验显示其提升位姿估计精度与新视角合成质量。

SCREP: Scene Coordinate Regression and Evidential Learning-based Perception-Aware Trajectory Generation Figure 1
arXiv preprint2025-07-10

SCREP: Scene Coordinate Regression and Evidential Learning-based Perception-Aware Trajectory Generation

Juyeop Han, Lukas Lao Beyer, Guilherme V. Cavalheiro, Sertac Karaman

Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA 02139, USA

6D位姿估计

面向无 GPS 室内无人机,传统特征地图重建与存储开销大,而 SCR 虽能给出绝对位姿但存在像素可靠性、低频和离群问题。SCREP 将证据学习的逐像素不确定性引入 SCR,并用熵图驱动滚动时域轨迹优化,使相机主动朝向低不确定场景坐标,同时用固定滞后平滑融合 SCR 与 IMU。仿真中相对基线至少降低平移 RMSE 4.9%、旋转 RMSE 30.8%,硬件在环验证了接近真实部署的可行性。

g2o vs. Ceres: Optimizing Scan Matching in Cartographer SLAM Figure 1
arXiv preprint2025-07-09

g2o vs. Ceres: Optimizing Scan Matching in Cartographer SLAM

1 Quanjie Qiu

School of Engineering and Computer Science, Laurentian University

6D位姿估计相机位姿

针对 Cartographer 扫描匹配中优化器选择对实时 SLAM 效率与建图质量的影响,论文将 g2o 接入原本默认使用 Ceres 的局部 SLAM 优化流程,在相同扫描匹配问题上比较收敛、速度与地图效果。实验显示,Ceres 在迭代次数、收敛时间和整体地图清晰度上优于 g2o,尤其在 AgileX LIMO 实机场景中更稳定;但 g2o 对局部障碍物刻画更突出,适合特定感知需求。

Smartphone Exergames with Real-Time Markerless Motion Capture: Challenges and Trade-offs Figure 1
arXiv preprint2025-07-09

Smartphone Exergames with Real-Time Markerless Motion Capture: Challenges and Trade-offs

Mathieu Phosanarack, Laura Wallard, Sophie Lepreux, Christophe Kolski, Eugénie Avril

6D位姿估计人体姿态数据集/基准

本文面向康复与健康运动中低成本、可及的互动训练需求,探索仅用手机摄像头实现实时无标记人体姿态捕捉的体感游戏。其核心洞察不是提出新模型,而是基于 Unity/Mediapipe 原型梳理移动端精度、延迟、算力与交互距离之间的权衡,并提出轻量模型、降采样、云端处理、大界面和替代反馈等设计方向。文中主要结果为挑战分析与设计建议,尚未给出充分用户实验或量化性能增益。

MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning Figure 1
arXiv preprint2025-07-09

MK-Pose: Category-Level Object Pose Estimation via Multimodal-Based Keypoint Learning

Yifan Yang, Peili Song, Enfan Lan, Dong Liu, Jingtai Liu, Senior Member, IEEE

Nankai University

6D位姿估计物体位姿类别级位姿

面向仓储、制造等场景中未知实例的抓取需求,MK-Pose针对类别级6D位姿在遮挡、类内形变和关键点标注依赖下泛化不足的问题,将RGB、点云与类别文本融合,并用可学习查询、自监督关键点、图关系建模及对称感知损失联合估计位姿和尺寸。在CAMERA25、REAL275上优于现有方法,并在HouseCat6D跨数据集测试中显示较强零样本泛化。

Failure Forecasting Boosts Robustness of Sim2Real Rhythmic Insertion Policies Figure 1
arXiv preprint2025-07-09

Failure Forecasting Boosts Robustness of Sim2Real Rhythmic Insertion Policies

Yuhan Liu, Xinyu Zhang, Haonan Chang, Abdeslam Boularias

the Department of Computer Science, Rutgers, University, New Jersey, USA

6D位姿估计仿真到现实

论文针对节律性插入任务中“单次成功率高但多轮累积易失败”的问题,以扳手拧螺母为例构建仿真到现实方案。核心做法是将扳手位姿表示在螺母坐标系中以提升迁移性,并用仿真数据训练失败预测器,提前触发抬起重试。实验表明该组合不仅提高单次插入稳定性,也显著改善长时重复任务的鲁棒性。

Mask6D: Masked Pose Priors For 6D Object Pose Estimation Figure 1
arXiv preprint2025-07-09

Mask6D: Masked Pose Priors For 6D Object Pose Estimation

Yuechen Xie, Haobo Jiang, Jin Xie

Nanjing University of Science and Technology

6D位姿估计物体位姿

针对单目 RGB 在遮挡和杂乱背景下缺乏可靠位姿感知特征的问题,Mask6D 将 MAE 式预训练改造成面向 6D 位姿的任务先验学习:用 RGB、2D-3D 对应图和可见掩码进行重建预训练,并引入只关注物体区域的损失以削弱背景干扰。随后将预训练编码器接入常规端到端位姿网络,在 LM、LM-O、YCB-V 上相较既有端到端方法取得更好表现。

SenseShift6D: Multimodal RGB-D Benchmarking for Robust 6D Pose Estimation across Environment and Sensor Variations Figure 1
arXiv preprint2025-07-08

SenseShift6D: Multimodal RGB-D Benchmarking for Robust 6D Pose Estimation across Environment and Sensor Variations

Yegyu Han, Taegyoon Yoon, Dayeon Woo, Sojeong Kim, Hyung-Sin Kim

6D位姿估计点云彩色深度数据集/基准

现有6D位姿基准多在固定光照和相机设置下采集,难以衡量真实部署中的传感器/环境漂移。SenseShift6D通过物理扫描曝光、增益、深度模式和光照,构建带精确标注的RGB-D鲁棒性基准。实验显示通用预训练模型和实例级模型都对这些变化明显敏感;oracle式测试时传感器选择最高带来约+16.7个百分点提升,而实际一致性代理增益有限,说明自适应感知仍有较大研究空间。

Event-RGB Fusion for Spacecraft Pose Estimation Under Harsh Lighting Figure 1
Aerospace Science and Technology2025-07-08

Event-RGB Fusion for Spacecraft Pose Estimation Under Harsh Lighting

Mohsi Jawaid, Marcus Märtens, Tat-Jun Chin

The University of Adelaide

6D位姿估计事件相机航天器

面向交会、对接等在轨操作中强眩光、过曝和镜头光斑导致RGB航天器6D位姿失效的问题,论文用分光棱镜构建光学/时间对齐的RGB-事件双通道系统,并以RANSAC进行学习-free融合,结合dropout不确定性检测单模态失效。作者采集真实实验室光照挑战数据集,结果显示融合在恶劣照明下优于单一RGB或事件通道,并支持事件相机用于航天器位姿估计。

W2W: A Simulated Exploration of IMU Placement Across the Human Body for Designing Smarter Wearable Figure 1
arXiv preprint2025-07-07

W2W: A Simulated Exploration of IMU Placement Across the Human Body for Designing Smarter Wearable

Lala Shakti Swarup Ray, Bo Zhou, Paul Lukowicz

6D位姿估计

针对IMU可穿戴系统中传感器位置长期依赖经验、实体试验成本高的问题,W2W用MoCap与SMPL在全身512个解剖表面位置生成合成IMU并评估任务相关效用。作者用MM-Fit和VIDIMU真实IMU验证空间排名趋势一致,进一步发现若干商业设备少用但效用较高的区域,可用于更低成本的自适应传感器布置。

UDF-GMA: Uncertainty Disentanglement and Fusion for General Movement Assessment Figure 1
arXiv preprint2025-07-07

UDF-GMA: Uncertainty Disentanglement and Fusion for General Movement Assessment

Scotland, United Kingdom Shu-Lim.Ho@glasgow.ac.uk

School of Computing Science, University of Glasgow

6D位姿估计

针对自动化婴儿全身运动评估中数据稀缺、2D姿态估计噪声导致临床可靠性不足的问题,UDF-GMA将数据噪声的偶然不确定性与模型参数的认知不确定性显式解耦,并把不确定性与运动表征融合以提升正常/poor repertoire区分度。在Pmi-GMA基准上的实验显示其预测PR更有效且具一定泛化性,但具体增益幅度需结合全文表格判断。

Thousand-Brains Systems: Sensorimotor Intelligence for Rapid, Robust Learning and Inference Figure 1
Neural Computation2025-07-06

Thousand-Brains Systems: Sensorimotor Intelligence for Rapid, Robust Learning and Inference

Niels Leadholm 1 Joint first authors, Viviane Clay : 1, Scott Knudstrup, Hojae Lee, Jeff Hawkins Thousand Brains Project, Redwood City, United States @thousandbrains.org

Electronic Sensor Technology (United States)

6D位姿估计

本文针对现有 AI 在少样本、持续学习和具身泛化上的不足,评估千脑系统首个实现 Monty 在 YCB 3D 物体识别与 6D 位姿估计中的能力。核心在于用类皮层柱的模块、显式参考系、主动传感运动策略、模块投票和 Hebbian 式绑定来学习结构化物体模型。结果显示其更偏向形状表征,可自然处理对称性,并通过模型驱动动作与模块通信加速推理,支持快速、连续且计算高效的学习。

Gaussian-LIC2: LiDAR-Inertial-Camera Gaussian Splatting SLAM Figure 1
arXiv preprint2025-07-09

Gaussian-LIC2: LiDAR-Inertial-Camera Gaussian Splatting SLAM

Xiaolei Lang, Jiajun Lv, Kai Tang, Laijian Li, Jianxin Huang, Lina Liu, Yong Liu, Xingxing Zuo

Institute of Cyber-Systems and Control, Zhejiang University, China, Department of Robotics, Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)

6D位姿估计相机位姿点云三维重建高斯泼溅

针对现有3DGS SLAM在稀疏LiDAR盲区重建不足、几何精度与实时性难兼顾的问题,Gaussian-LIC2融合LiDAR-IMU-相机,在连续时间优化中估计位姿,并用零样本深度补全初始化盲区高斯、以LiDAR深度监督CUDA加速优化,还将高斯地图光度约束反馈里程计。公开与自采数据实验显示其在不同线数LiDAR下提升RGB/深度渲染和位姿鲁棒性,并支持插帧与快速网格提取。

Accurate Pose Estimation Using Contact Manifold Sampling for Safe Peg-in-Hole Insertion of Complex Geometries Figure 1
arXiv preprint2025-07-05

Accurate Pose Estimation Using Contact Manifold Sampling for Safe Peg-in-Hole Insertion of Complex Geometries

Abhay Negi, Omey M. Manyar, Dhanush K. Penmetsa, Satyandra K. Gupta

University of Southern California

6D位姿估计

面向复杂非凸零件在小间隙装配中易因微小位姿误差卡死、受力过大的问题,论文提出只依赖本体运动学与力阈值接触检测的6D位姿估计框架:离线构建接触流形,在线用约6秒原始探索采样接触子流形并配准到参考流形。五类0.1–1.0 mm间隙工业几何实验中成功率达96.7%,较无状态估计的原始插入提升约6倍,并降低平均扳手以提高安全性。

Markerless Stride Length estimation in Athletic using Pose Estimation with monocular vision Figure 1
arXiv preprint2025-07-02

Markerless Stride Length estimation in Athletic using Pose Estimation with monocular vision

Via Monteroni sn, 73100 Lecce, Via Monteroni sn. 73100 Lecce, ITALY) pierluigi.mazzeo@cnr.it

6D位姿估计

针对田径训练中步幅、配速等指标依赖人工经验或赛道标记、难以低成本量化的问题,本文提出单目视频下的无标记步幅估计流程:用 Canny 与概率霍夫变换检测跑道线并估计消失点,通过单应性变换获得可度量俯视平面,再结合 EfficientPose 足部关键点与触地时刻分析计算步长。三名跑者多段视频实验显示测得步幅在个体内较一致,具备训练监测潜力;但文中未提供运动捕捉等真值对照,绝对误差与泛化性仍未充分说明。

Reconstructing Close Human Interaction with Appearance and Proxemics Reasoning Figure 1
arXiv preprint2025-07-03

Reconstructing Close Human Interaction with Appearance and Proxemics Reasoning

Agency for Science, Technology, Research, Singapore CFAR, Singapore

Southeast University, National University of Singapore, Sichuan University, IHPC, Agency for Science, Technology and Research, Singapore, CFAR, Agency for Science, Technology and Research, Singapore

6D位姿估计

该文针对野外视频中近距离双人交互因遮挡、深度歧义和人体语义混淆而难以恢复的问题,提出将外观作为约束线索:用扩散模型学习社交距离/交互先验,并在双分支优化中联合重建SMPL运动与3D Gaussian外观,结合2D关键点和穿透惩罚提升物理合理性。实验显示其在多个基准上优于现有方法,并构建了带伪真值的近距离交互数据集。

IMASHRIMP: Automatic White Shrimp (Penaeus vannamei) Biometrical Analysis from Laboratory Images Using Computer Vision and Deep Learning Figure 1
arXiv preprint2025-07-03

IMASHRIMP: Automatic White Shrimp (Penaeus vannamei) Biometrical Analysis from Laboratory Images Using Computer Vision and Deep Learning

Remache González Abiam, Chagour Meriem, Bijan Rüth Timon, Trapiella Cañedo Raúl, Martínez Soler Marina, Lorenzo Felipe Álvaro, Shin Hyun-Suk, Zamorano Serrano María-Jesús, Torres Ricardo, Castillo Parra Juan-Antonio, Reyes Abad Eduardo, Ferrer Ballester Miguel-Ángel, Afonso López Juan-Manuel, Hernández Tejera Francisco-Mario, Penate-Sanchez Adrian

6D位姿估计

面向南美白对虾育种中人工形态测量耗时且易错的问题,IMASHRIMP将实验室RGB-D图像分析拆成视角/额剑完整性判别、基于VitPose的23点虾体“骨架”估计,以及SVM像素到厘米回归;核心价值在于把表型测量转化为关键点检测并加入人机双重校验。实验称视角错误降至0%、额剑判断错误由12.46%降至3.64%,姿态估计mAP约93.12%/摘要称97.94%,尺寸回归MAE为0.07±0.1 cm。

3D Heart Reconstruction from Sparse Pose-agnostic 2D Echocardiographic Slices Figure 1
Lecture notes in computer science2025-07-03

3D Heart Reconstruction from Sparse Pose-agnostic 2D Echocardiographic Slices

Zhurong Chen, Jinhua Chen, Wei Zhuo, Wufeng Xue, Dong Ni

Shenzhen University, Shenzhen University Health Science Center, Shenzhen Technology University, Nanjing Medical University

6D位姿估计三维重建

针对常规2D超声切面难以准确支持三维心功能评估、而3D超声分辨率和人工标注成本受限的问题,论文提出Echo3D:在切面位姿未知且稀疏的条件下,交替优化2D切片6D位姿与基于隐式神经表示的三维心脏形状融合。使用6个临床常用平面时,LV体积误差由双平面法20.24%降至1.98%,并实现RV体积估计,误差5.75%。

LMPNet for Weakly-supervised Keypoint Discovery Figure 1
arXiv preprint2025-07-03

LMPNet for Weakly-supervised Keypoint Discovery

Pei Guo Ryan Farrell

Brigham Young University

6D位姿估计

这篇工作针对语义关键点依赖人工标注、难以扩展到大规模类别的问题,尝试仅用类别标签把判别式卷积滤波器转化为关键点探测器。核心洞察是关键点应表现为稀疏、一致且多样的“不可重复局部模式”,因此提出 Leaky Max Pooling 抑制非峰值响应,并结合高激活滤波器选择、注意力遮挡和可学习聚类生成关键点。实验显示 LMPNet 可发现对姿态较鲁棒的语义关键点,预测精度接近监督式位姿估计模型。

What does really matter in image goal navigation? Figure 1
arXiv preprint2025-07-02

What does really matter in image goal navigation?

Gianluca Monaci, Philippe Weinzaepfel, Christian Wolf

NAVER LABS Europe, Grenoble, France

6D位姿估计

本文追问 ImageNav 是否能仅靠强化学习端到端学会从当前图像与目标图像中推断相对方向。作者系统比较晚融合、通道堆叠、space-to-depth、交叉注意力等结构,并探测导航表征中的相对位姿能力。主要发现是:纯 RL 在更真实设置下明显弱于带预训练视觉编码器的 DEBiT;早期、局部 patch 级融合更关键;近期小 CNN 的高分很大程度受 Habitat 允许贴墙滑动的模拟器捷径影响。

2024 NASA SUITS Report: LLM-Driven Immersive Augmented Reality User Interface for Robotics and Space Exploration Figure 1
arXiv preprint2025-07-01

2024 NASA SUITS Report: LLM-Driven Immersive Augmented Reality User Interface for Robotics and Space Exploration

Kathy Zhuang, Zixun Huang, Yukun Song, Rui Li, Yinuo Zhou, Allen Y. Yang

6D位姿估计机器人操作

面向航天服场景中宇航员需免手、低干扰地监控和操控机器人且仍需可靠3D定位的问题,本文构建URSA,将HoloLens非侵入式AR界面、LLM语音控制、LMCC任务可视化与基于ZED2/DTTD3数据的DTTDNet 6DoF跟踪结合。实验显示可对Leo Rover进行实时粗位姿估计,刚体场景ADD-S AUC为62.66、非刚体为38.73,说明系统集成可行,但非刚体鲁棒性和LLM幻觉仍是主要瓶颈。

Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations Figure 1
arXiv preprint2025-07-04

Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrations

Shivansh Patel, Shraddhaa Mohan, Hanlin Mai Unnat Jain, Svetlana Lazebnik, Yunzhu Li UIUC, UC Irvine

Columbia University

6D位姿估计机器人操作

针对真实示教采集成本高、公开视频存在域差的问题,RIGVid尝试让机器人仅从与当前场景和指令匹配的生成视频中学习操作。其关键在于用VLM筛掉不符合指令的视频,再以6D位姿跟踪提取物体轨迹并跨本体重定向执行。真实任务实验显示,过滤后的生成视频可接近真人示教效果,并优于VLM关键点、光流和点轨迹等替代方案;性能随视频生成质量提升而提高。

Multi-Modal Graph Convolutional Network with Sinusoidal Encoding for Robust Human Action Segmentation Figure 1
arXiv preprint2025-07-01

Multi-Modal Graph Convolutional Network with Sinusoidal Encoding for Robust Human Action Segmentation

Hao Xing, Kai Zhe Boey, Yuankai Wu, Darius Burschka, Gordon Cheng

Technical University of Munich

6D位姿估计

面向人机协作中的连续动作分割,论文针对骨架估计和物体检测噪声导致的过分割问题,提出 MMGCN:用正弦编码增强 3D 关节表示,并在不同帧率下融合 1fps 视觉特征与 30fps 骨架/物体运动特征,同时用 SmoothLabelMix 强化动作边界的平滑性。在 Bimanual Actions Dataset 上优于已有方法,达到 F1@10 94.5%、F1@25 92.8%。

LoD-Loc v2: Aerial Visual Localization over Low Level-of-Detail City Models using Explicit Silhouette Alignment Figure 1
arXiv preprint2025-07-01

LoD-Loc v2: Aerial Visual Localization over Low Level-of-Detail City Models using Explicit Silhouette Alignment

Juelin Zhu, Shuaibang Peng, Long Wang, Hanlin Tan, Yu Liu, Maojun Zhang, Shen Yan, wanglongzju@gmail.com

National University of Defense Technology, Westlake University

6D位姿估计相机位姿航天器

针对现有航拍视觉定位依赖高细节 LoD2/3 或纹理三维地图、而现实中更普遍的是轻量且隐私友好的 LoD1 城市模型的问题,LoD-Loc v2 将定位线索从线框转向建筑轮廓:先分割查询图像中的建筑轮廓,再用姿态代价体粗选位姿,并结合多束跟踪粒子滤波细化。实验表明其首次在低 LoD 模型上实现有效定位,在高、低 LoD 场景均显著优于基线,甚至超过部分纹理模型方法,并扩大了可收敛的先验误差范围。

Computer Vision for Objects used in Group Work: Challenges and Opportunities Figure 1
Communications in computer and information science2025-06-30

Computer Vision for Objects used in Group Work: Challenges and Opportunities

Changsoo Jung, Sheikh Mannan, Jack Fitzgerald, Nathaniel Blanchard

Colorado State University

6D位姿估计数据集/基准

面向K-12协作学习中AI难以理解学生与实物交互的问题,论文将6D位姿估计引入小组操作场景,构建FiboSB视频数据集,包含远距离拍摄下三人操作小方块与天平的密集标注。对四种现有6D位姿方法的基准显示,其主要瓶颈在目标检测而非后续姿态估计;微调YOLO11-x后检测mAP50达到0.898,为复杂协作场景中的物体空间理解提供了基准与误差分析。

Validation of AI-Based 3D Human Pose Estimation in a Cyber-Physical Environment Figure 1
arXiv preprint2025-06-30

Validation of AI-Based 3D Human Pose Estimation in a Cyber-Physical Environment

Lisa Marie Otto, Michael Kaiser, Daniel Seebacher, Steffen Müller

University of Konstanz

6D位姿估计人体姿态

面向自动驾驶与行人/骑行者安全交互验证,本文关注真实道路测试危险、纯仿真感知保真不足的问题。其核心是将ViL车辆台架与运动实验室、UE5虚拟场景和单目3D骨架检测结合,对真实与赛博物理环境中的人体姿态估计一致性进行对照评估。结果显示,稳定步行等运动下两域HPE较一致,但动态运动、遮挡和复杂骑行姿态仍产生明显误检与关节不稳定。

MGPRL: Distributed Multi-Gaussian Processes for Wi-Fi-based Multi-Robot Relative Localization in Large Indoor Environments Figure 1
arXiv preprint2025-06-30

MGPRL: Distributed Multi-Gaussian Processes for Wi-Fi-based Multi-Robot Relative Localization in Large Indoor Environments

Sai Krishna Ghanta, Ramviyas Parasuraman

University of Georgia

6D位姿估计机器人操作高斯泼溅

面向 GPS 缺失、视觉/LiDAR 代价高且机器人活动区域可能不重叠的室内多机器人相对定位,MGPRL 利用现有 Wi‑Fi RSSI 在线建模多个 AP。其核心是用共区域化多输出高斯过程联合预测 RSSI 场并估计 AP 位置,再通过带不确定性权重的 AP 凸包对齐求相对位姿。仿真与真实实验显示,相比 HGPRL 等方法在定位精度和计算效率上更优,并发布了 ROS 包。

TVG-SLAM: Robust Gaussian Splatting SLAM with Tri-view Geometric Constraints Figure 1
arXiv preprint2025-06-29

TVG-SLAM: Robust Gaussian Splatting SLAM with Tri-view Geometric Constraints

Zhen Tan, Xieyuanli Chen, Lei Feng, Yangbing Ge, Shuaifeng Zhi, Jiaxiong Liu, Dewen Hu

the National University of Defense Technology, China. indicates

6D位姿估计相机位姿三维重建高斯泼溅

TVG-SLAM针对RGB-only 3DGS SLAM过度依赖光度一致性、在户外大视角与光照变化下易跟踪失效的问题,引入三视图几何约束:通过密集三视图匹配构建稳定关联,并结合光度、三焦点2D重投影和3D对齐损失进行位姿优化;同时用TUGI将多视图不确定性注入高斯初始化,DART在地图滞后时降低渲染信任。多组户外数据集上优于既有RGB-only 3DGS SLAM,最难数据集平均ATE降低69.0%,渲染质量也达到SOTA。

Deterministic Object Pose Confidence Region Estimation Figure 1
arXiv preprint2025-06-28

Deterministic Object Pose Confidence Region Estimation

Jinghao Wang, Zhang Li, Zi Wang, Banglei Guan, Yang Shang

National University of Defense Technology

6D位姿估计物体位姿

面向机器人操作等安全关键场景,论文关注单点6D位姿估计缺少可靠不确定性且采样式置信区域慢、偏大的问题。方法先用归纳保形预测校准回归得到的关键点高斯分布,再借助隐函数定理的雅可比将2D关键点区域确定性传播到6D位姿区域,避免采样膨胀。在LMO和SPEED上,在相近覆盖率下显著缩小旋转/平移置信区域体积,最高分别减少99.9%和99.8%,并降低计算时间。

Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration Figure 1
arXiv preprint2025-06-27

Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration

Noora Sassali, Roel Pieters

Cognitive Robotics group, Unit of Automation Technology and Mechanical Engineering, Tampere University, 33720, Tampere, Finland

6D位姿估计机器人操作

面向协作机器人中语音受噪声影响、目标选择不直观的问题,论文用RGB-D人体姿态估计提取肩—腕射线,并与标定平面求交来定位指向目标,配套两种拾放任务选择策略。主要结果是建立了平面工作区指向精度评测,并接入物体检测、语音转写/合成与Franka系统完成概念验证;具体数值增益文中未充分说明,局限主要来自线性外推、姿态与深度误差。

Single-Scanline Relative Pose Estimation for Rolling Shutter Cameras Figure 1
arXiv preprint2025-06-27

Single-Scanline Relative Pose Estimation for Rolling Shutter Cameras

Petr Hrubý, Marc Pollefeys

Microsoft (United States)

6D位姿估计相机位姿

针对滚动快门相机运动模型常与真实轨迹不匹配、影响相对位姿估计的问题,论文提出仅利用每幅图像单条扫描线与3D直线投影的交点来估计扫描线间位姿,从而避免显式建模相机运动;并系统分类含平行线、重力先验等情形的最小问题,构造多种最小求解器。合成与 Fastec 实验表明方法可在多数场景中给出至少一个正确位姿,适合作为滚动快门 SfM 初始化模块,但稳定性和线特征匹配仍受限。

ICP-3DGS: SfM-free 3D Gaussian Splatting for Large-scale Unbounded Scenes Figure 1
arXiv preprint2025-06-24

ICP-3DGS: SfM-free 3D Gaussian Splatting for Large-scale Unbounded Scenes

Chenhao Zhang, Yezhi Shen, Fengqing Zhu

Purdue University West Lafayette

6D位姿估计三维重建高斯泼溅

针对大尺度室外场景中 SfM 预处理昂贵且在弱纹理、大运动下易失效的问题,ICP-3DGS用单目深度生成点云并结合 G-ICP 与优化细化估计相邻帧位姿,同时以体素密度判断新区域并自适应扩展高斯。实验在 KITTI-360、Tanks and Temples 上同时提升位姿精度与新视角合成质量,在大尺度场景较既有无位姿 3DGS 方法报告超过 9 dB PSNR 增益。

EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splatting Figure 1
Lecture notes in computer science2025-06-26

EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splatting

Taoyu Wu 0009-0008-7991-6869, Yiyi Miao 0009-0008-4488-1272, Zhuoxiao Li 0000-0002-4531-1959, Haocheng Zhao 0000-00018932-8160, Kang Dang 0000-0003-0613-2787, Jionglong Su 0000-0001-5360-6493, Limin Yu 0000-0002-6891-0604, Haoang Li 0000-0002-1576-9408

University of Liverpool, Xi’an Jiaotong-Liverpool University

6D位姿估计相机位姿三维重建高斯泼溅

面向内窥镜手术中弱纹理、非朗伯反光、呼吸运动导致的相机跟踪和稠密重建不稳定问题,EndoFlow-SLAM在3D Gaussian Splatting SLAM中加入光流损失作为几何约束,并结合深度正则化与面向低质量关键帧的高斯细化,以同时约束结构和位姿。其在C3VD静态与StereoMIS动态数据集上优于现有方法,提升新视角合成和位姿估计表现。

CURL-SLAM: Continuous and Compact LiDAR Mapping Figure 1
arXiv preprint2025-06-26

CURL-SLAM: Continuous and Compact LiDAR Mapping

Kaicheng Zhang, Shida Xu, Yining Ding, Xianwen Kong, Sen Wang

Department of Electrical and Electronic Engineering, Imperial College London, W12 BZ, UK, School of Engineering and Physical Sciences, Heriot-Watt University, Edinburgh, EH14 AS, UK

6D位姿估计相机位姿点云

针对点云式 LiDAR SLAM 在大规模场景中存储开销大、降采样损失细节且回环后易不一致的问题,CURL-SLAM 用球谐隐式 CURL 表示构建可更新的超紧凑连续地图,并将位姿估计改写为面向 CURL 的优化,结合局部 BA 同时修正位姿和地图。实验显示其地图质量达到 SOTA、轨迹精度具竞争力,可在 CPU 上以 10 Hz 实时运行。

DidSee: Diffusion-Based Depth Completion for Material-Agnostic Robotic Perception and Manipulation Figure 1
arXiv preprint2025-06-27

DidSee: Diffusion-Based Depth Completion for Material-Agnostic Robotic Perception and Manipulation

Wenzhou Lyu, Jialing Lin, Wenqi Ren, Ruihao Xia, Feng Qian, Technology

East China University of Science and Technology

6D位姿估计彩色深度机器人操作

DidSee面向透明、反光等非朗伯物体中RGB-D相机深度缺失和噪声严重、传统补全泛化不足的问题,指出直接套用扩散模型会受信号泄漏与曝光偏差影响。方法通过零终端SNR噪声调度、噪声无关单步训练和语义增强联合分割/补全来提升边界与物体-背景区分;在三个基准达到SOTA,并改善类别级位姿估计与机器人抓取。

How do Foundation Models Compare to Skeleton-Based Approaches for Gesture Recognition in Human-Robot Interaction? Figure 1
arXiv preprint2025-06-25

How do Foundation Models Compare to Skeleton-Based Approaches for Gesture Recognition in Human-Robot Interaction?

Stephanie Käs, Anton Burenko, Louis Markert, Onur Alp Çulha, Dennis Mack, Timm Linder, Bastian Leibe

Chair for Computer Vision, RWTH Aachen University, Germany. Mail, Robert Bosch GmbH, Corporate Research & Bosch Center for AI, Renningen and Hildesheim, Germany. Mail

6D位姿估计机器人操作

面向仓储/工厂中噪声和远距离条件下的人机非语言交互,论文考察通用视觉/多模态基础模型能否替代专用手势识别模块。其核心在于用新建的 NUGGET 动态上肢手势数据集,对比骨架式 HD-GCN、加分类头的 V-JEPA 与零样本 Gemini。结果显示 HD-GCN 仍最佳,但 V-JEPA 已接近,提示共享视频基础模型有望降低系统复杂度;Gemini 仅凭文本描述难以区分手势。

Consensus-Driven Uncertainty for Robotic Grasping based on RGB Perception Figure 1
arXiv preprint2025-06-26

Consensus-Driven Uncertainty for Robotic Grasping based on RGB Perception

Eric C. Joyce 0009-0000-4581-4399, Qianwen Zhao 0009-0003-0361-1181, Nathaniel Burgdorfer 0009-0004-4706-7373, Long Wang 0000-0003-3476-6779, Philippos Mordohai 0000-0002-9671-4408

Stevens Institute of Technology, Hoboken, NJ 07030, USA

6D位姿估计机器人操作

针对RGB单目6D位姿估计在抓取中常过度自信、指标好却导致执行失败的问题,论文把多个现成位姿估计器的“共识差异”作为不确定性信号,由主估计器负责抓取,MLP学习预测该抓取是否会失败,并用真实图像位姿估计加仿真抓取生成训练数据。结果显示该方法比ADD式基线平均提升4.5%,跨物体联合训练提升至7.27%,但跨夹爪联合未带来同样收益。

Systematic Comparison of Projection Methods for Monocular 3D Human Pose Estimation on Fisheye Images Figure 1
arXiv preprint2025-06-24

Systematic Comparison of Projection Methods for Monocular 3D Human Pose Estimation on Fisheye Images

Stephanie Käs, Sven Peter, Henrik Thillmann, Anton Burenko, David Benjamin Adrian, Dennis Mack, Timm Linder, Bastian Leibe

Chair for Computer Vision, RWTH Aachen University, Germany. Mail, Robert Bosch GmbH, Corporate Research & Bosch Center for AI, Renningen and Hildesheim, Germany. Mail

6D位姿估计人体姿态

面向机器人/车载场景中鱼眼相机大视场带来的单目3D人体姿态畸变问题,本文系统比较针孔、等距、双球面与柱面投影,并将等距/双球面模型接入MeTRAbs,提出基于检测框选择投影的启发式策略。实验显示近距离和大视场人体下针孔重投影不足,双球面等鱼眼模型无需鱼眼数据重训即可显著提升精度,并发布含极近距、地面视角等标注的FISHnCHIPS数据集。

RAG-6DPose: Retrieval-Augmented 6D Pose Estimation via Leveraging CAD as Knowledge Base Figure 1
arXiv preprint2025-06-23

RAG-6DPose: Retrieval-Augmented 6D Pose Estimation via Leveraging CAD as Knowledge Base

Kuanning Wang, Yuqian Fu, Tianyu Wang, Yanwei Fu, Longfei Liang, Yu-Gang Jiang, Xiangyang Xue

Fudan University, China, INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria

6D位姿估计

面向遮挡、弱纹理和合成到真实域差异下的单目 6D 位姿估计,RAG-6DPose 不再把 CAD 仅作监督,而是将多视角渲染的 DINOv2 视觉特征映射回 3D 点,构建含外观、颜色与几何的 CAD 知识库,并通过 ReSPC 检索与解码注入查询图像相关信息。实验显示其在标准基准和真实机器人抓取中更稳健,尤其改善遮挡与新视角场景。

Reproducible Evaluation of Camera Auto-Exposure Methods in the Field: Platform, Benchmark and Lessons Learned Figure 1
IEEE transactions on field robotics2025-06-19

Reproducible Evaluation of Camera Auto-Exposure Methods in the Field: Platform, Benchmark and Lessons Learned

Olivier Gamache, Jean-Michel Fortin, Matěj Boxan, François Pomerleau, Philippe Giguère

6D位姿估计数据集/基准

针对野外视觉 SLAM 中自动曝光算法难以在相同光照与轨迹下复现实验的问题,论文用 BorealHDR 多曝光双目数据和曝光时间仿真器,把在线曝光控制转为离线可重复评测,并公开背包式采集平台细节。数据覆盖 59 条、13.4 km 轨迹,仿真图像相对真值 RMSE 低于 1.78%;对 8 种 AE 方法的基准显示,传统自动曝光仍是整体最佳。

SViP: Sequencing Bimanual Visuomotor Policies with Object-Centric Motion Primitives Figure 1
arXiv preprint2025-06-23

SViP: Sequencing Bimanual Visuomotor Policies with Object-Centric Motion Primitives

Yizhou Chen, Hang Xu, Dongjie Yu, Zeqing Zhang, Yi Ren, Jia Pan

The University of Hong Kong, Centre for Transformative Garment Production (InnoHK), Huawei Technologies Co., Ltd

6D位姿估计

针对小规模示教下双臂视觉运动策略在长时程任务中泛化差、误差累积且依赖6D物体位姿估计的问题,SViP将学习策略嵌入TAMP,用语义场景图切分单双臂技能,并从点云学习切换条件以调度物体中心运动基元。实验显示仅20次真实示教即可适应分布外初始状态、组合未见任务,并优于生成式模仿学习基线。

RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking Figure 1
IROS 20252025-06-20

RGBTrack: Fast, Robust Depth-Free 6D Pose Estimation and Tracking

Teng Guo, Jingjin Yu

Computer Science, Rutgers, the State University of New Jersey, Piscataway, NJ, USA

6D位姿估计彩色深度

针对 FoundationPose 依赖深度、在快速运动/遮挡及 CAD 尺度不准时易失效的问题,RGBTrack 将 2D 跟踪、卡尔曼滤波和状态机接入 RGB-only 6D 位姿流程,并用二分深度搜索结合渲染-比较从真实尺度 CAD 中生成候选,还支持初始深度驱动的尺度恢复。在 YCBinEAOT、ClearPose 等基准上,文中报告其在无深度输入下保持接近实时和有竞争力精度,复杂遮挡与快速运动下跟踪更稳定。

Monocular One-Shot Metric-Depth Alignment for RGB-Based Robot Grasping Figure 1
arXiv preprint2025-06-20

Monocular One-Shot Metric-Depth Alignment for RGB-Based Robot Grasping

Teng Guo, Baichuan Huang, Jingjin Yu

Computer Science, Rutgers University, Piscataway, NJ, USA

6D位姿估计彩色深度机器人操作

针对机器人抓取依赖昂贵且易受透明物体、光照干扰的深度传感器问题,论文提出 MOMA:在固定相机标定阶段用少量真实深度点对单目深度模型输出做尺度-旋转-平移对齐,从单张 RGB 恢复可用的度量深度,无需目标场景再采集和重训。UR-5e 实验中,SSRA 版本推理仅毫秒级,非透明物体双指/吸取抓取成功率超过 80%,透明物体超过 70%,但相较 RGB-D 方法仍有差距。

LunarLoc: Segment-Based Global Localization on the Moon Figure 1
arXiv preprint2025-06-20

LunarLoc: Segment-Based Global Localization on the Moon

Annika Thomas, Robaire Galliath, Aleksander Garbuz, Luke Anger, Cormac O’Neill, Trevor Johst, Dami Thomas, George Lordos, Jonathan P. How

6D位姿估计

月面缺乏 GNSS,VIO 又会在长距离任务中累积漂移,影响采掘和运输等自主操作的精确位姿。LunarLoc 的关键思路是把光照不变的岩石分布作为地标,用开放集实例分割从双目图像零样本提取岩石,并构建地形图与既有参考图做图匹配。论文在 IPEx 数字孪生月面仿真、多会话定位中报告亚厘米级精度,显著优于既有月面全局定位方法,并公开数据与回放模块。

ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models Figure 1
arXiv preprint2025-06-19

ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models

Puhao Li, Yingying Wu, Ziheng Xi, Wanlin Li, Yuzhe Huang, Zhiyuan Zhang, Yinghan Chen, Jianan Wang, Song-Chun Zhu, Tengyu Liu, Astribot Inc

Tsinghua University State Key Lab of General Artificial Intelligence, BIGAI, Peking University Astribot Inc

6D位姿估计

面向真实机器人在少量示教下难以适配新任务的问题,ControlVLA将预训练VLA的动作先验与物体中心表征结合,用ControlNet式零初始化KV投影/交叉注意力逐步注入物体条件,避免破坏原策略。真实任务中仅用10–20条示教达到76.7%成功率,显著高于基线,并展示了长程任务及未见物体、背景的鲁棒性。

STAR-Pose: Efficient Low-Resolution Video Human Pose Estimation via Spatial-Temporal Adaptive Super-Resolution Figure 1
Lecture notes in computer science2025-06-19

STAR-Pose: Efficient Low-Resolution Video Human Pose Estimation via Spatial-Temporal Adaptive Super-Resolution

Yucheng Jin, Jinyan Chen, Ziyue He, Baojun Han, Furan An

Tianjin University

6D位姿估计人体姿态

低分辨率视频中人体只占少量像素,传统HPE依赖高清输入或级联视频超分,既易丢失结构信息又计算开销大。STAR-Pose将任务驱动超分嵌入姿态估计,采用LeakyReLU线性注意力的时空Transformer建模长程帧间关系,并用并行CNN与自适应融合补足局部纹理,姿态感知复合损失引导重建有利于关键点定位的结构特征。在64×48等极低分辨率下,文中报告最高提升5.2% mAP,推理较级联方案快2.8至4.4倍。

KARL: Kalman-Filter Assisted Reinforcement Learner for Dynamic Object Tracking and Grasping Figure 1
arXiv preprint2025-06-19

KARL: Kalman-Filter Assisted Reinforcement Learner for Dynamic Object Tracking and Grasping

Kowndinya Boyalakuntla, Abdeslam Boularias, Jingjin Yu

the Department of Computer Science, Rutgers, University, New Brunswick, USA

6D位姿估计

面向动态场景中腕部相机机器人易丢失目标、工作空间受限且抓取失败难恢复的问题,KARL在6D位姿感知与RL控制之间加入卡尔曼滤波以维持不确定但连续的目标估计,并用六阶段课程学习扩展运动范围、支持多次重试。仿真和真实实验显示其相较EARL获得更高抓取成功率与更快执行速度,但具体增益在多项组件更新间的归因仍不完全清晰。

Beyond Audio and Pose: A General-Purpose Framework for Video Synchronization Figure 1
arXiv preprint2025-06-19

Beyond Audio and Pose: A General-Purpose Framework for Video Synchronization

Yosub Shin

University of Hawai’i at Manoa

6D位姿估计

针对多机位视频在无可靠音频、标记或人体姿态时难以帧级同步的问题,论文提出 VideoSync:用通用视频嵌入逐帧表征,构造跨视频相似度矩阵,再由偏移预测器估计同步帧差,并重建覆盖单人、多人和非人场景的可复现实验集。作者指出 SeSyn-Net 预处理存在偏置、会高估性能;在修正评测后,基于 CNN 的偏移分类器优于 Argmax、DTW、MLP 等方法及 SeSyn-Net。

Improving Robotic Manipulation: Techniques for Object Pose Estimation, Accommodating Positional Uncertainty, and Disassembly Tasks from Examples Figure 1
arXiv preprint2025-06-18

Improving Robotic Manipulation: Techniques for Object Pose Estimation, Accommodating Positional Uncertainty, and Disassembly Tasks from Examples

1 Introduction

6D位姿估计物体位姿机器人操作

该文面向非结构化操作中视觉易被遮挡、抓取后物体姿态会因滑移和外力改变的问题,研究利用触觉信号进行物体位姿/角度估计。核心洞察是把触觉读数视为时间序列,通过滑动窗口采样训练深度模型,而非只用独立瞬时样本,以捕捉抓取过程中的时序相关性。实验表明时间特征有助于改进抓取后角度估计,但片段中未给出完整指标,具体增益幅度文中未充分说明。

PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Maps Figure 1
arXiv preprint2025-06-18

PRISM-Loc: a Lightweight Long-range LiDAR Localization in Urban Environments with Topological Maps

Kirill Muravyev, Artem Kobozev, Vasily Yuryev, Alexander Melekhin, Oleg Bulichev, Dmitry Yudin, Konstantin Yakovlev

Dmitry Yudin 3,4, Oleg Bulichev is also with Innopolis University

6D位姿估计点云

面向城市长距离机器人定位中稠密 LiDAR 地图存储和实时计算成本过高的问题,PRISM-Loc 用紧凑拓扑地图替代全局度量地图,并结合全局地点识别、粗里程计跟踪、直接作用于原始点云的路缘检测与扫描匹配来细化 6D 位姿。在多组大规模户外数据和嵌入式平台上,其 ITLP-Campus 成功率达 99%,单次定位约 150 ms,地图仅 20 MB,结论称平均轨迹误差约 0.5 m。

Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models Figure 1
arXiv preprint2025-06-18

Human Motion Capture from Loose and Sparse Inertial Sensors with Garment-aware Diffusion Models

Andela Ilic, Jiaxi Jiang, Paul Streli

Department of Computer Science, ETH Zürich, Switzerland

6D位姿估计人体姿态

该文针对稀疏 IMU 动捕默认传感器紧贴身体、现实穿衣佩戴更松散导致信号含衣物二次运动的问题,提出 GaIP:用服装感知数据模拟松散 IMU,并以 Transformer 条件扩散模型生成松散信号和回归全身姿态,同时引入衣物松紧等参数。实验在模拟、合成与真实数据上优于现有惯性姿态估计方法,显示对不同服装贴合度更稳健。

RA-NeRF: Robust Neural Radiance Field Reconstruction with Accurate Camera Pose Estimation under Complex Trajectories Figure 1
arXiv preprint2025-06-18

RA-NeRF: Robust Neural Radiance Field Reconstruction with Accurate Camera Pose Estimation under Complex Trajectories

Qingsong Yan, Qiang Wang, Kaiyong Zhao, Jie Chen, Bo Li, Xiaowen Chu, Fei Deng

Jie Chen is with Department of Computer Science, HKBU, China, Xiaowen Chu is with Data Science and Analytics Thrust, HKUST (Guangzhou), China

6D位姿估计相机位姿三维重建

RA-NeRF针对NeRF/3DGS在未知或复杂相机轨迹下高度依赖准确位姿、易陷入局部最优的问题,将增量式重建与光度一致性结合,引入光流驱动的位姿约束和隐式位姿滤波,在SE(3)中抑制梯度噪声并建模运动模式。其在Tanks&Temple和更具挑战的NeRFBuster上同时提升位姿估计精度与渲染质量,达到文中报告的SOTA。

PoseGRAF: Geometric-Reinforced Adaptive Fusion for Monocular 3D Human Pose Estimation Figure 1
arXiv preprint2025-06-17

PoseGRAF: Geometric-Reinforced Adaptive Fusion for Monocular 3D Human Pose Estimation

Ming Xu, Xu Zhang

Liaoning Technical University

6D位姿估计人体姿态

PoseGRAF针对单目2D到3D人体姿态提升中过度依赖关节坐标、忽视骨骼方向与关节角关系的问题,构建关节图与骨骼方向图的双GCN,并用交叉注意力和动态融合自适应结合位置与几何特征,再接残差Transformer输出3D姿态。文中在Human3.6M、MPI-INF-3DHP及野外视频上报告优于现有方法,尤其旨在缓解遮挡和快速复杂运动下的不合理姿态。

Non-Overlap-Aware Egocentric Pose Estimation for Collaborative Perception in Connected Autonomy Figure 1
arXiv preprint2025-06-17

Non-Overlap-Aware Egocentric Pose Estimation for Collaborative Perception in Connected Autonomy

Hong Huang, Dongkuan Xu, Hao Zhang, Peng Gao

Human-Centered Robotics Lab at University of Massachusetts Amherst, Amherst, MA, USA

6D位姿估计

面向车联网等多机器人协同感知,论文针对视角不重叠且带宽受限时相对位姿易误匹配的问题,提出 NOPE:用对象图压缩观测,高层深度图匹配先判断重叠/对应关系,低层位置感知跨注意力估计自车坐标系下队友位姿。仿真与真实实验显示其在非重叠检测、位姿精度和通信量上优于现有方法,报告位置/旋转误差提升超过 53%/78.6%,共享数据量减少约 96 倍。

TACS-Graphs: Traversability-Aware Consistent Scene Graphs for Ground Robot Indoor Localization and Mapping Figure 1
arXiv preprint2025-06-17

TACS-Graphs: Traversability-Aware Consistent Scene Graphs for Ground Robot Indoor Localization and Mapping

Jeewon Kim, Minho Oh, Hyun Myung, Senior Member, IEEE

URobotics Corp., Republic of Korea

6D位姿估计机器人操作

针对室内3D场景图在复杂结构中易把不可通行区域并入房间、或将同一房间过度切分,进而影响地面机器人定位与建图的问题,论文提出TACS-Graphs,用机器人可通行性而非单纯体素几何邻近来约束房间边界,并以一致房间层辅助CoSG-LCD回环检测。实验显示其场景图一致性和位姿图优化精度优于现有方法。

Diffusion-based Inverse Observation Model for Artificial Skin Figure 1
arXiv preprint2025-06-16

Diffusion-based Inverse Observation Model for Artificial Skin

Ante Marić12, Julius Jankowski12, Giammarco Caroleo3, Alessandro Albini3, Perla Maiolino3, Sylvain Calinon12

Idiap Research Institute, Martigny, Switzerland, Oxford Robotics Institute (ORI), University of, Oxford, UK

6D位姿估计

面向接触观测不连续、同一触觉信号对应多种物体位姿而导致采样低效的问题,论文用条件 DDPM 学习分布式人工皮肤的逆触觉观测模型,直接生成满足接触约束的位姿假设。仿真平面位姿估计与粒子滤波实验表明,触觉条件化可提高假设采样效率,减少达到准确估计所需接触次数并加快收敛;真实机器人验证仍未充分说明。

ATK: Automatic Task-driven Keypoint Selection for Robust Policy Learning Figure 1
arXiv preprint2025-06-16

ATK: Automatic Task-driven Keypoint Selection for Robust Policy Learning

Yunchu Zhang, Shubham Mittal, Zhengyu Zhang, Liyiming Ke Siddhartha Srinivasa

Yunchu Zhang Shubham Mittal Zhengyu Zhang Liyiming Ke, Paul G. Allen School of Computer Science and Engineering, University of Washington

6D位姿估计

针对视觉运动策略在仿真到真实、光照/外观变化和遮挡下易失效,以及6D位姿等状态估计难以扩展的问题,ATK将可跟踪2D关键点作为中间状态,并用任务驱动的掩码优化从候选点中选择能预测专家动作的最小集合,同时蒸馏策略。实验覆盖透明、精细和可变形物体操作,显示该紧凑关键点表示提升了视觉扰动与环境变化下的鲁棒性;但对相机视角、跟踪器和超参数仍较敏感。

JENGA: Object selection and pose estimation for robotic grasping from a stack Figure 1
arXiv preprint2025-06-16

JENGA: Object selection and pose estimation for robotic grasping from a stack

Sai Srinivas Jeevanandam, Sandeep Inuganti, Shreedhar Govil, Didier Stricker, RPTU Kaiserslautern

German Research Center for Artificial Intelligence (DFKI)

6D位姿估计机器人操作

面向施工、仓储中常见的规则堆叠物体,论文指出传统 bin-picking 或单纯 6D 位姿估计会给出被遮挡、不可抓的目标。JENGA 将问题定义为“可抓物选择+位姿估计”,构建堆叠砖块合成数据集与联合评价指标,并融合相机位姿、物体可见掩码和 IMU 重力线索优先选择高层低遮挡物体。实验和真实砖块抓取部署显示其优于仅靠检测置信度或惯性线索的基线,但完全无错抓取仍很困难。

Automatic Multi-View X-Ray/CT Registration Using Bone Substructure Contours Figure 1
International Journal of Computer Assisted Radiology and Surgery2025-06-16

Automatic Multi-View X-Ray/CT Registration Using Bone Substructure Contours

Leon Nissen, Bastian Sigrist, Arend Nieuwland, Nicola Cavalcanti, Philipp Fürnstahl, Thomas Dreher, Lilian Calvet

University Children's Hospital Zurich, University of Zurich

6D位姿估计多视角

面向骨科术中导航中 X-ray/CT 配准对高精度、宽初值鲁棒性和少人工干预的需求,论文将多视角轮廓 ICP 从整骨轮廓匹配改为按骨性子结构语义轮廓匹配,以减少对应歧义;方法仅需两张 X 光并全自动运行,在真实尸体股骨数据上 mRPD 达 0.67 mm,明显优于需人工介入的商业方案 5.35 mm。

DETRPose: Real-time end-to-end transformer model for multi-person pose estimation Figure 1
arXiv preprint2025-06-16

DETRPose: Real-time end-to-end transformer model for multi-person pose estimation

Sebastian Janampa

Department of Electrical & Computer Engineering, The University of New Mexico

6D位姿估计

针对现有 DETR/Transformer 多人姿态估计精度尚可但解码器延迟高、难以实时的问题,DETRPose 将 DETR 改为端到端 2D MPPE 框架,核心在于面向关键点的改进解码器、基于 Keypoint Similarity 的正负查询去噪、Pose-LQE 与新的查询质量损失。实验显示 DETRPose-L 在 COCO val2017 达到 72.5 mAP、32.5ms 延迟且无需 TensorRT,并以 48 epochs 收敛,较 RTMO 训练轮数显著减少。

A large-scale, physically-based synthetic dataset for satellite pose estimation Figure 1
arXiv preprint2025-06-15

A large-scale, physically-based synthetic dataset for satellite pose estimation

Szabolcs Velkei, Csaba Goldschmidt, Károly Vass

Machine Intelligence Research Institute, Machine Intelligence Research Labs

6D位姿估计仿真到现实数据集/基准航天器

面向在轨交会、服务和碎片清除中真实标注稀缺、光照与材质复杂导致的卫星6D位姿估计难题,论文提出DLVS3合成数据生成管线与HST-V1数据集,结合Houdini/Unreal、MaterialX、SPICE、地球反照等物理光照、材质老化和域随机化,输出位姿、关键点、分割、深度和法线标注。主要结果是提供更大规模、更高保真且支持铰接目标的训练/评测基准;对实际模型精度提升文中未充分说明,增益可能主要来自高质量仿真与数据规模。

ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimation Figure 1
arXiv preprint2025-06-13

ViTaSCOPE: Visuo-tactile Implicit Representation for In-hand Pose and Extrinsic Contact Estimation

Jayjun Lee, Nima Fazeli

Robotics Department, University of Michigan

6D位姿估计手部姿态

面向灵巧操作中视觉遮挡、触觉局部且噪声大的难题,ViTaSCOPE将物体SDF、视觉点云与基于剪切场的高分辨率触觉反馈统一到物体中心隐式表示中,同时优化手内6D位姿并把外部接触注册到3D表面。论文还用GPU触觉仿真扩充训练数据以做sim-to-real迁移;仿真和真实实验显示,视觉与剪切触觉互补可提升接触定位和位姿估计,但仍依赖已知几何与高保真触觉。

Monocular 3D Hand Pose Estimation with Implicit Camera Alignment Figure 1
arXiv preprint2025-06-10

Monocular 3D Hand Pose Estimation with Implicit Camera Alignment

Christos Pantazopoulos, Spyridon Thermos, Computer Engineering, Greece Moverse cpantazop@uth.gr, spiros@moverse.ai, gpotam@ieee.org

Department of Electrical and Computer Engineering, University of Thessaly, Greece

6D位姿估计手部姿态

单目 RGB 手部 3D 姿态在机器人交互、AR/VR 中实用,但常受缺深度、遮挡和未知相机内参限制。本文将 MediaPipe 2D 关键点与 MANO 手模型拟合结合,设计先刚体对齐、再用指尖损失和解剖约束细化的免相机参数优化流程。其在 EgoDexter 与 Dexter+Object 上接近现有方法,并展示野外图像鲁棒性;但性能仍明显依赖 2D 关键点精度。

Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoders Figure 1
arXiv preprint2025-06-12

Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoders

Hui Yang, Wei Sun, Jian Liu, Jin Zheng, Jian Xiao, Ajmal Mian

6D位姿估计物体位姿手部姿态

针对单目 RGB 手物交互中自遮挡和互遮挡导致关键点/SDF 估计不稳的问题,HOMAE 将 MAE 用于遮挡感知学习:在手物交互区域做目标聚焦 masking,促使模型补全被遮挡结构,并融合解码器多尺度特征预测 SDF,再结合由 SDF 提取的显式点云强化局部几何。论文在 DexYCB 与 HO3Dv2 上报告达到 SOTA,但极端遮挡下仍会失效。

In-Hand Object Pose Estimation via Visual-Tactile Fusion Figure 1
arXiv preprint2025-06-12

In-Hand Object Pose Estimation via Visual-Tactile Fusion

Felix Nonnengießer, Alap Kshirsagar, Boris Belousov, Jan Peters

Department of Computer Science, Goethe Universität Frankfurt, Germany

6D位姿估计物体位姿手部姿态

针对手内操作中夹爪遮挡导致纯视觉6D位姿估计失效的问题,论文将腕部RGB-D点云与指尖视觉触觉传感器的局部几何点云融合,并在加权ICP中调节两类模态贡献,无需针对新物体大量训练或初始位姿。实验显示触觉在高遮挡时收益更明显,平均误差为7.5 mm、16.7°,相对视觉基线最高提升约20%,并完成真实插入任务。

Fluoroscopic Shape and Pose Tracking of Catheters with Custom Radiopaque Markers Figure 1
arXiv preprint2025-06-11

Fluoroscopic Shape and Pose Tracking of Catheters with Custom Radiopaque Markers

Jared Lawson, Rohan Chitale, Nabil Simaan

Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235, USA, Department of Neurological Surgery, Vanderbilt University Medical Center, Nashville, TN 37235, USA

6D位姿估计

面向脑血管微导管导航中医生需从双平面透视心算三维形状与滚转姿态、且EM/FBG等传感难以嵌入小直径导管的问题,论文在导管外表布置定制不透射线标记,结合双平面分割、三维重建与标记布局灵敏度优化,同时估计形状和6D姿态;在≤2 mm微导管血管模型实验中实现<1 mm形状误差、滚转误差<40°。

EquiCaps: Predictor-Free Pose-Aware Pre-Trained Capsule Networks Figure 1
arXiv preprint2025-06-11

EquiCaps: Predictor-Free Pose-Aware Pre-Trained Capsule Networks

Athinoulla Konstantinou, Georgios Leontidis, Mamatha Thota, Aiden Durrant, School of Natural, Computing Sciences, School of Computer Science

School of Natural and Computing Sciences, University of Aberdeen, UK, Interdisciplinary Institute, School of Computer Science, University of Lincoln, UK

6D位姿估计

针对自监督等变学习常依赖额外 predictor、且在6D/多几何位姿任务中可能丢失变换信息的问题,EquiCaps利用胶囊网络本身的姿态感知与部件-整体路由,构建无需专用预测器的等变表征,并提出含旋转和平移的3DIEBench-T评测。实验中其在3DIEBench旋转预测达到R²=0.78,较SIE和CapsIE分别高0.05/0.04,并在组合几何变换下保持更稳健的等变性能。

Accurate and efficient zero-shot 6D pose estimation with frozen foundation models Figure 1
arXiv preprint2025-06-11

Accurate and efficient zero-shot 6D pose estimation with frozen foundation models

Andrea Caraffa, Davide Boscaini, Fabio Poiesi

6D位姿估计

面向机器人操作中未见物体的6D位姿估计,论文质疑依赖大规模合成数据训练的必要性,提出训练-free的FreeZeV2:冻结视觉与几何基础模型,离线保留物体稠密特征、在线仅抽取场景稀疏特征,并用结合几何对齐与特征相似度的打分选择位姿、支持分割模型集成。其在BOP七个核心数据集刷新零样本SOTA,同掩码下较FreeZe提速8倍且AR提升约5%。

CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settings Figure 1
arXiv preprint2025-06-11

CHIP: A multi-sensor dataset for 6D pose estimation of chairs in industrial settings

Mattia Nardon, FBK-TeV, mnardon@fbk.eu, &Mikel Mujika Agirre

6D位姿估计数据集/基准

面向工业机器人喷涂等任务,现有6D位姿基准多为家居或受控桌面场景,难以检验真实工厂泛化。CHIP用机械臂替代转台采集7把木椅的多传感器RGBD数据,并由机器人运动学自动生成77,811帧位姿标注,包含相似干扰椅、机械臂/人员遮挡和深度噪声。对SAM-6D、FreeZe等零样本方法的评测显示,在遮挡、杂乱和定位先验不准时误差仍大,说明该数据集能暴露现有方法的工业落地短板。

Princeton365: A Diverse Dataset with Accurate Camera Pose Figure 1
arXiv preprint2025-06-10

Princeton365: A Diverse Dataset with Accurate Camera Pose

Karhan Kayan, Stamatis Alexandropoulos, Rishabh Jain, Yiming Zuo, Erich Liang

6D位姿估计相机位姿数据集/基准

现有 SLAM 基准常在位姿精度、场景多样性与完整 6DoF 运动之间取舍,限制了方法诊断。Princeton365 用带唯一标记的标定板和 360°相机分离用户视图/真值视图,并通过位姿图、PnP 与 Bundle PnP 优化生成真值,构建了含室内、室外和物体扫描的 365 段同步单目/双目/IMU 数据;文中报告可达毫米级精度,并提出尺度感知光流误差指标及更具挑战的非朗伯 NVS 基准。

ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds Figure 1
arXiv preprint2025-06-10

ArrowPose: Segmentation, Detection, and 5 DoF Pose Estimation Network for Colorless Point Clouds

1 Frederik Hagelskjær

SDU Robotics, Mærsk Mc-Kinney Møller Institute, University of Southern Denmark

6D位姿估计点云

面向无 RGB 或颜色不可靠的工业场景,ArrowPose针对仅含几何信息的点云做检测与位姿估计,避免依赖RGB检测器。其核心是结合DGCNN/PointNet++思想处理大规模点云,通过语义分割、中心点与顶点预测及聚类,直接恢复圆柱对称物体的5DoF位姿。方法用合成数据训练,在IC-BIN真实基准上超过其他depth-only方法,推理约250 ms,但适用性主要限于旋转对称物体。

UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial References Figure 1
arXiv preprint2025-06-09

UA-Pose: Uncertainty-Aware 6D Object Pose Estimation and Online Object Completion with Partial References

Ming-Feng Li, Xin Yang, Fu-En Wang, Hritam Basak, Yuyin Sun, Shreekant Gayaka, Min Sun, Cheng-Hao Kuo

Carnegie Mellon University Stony Brook University National Tsing Hua University, Amazon

6D位姿估计物体位姿

UA-Pose针对真实机器人场景中难以获得完整CAD模型或密集参考视角的问题,研究仅有少量RGBD参考甚至单张RGB图时的6D位姿估计。其核心是把未观测区域的不确定性显式注入纹理-几何混合3D表示,用于位姿置信度评估,并在线选择信息量高的观测补全物体模型。在YCB-Video、YCBInEOAT和HO3D上,相比现有方法在部分观测条件下提升位姿精度与模型完整性。

Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation Figure 1
arXiv preprint2025-06-09

Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation

Yijie Deng, Shuaihang Yuan, Geeta Chandra Raju Bethala, Anthony Tzes, Yu-Shen Liu, Yi Fang, NYUAD Center for Artificial Intelligence, Robotics (CAIR, Abu Dhabi, Electrical Engineering, Abu Dhabi 129188, Electrical, Computer Engineering Dept, Brooklyn, NY 11201, USA. Embodied AI, Robotics (AIR) Lab, NYU Abu Dhabi, UAE. School of Software, Beijing, China

Geeta Chandra Raju Bethala 1,2,4, NYUAD Center for Artificial Intelligence and Robotics (CAIR), Abu Dhabi, UAE, New York University Abu Dhabi, Electrical Engineering, Abu Dhabi 129188, UAE, New York University, Electrical & Computer Engineering Dept., Brooklyn, NY 11201, USA, Embodied AI and Robotics (AIR) Lab, NYU Abu Dhabi, UAE, School of Software, Tsinghua University, Beijing, China

6D位姿估计三维重建高斯泼溅

针对实例图像目标导航中3DGS方法依赖随机/密集采样视角、渲染与匹配冗余高的问题,论文提出分层评分框架:先用CLIP相关场在高斯场中筛出语义候选区域,再用DINOv2特征与射线级几何匹配细化位姿,从而主动选择有效视角。实验显示其在模拟IIN基准达到SOTA,并展示了真实室内可用性。

From Generation to Generalization: Emergent Few-Shot Learning in Video Diffusion Models Figure 1
arXiv preprint2025-06-10

From Generation to Generalization: Emergent Few-Shot Learning in Video Diffusion Models

Pablo Acuaviva, pablo.acuavivahuertos@unibe.ch, &Aram Davtyan 1 1, aram.davtyan@unibe.ch

Computer Vision Group, University of Bern — VITA Lab, EPFL —

6D位姿估计

论文关注视频扩散模型是否在生成训练中形成可迁移的视觉表征,而不只是会合成视频。其核心做法是把各类输入—输出图像任务重写为“从输入过渡到输出”的短视频,在冻结VDM主体的情况下仅训练LoRA,从少量样本适配新任务。实验显示该框架可泛化到分割、人体/姿态估计、几何变换、风格迁移及ARC类视觉推理;但推理和微调成本仍高,RGB编码带来的精度与颜色偏移限制也较明显。

GoTrack: Generic 6DoF Object Pose Refinement and Tracking Figure 1
arXiv preprint2025-06-08

GoTrack: Generic 6DoF Object Pose Refinement and Tracking

Van Nguyen Nguyen, Christian Forster, Sindi Shkodrani, Vincent Lepetit, Bugra Tekin, Cem Keskin, Tomas Hodan

Meta Reality Labs

6D位姿估计物体位姿

GoTrack面向机器人与AR/VR中连续帧6DoF物体位姿估计需求,针对现有跟踪过度依赖模型到图像配准、计算重且稳定性不足的问题,引入类似SLAM的帧间配准:用DINOv2上的Transformer预测模板到图像光流与可见掩码,经2D-3D对应和PnP-RANSAC细化位姿,并用轻量帧间光流传播对应点以减少重配准。该RGB-only、无需物体专属训练的CAD方法在标准位姿细化与跟踪基准上达到SOTA,并在遮挡下提升稳定性。

UNO: Unified Self-Supervised Monocular Odometry for Platform-Agnostic Deployment Figure 1
arXiv preprint2025-06-08

UNO: Unified Self-Supervised Monocular Odometry for Platform-Agnostic Deployment

Wentao Zhao, Yihe Niu, Yanbo Wang, Tianchen Deng, Shenghai Yuan, Zhenli Wang, Rui Guo, Jingchuan Wang

Institute of Medical Robotics and Department of Automation, Shanghai Jiao Tong University, Shanghai, China, School of Mathematical Sciences Shanghai Jiao Tong University, Shanghai Jiao Tong University, Shanghai, China, The Centre for Advanced Robotics Technology Innovation (CARTIN), School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore, State Grid Intelligence Technology CO., LTD

6D位姿估计相机位姿

UNO针对自监督单目VO在车辆、无人机、手持等平台间运动模式差异大、传统单一位姿解码器易漂移的问题,将多专家轻量解码器、可微Gumbel-Softmax帧间图选择与剪枝、结合尺度无关深度先验的滑窗BA后端串联起来,实现运行时自适应前端和几何一致性优化。在KITTI、EuRoC-MAV和TUM-RGBD上报告达到或超过现有自监督方法的精度,但具体增益中基础模型深度先验带来的贡献仍需结合消融判断。

Deep Inertial Pose: A deep learning approach for human pose estimation Figure 1
arXiv preprint2025-06-07

Deep Inertial Pose: A deep learning approach for human pose estimation

Sara M. Cerqueira, Manuel Palermo, Cristina P. Santos

6D位姿估计人体姿态

论文针对惯性动捕依赖昂贵专有软件、复杂传感器融合与人体生物力学标定的问题,尝试用神经网络直接学习 MARG/IMU 数据到人体关节姿态的映射,并比较低成本 MPU9250 与高端 MTw Awinda 传感器及多种网络/混合方案。核心洞察是将 LSTM 与 Madgwick 滤波解耦结合可在不完全依赖传统建模的情况下逼近经典融合滤波效果;最佳方案在 MTw Awinda 数据上四元数角距离误差为 7.96°,消融还分析了增强、窗口、损失、输出表示和磁力计的影响。

Dy3DGS-SLAM: Monocular 3D Gaussian Splatting SLAM for Dynamic Environments Figure 1
arXiv preprint2025-06-06

Dy3DGS-SLAM: Monocular 3D Gaussian Splatting SLAM for Dynamic Environments

Mingrui Li, Yiming Zhou, Hongxing Zhou, Xinggang Hu, Florian Roemer, Hongyu Wang, Ahmad Osman

Dalian University of Technology, Saarland University, Beijing University of Chemical Technology, Fraunhofer Institute for Nondestructive Testing

6D位姿估计相机位姿三维重建高斯泼溅

面向真实场景中动态物体导致单目 3DGS/NeRF SLAM 跟踪失稳、重建污染的问题,Dy3DGS-SLAM用光流运动线索与单目深度几何一致性进行概率式动态掩码融合,并将掩码引入位姿运动损失和动态像素的颜色/深度渲染约束,以削弱遮挡与瞬态物体影响。实验称其在三个真实数据集上取得优于或接近现有 RGB-D 动态 SLAM 的跟踪与渲染效果。

SurGSplat: Progressive Geometry-Constrained Gaussian Splatting for Surgical Scene Reconstruction Figure 1
arXiv preprint2025-06-06

SurGSplat: Progressive Geometry-Constrained Gaussian Splatting for Surgical Scene Reconstruction

Yuchao Zheng, Jianing Zhang, Guochen Ning, Hongen Liao

Tsinghua University, Fudan University

6D位姿估计三维重建高斯泼溅医学/手术

面向内窥镜手术中纹理稀疏、反光和光照变化导致 SfM 初始化与位姿估计易失败的问题,SurGSplat 将无 SfM 的 3D Gaussian Splatting 与视频时序渐进优化结合,通过单目深度初始化、局部到全局高斯融合,并引入投影几何一致性和深度几何相关损失联合约束位姿与结构。实验显示其在手术场景新视角合成和相机位姿精度上优于对比方法,可更稳定重建血管等细节。

CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easy Figure 1
arXiv preprint2025-06-06

CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easy

Jiakai Zhang 1, Shouchen Zhou 1, Haizhao Dai 1, Xinhang Liu 3

ShanghaiTech University, Cellverse, Co., Ltd, HKUST

6D位姿估计三维重建

针对冷冻电镜从无序低信噪粒子图像进行 ab initio 重建仍依赖逐目标迭代位姿搜索、耗时且易陷局部最优的问题,CryoFastAR 将 DUSt3R 式几何基础模型引入显微重建,用 ViT 融合多视图特征并预测可转为 5D 位姿的傅里叶平面图,结合大规模仿真、真实噪声/CTF 扰动和渐进训练提升鲁棒性。实验显示其在合成与真实数据上重建质量接近或优于传统方法,并将推理/重建时间降低一个数量级以上。

You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Grasping Figure 1
ICRA 20252025-06-06

You Only Estimate Once: Unified, One-stage, Real-Time Category-level Articulated Object 6D Pose Estimation for Robotic Grasping

Jingshun Huang, Haitao Lin, Tianyu Wang, Yanwei Fu, Yu-Gang Jiang, Xiangyang Xue

Fudan University, Tencent Robotics X Lab, Shenzhen, China

6D位姿估计物体位姿类别级位姿机器人操作

面向机器人抓取中铰接物体部件多、类别内形变和跨类别上下文差异导致的实时位姿感知难题,YOEO将语义分割、实例中心偏移和NPCS坐标预测统一到单阶段点云网络中,再聚类并配准恢复部件6D位姿与尺寸,减少级联误差和计算开销。其在GAPart上验证了位姿估计能力,并以合成训练模型在真实Kinova系统中实现200Hz视觉反馈,操作未见铰接物体。

On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Images Figure 1
ACM Transactions on Graphics 44, 4 (August 2025)2025-06-05

On-the-fly Reconstruction for Large-Scale Novel View Synthesis from Unposed Images

Andreas Meuleman, Ishaan Shah, Alexandre Lanvin, Bernhard Kerbl, George Drettakis

6D位姿估计三维重建

针对无位姿图像构建3DGS时,SfM与训练耗时长、SLAM又难处理宽基线和大场景的问题,论文提出边采集边重建流程:用学习特征匹配与GPU友好的小型BA快速给初始位姿,再按像素概率直接采样高斯位置和尺度,并用滑窗anchor聚类/卸载扩展到大规模场景。实验显示其能在目标采集场景中实现捕获结束即得到相机位姿和可用3DGS,速度或画质与专用方法保持竞争力。

Rectified Point Flow: Generic Point Cloud Pose Estimation Figure 1
arXiv preprint2025-06-05

Rectified Point Flow: Generic Point Cloud Pose Estimation

Tao Sun ∗

Stanford University, NVIDIA Research

6D位姿估计点云

这篇论文针对点云配准与多部件装配长期依赖任务特定姿态回归、难处理对称和可互换部件的问题,将二者统一为条件生成式点流学习:从噪声点到目标装配位置的连续速度场中恢复6D位姿,并用重叠感知编码器强化部件接触关系。其优势在于绕开显式对称标签和SE(3)姿态向量回归,可跨异构数据联合训练;在六个配准/装配基准上报告了超过现有方法的结果。

Realizing Text-Driven Motion Generation on NAO Robot: A Reinforcement Learning-Optimized Control Pipeline Figure 1
arXiv preprint2025-06-05

Realizing Text-Driven Motion Generation on NAO Robot: A Reinforcement Learning-Optimized Control Pipeline

Zihan Xu, Mengxian Hu, Kaiyan Xiao, Qin Fang, Chengju Liu, Qijun Chen, Senior Member, IEEE

6D位姿估计机器人操作

针对文本生成的人体动作难以直接满足人形机器人运动学约束与稳定执行的问题,本文构建从文本扩散模型到NAO实机控制的流水线:用基于归一化位置与旋转损失的角度信号网络做姿态映射,再由IsaacLab中训练的强化学习全身控制策略跟踪关节命令。实验展示了多种文本驱动动作可迁移到真实NAO机器人上,但定量增益与各模块贡献文中未充分说明。

CzechLynx: A Dataset for Individual Identification and Pose Estimation of the Eurasian Lynx Figure 1
arXiv preprint2025-06-05

CzechLynx: A Dataset for Individual Identification and Pose Estimation of the Eurasian Lynx

Lukas Picek, Elisa Belotti, Michal Bojda, Luděk Bufka, Vojtech Čermak, Martin Dula, Rostislav Dvořák, Luboslav Hrdý, Miroslav Jirik, Václav Kocourek, Josefa Krausová, Jiří Labuda, Jakub Straka, Luděk Toman, Vlado Trulík, Martin Váňa, Miroslav Kutal

Faculty of Applied Sciences, University of West Bohemia in Pilsen, Czechia, Inria, LIRMM, University of Montpellier, France, Faculty of Forestry and Wood Sciences, Czech University of Life Sciences Prague, Czechia, Department of Research and Nature Protection, Šumava National Park, Center for Machine Perception, Czech Technical University in Prague, Czechia, Jiří Labuda

6D位姿估计数据集/基准

面向欧亚猞猁长期相机陷阱监测中个体识别、姿态与分割数据稀缺且跨地域/跨时间泛化困难的问题,CzechLynx整理了15年、两地区319只个体的39,760张实拍图,提供身份、实例掩码和20点骨架标注,并配套Unity合成数据生成流程。论文主要结果是形成开放基准与geo-aware、time-aware开/闭集三类协议,便于评估真实生态场景下模型鲁棒性;具体算法增益文中未作为重点充分说明。

SupeRANSAC: One RANSAC to Rule Them All Figure 1
arXiv preprint2025-06-05

SupeRANSAC: One RANSAC to Rule Them All

Daniel Barath

D. Barath was with ETH Zurich

6D位姿估计

论文针对不同RANSAC库在单项几何任务上表现不均、实际性能常受求解器选择、退化检测和局部优化等细节主导的问题,提出统一的SupeRANSAC流水线,并按单应、基础/本质矩阵、绝对/刚体位姿分别配置采样与验证策略。在11个公开数据集、稀疏和稠密匹配上,它整体优于OpenCV、PoseLib、GC-RANSAC等基线,基础矩阵估计平均约提升6个AUC点。

LGM-Pose: A Lightweight Global Modeling Network for Real-time Human Pose Estimation Figure 1
arXiv preprint2025-06-05

LGM-Pose: A Lightweight Global Modeling Network for Real-time Human Pose Estimation

Biao Guo, Cong Zhou, Fangmin Guo, Xiaonan Luo, Guibo Luo

6D位姿估计人体姿态

面向端侧实时多人姿态估计,论文针对轻量HRNet类多分支CNN延迟高、全局上下文建模弱的问题,提出近似单分支的LGM-Pose:用MobileViM/LARM通过非参数变换与MLP在patch内外交换信息,并以SFusion补足多尺度融合。COCO和MPII实验显示其在参数更少的同时,相比主流轻量方法取得更高精度和更快速度。

Photoreal Scene Reconstruction from an Egocentric Device Figure 1
arXiv preprint2025-06-04

Photoreal Scene Reconstruction from an Egocentric Device

Zhaoyang Lv, Maurizio Monge, Ka Chen, Yufeng Zhu, Michael Goesele, Jakob Engel, Zhao Dong, Richard Newcombe

Reality Labs Research, Meta

6D位姿估计三维重建

论文针对头戴自我中心设备在快速头动、滚动快门和高动态光照下,仅用帧率6DoF位姿会损害像素级重建的问题,提出用VIBA估计高频连续轨迹并在Gaussian Splatting中显式建模滚动快门、曝光/增益、镜头阴影等成像过程。基于Project Aria并迁移到Quest3的实验显示,VIBA约带来+1 dB PSNR,成像模型再提升约+1 dB,改善细节清晰度和新视角渲染质量。

cuVSLAM: CUDA accelerated visual odometry Figure 1
arXiv preprint2025-06-04

cuVSLAM: CUDA accelerated visual odometry

Alexander Korovko, Dmitry Slepichev, Alexander Efitorov, Aigul Dzhumamuratova, Viktor Kuznetsov, Hesam Rabeti, Joydeep Biswas, Soha Pouya

NVIDIA, Dmitry Slepichev

6D位姿估计相机位姿

面向机器人在边缘设备上实时、稳健获得相机位姿的需求,cuVSLAM将传统视觉SLAM流水线用CUDA重构,支持单RGB到32相机、可选IMU/深度的任意传感器配置,并以前端低延迟里程计、后端异步回环与位姿图优化分离实现可部署性。实验显示其在KITTI平均轨迹误差低于1%、EuRoC位置误差低于5厘米,并可在Jetson上实时运行,多立体配置在困难序列上提升鲁棒性。

Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation Figure 1
arXiv preprint2025-06-04

Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation

Tianyu Huang, Wangguandong Zheng, Tengfei Wang, Yuhao Liu, Zhenwei Wang, Junta Wu, Jie Jiang, Hui Li, Rynson W.H. Lau, Wangmeng Zuo, Chunchao Guo

Harbin Institute of Technology, Southeast University, Tencent Hunyuan, City University of Hong Kong

6D位姿估计

面向游戏、VR与机器人仿真中可沿自定义相机路径探索的三维场景构建,Voyager将视频扩散从纯RGB生成推进到联合RGB-D生成:用可扩展世界缓存投影已有点云作为条件,并通过点裁剪与平滑自回归采样延长轨迹,同时以自动位姿和尺度深度的数据引擎扩充训练。实验显示其在长程一致性、几何精度和WorldScore等指标上优于多类视频/3D基线,可直接重建点云并支持风格迁移、深度估计等应用。

Accelerating SfM-based Pose Estimation with Dominating Set Figure 1
arXiv preprint2025-06-04

Accelerating SfM-based Pose Estimation with Dominating Set

Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar

Indian Institute of Science, Shalabh Bhatnagar

6D位姿估计

针对 SfM 位姿估计精度高但参考图像与点云规模大、难以实时用于机器人/AR/VR的问题,论文将 SfM 模型表示为图,并用近似最小支配集筛除冗余参考图像和关联点,在不改动下游匹配与 PnP 框架的情况下做预处理加速。OnePose 实验显示推理速度提升 1.5–14.48 倍,参考图像减少 17–23 倍、点云减少 2.27–4 倍,但边界视角覆盖不足时可能带来精度下降。

Learning Pyramid-structured Long-range Dependencies for 3D Human Pose Estimation Figure 1
IEEE Transactions on Multimedia2025-06-03

Learning Pyramid-structured Long-range Dependencies for 3D Human Pose Estimation

Mingjie Wei, Xuemei Xie, Yutong Zhong, Guangming Shi

Xidian University

6D位姿估计人体姿态

本文针对单目2D到3D人体姿态提升中,现有GCN偏重邻近关节、注意力又易引入噪声且模型变大的问题,提出用金字塔结构把关节、肢体和身体区域等层级子结构纳入自注意力。核心模块PGA并行建模跨尺度长程依赖,并与图卷积组成轻量PGFormer。实验在Human3.6M和MPI-INF-3DHP上取得更低误差和更小模型,插件与扩散模型实验也显示其可迁移性。

GeneA-SLAM2: Dynamic SLAM with AutoEncoder-Preprocessed Genetic Keypoints Resampling and Depth Variance-Guided Dynamic Region Removal Figure 1
Lecture notes in computer science2025-06-03

GeneA-SLAM2: Dynamic SLAM with AutoEncoder-Preprocessed Genetic Keypoints Resampling and Depth Variance-Guided Dynamic Region Removal

Shufan Qing, Anzhen Li, Qiandi Wang, Yuefeng Niu, Mingchen Feng, Guoliang Hu, Jinqiao Wu, Fengtao Nan, Yingchun Fan

Northwest A&F University

6D位姿估计相机位姿彩色深度

面向动态室内场景中检测框或语义掩码漏检导致的位姿漂移与点云拖影,GeneA-SLAM2不依赖动态物体语义先验,而用深度方差生成精细动态区域掩码,并结合自编码器重构与遗传重采样改善特征点均匀性。实验在多组高动态序列上显示,其相机位姿精度和无拖影点云构建优于或接近现有动态SLAM方法。

Rig3R: Rig-Aware Conditioning for Learned 3D Reconstruction Figure 1
arXiv preprint2025-06-02

Rig3R: Rig-Aware Conditioning for Learned 3D Reconstruction

Samuel Li, Pujith Kachana, Prajwal Chidananda, Saurabh Nair, Yasutaka Furukawa, Matthew A. Brown

Carnegie Mellon University

6D位姿估计三维重建

Rig3R针对DUSt3R等前馈多视角重建将多相机图像视作无序集合、难利用车载/机器人同步相机rig先验的问题,提出可选元数据条件化的Transformer,并联合预测点图、全局raymap与rig相对raymap,使缺失标定时也能从图像发现rig结构并闭式恢复位姿。实验在多种真实驾驶rig数据上显示,其在三维重建、相机位姿和rig发现上超过传统与学习方法,mAA提升约17–45%,且无需迭代后处理。

E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Models Figure 1
arXiv preprint2025-06-02

E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Models

Wenyan Cong, Yiqing Liang, Yancheng Zhang, Ziyi Yang, Yan Wang, Boris Ivanovic, Marco Pavone, Chen Chen, Zhangyang Wang, Zhiwen Fan

University of Texas at Austin, Brown University, University of Central Florida, NVIDIA Research, Stanford University

6D位姿估计数据集/基准

面向机器人等实时空间智能场景,传统 SfM/SLAM 管线成本高且对稀疏视角、动态场景不稳,E3D-Bench因此系统评测端到端3D几何基础模型。其核心贡献是统一数据处理、指标与效率协议,覆盖16个GFM、五类任务及跨域数据。结果显示现有模型在深度和相对位姿等子任务上较稳,完整3D重建和极端分布迁移仍明显不足;前馈/扩散架构无绝对赢家,推理延迟与显存仍限制实时部署。

SteerPose: Simultaneous Extrinsic Camera Calibration and Matching from Articulation Figure 1
arXiv preprint2025-06-02

SteerPose: Simultaneous Extrinsic Camera Calibration and Matching from Articulation

Sang-Eun Lee

Graduate School of Informatics, Kyoto University, Kyoto Institute of Technology

6D位姿估计

该文针对野外多相机动捕中外参标定繁琐、跨视角个体匹配困难的问题,提出把自由运动的人或动物关节姿态本身作为标定目标。核心是 SteerPose 学习“心理旋转”式的2D姿态跨视角变换,并结合 Sinkhorn 可微匹配与几何一致性损失,在推理时联合优化相机外参与对应关系。实验覆盖人、狗、猪、鸽、猎豹等数据,显示其在宽基线和弱纹理场景下优于传统/学习式基线,并可用于新动物的多视角3D姿态重建。

TIGeR: Text-Instructed Generation and Refinement for Template-Free Hand-Object Interaction Figure 1
arXiv preprint2025-06-01

TIGeR: Text-Instructed Generation and Refinement for Template-Free Hand-Object Interaction

Yiyao Huang, Zhedong Zheng, Yu Ziwei, Yaxiong Wang, Tze Ho Elden Tse, Angela Yao, Macau, Hefei, China

National University of Singapore, Singapore, University of Macau, Macau, China, Hefei University of Technology, Hefei, China

6D位姿估计手部姿态

TIGeR针对手物交互重建中预定义3D模板难获取、纯RGB无模板方法又易受手部遮挡影响的问题,引入“文本生成先验+视觉细化”的两阶段思路:先由多模态问答和生成模型产生物体点云先验,再用2D-3D协同注意力对齐图像线索并联合优化手与物体位姿。在Dex-YCB和Obman上物体Chamfer距离达1.979和5.468,优于现有无模板方法,并显示出较好的遮挡鲁棒性和先验来源兼容性。

XYZ-IBD: High-precision Bin-picking Dataset for Object 6D Pose Estimation Capturing Real-world Industrial Complexity Figure 1
arXiv preprint2025-05-31

XYZ-IBD: High-precision Bin-picking Dataset for Object 6D Pose Estimation Capturing Real-world Industrial Complexity

Junwen Huang

Technical University of Munich, Munich Center for Machine Learning, Shanghai Jiaotong University, XYZ Robotics, Google

6D位姿估计物体位姿机器人操作数据集/基准

针对现有6D位姿基准多偏家用物体、难以反映工业料箱抓取中反光、无纹理、对称和严重遮挡的问题,XYZ-IBD构建了含15类金属工业件的真实多视角RGB-D数据集,并用防反光喷涂、多视角深度融合与半自动标注实现毫米级位姿标签。基准实验显示,现有2D检测、6D位姿和深度估计方法在该数据集上明显退化,说明瓶颈主要在真实工业复杂度而非已有家用场景饱和指标。

Lazy Heuristic Search for Solving POMDPs with Expensive-to-Compute Belief Transitions Figure 1
the International Symposium on Combinatorial Search2025-05-30

Lazy Heuristic Search for Solving POMDPs with Expensive-to-Compute Belief Transitions

Muhammad Suhail Saleem, Rishi Veerapaneni, Maxim Likhachev

Carnegie Mellon University

6D位姿估计

针对机器人 POMDP 规划中信念转移需反复调用物理仿真、光线投射或碰撞检测而代价过高的问题,论文将“惰性”思想引入 RTDP-Bel 与 LAO*:先用保守 Q 值估计筛选当前最有希望动作,只在必要时计算其信念转移。实验覆盖接触式位姿估计、1D LiDAR 室内导航和崎岖地形导航,显示规划时间显著降低且解质量基本保持。

6D Pose Estimation on Point Cloud Data through Prior Knowledge Integration: A Case Study in Autonomous Disassembly Figure 1
arXiv preprint2025-05-30

6D Pose Estimation on Point Cloud Data through Prior Knowledge Integration: A Case Study in Autonomous Disassembly

Chengzhi Wu, Hao Fu, Jan-Philipp Kaiser, Erik Tabuchi Barczak, Julius Pfrommer, Gisela Lanza, Michael Heizmann, Jürgen Beyerer

Institute of Industrial Information Technology, Karlsruhe Institute of Technology, Hertzstraße 16, Karlsruhe, Germany, Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB, Fraunhoferstraße 1, Karlsruhe, Germany

6D位姿估计点云

面向再制造中启动电机的自动拆解,论文关注单视角点云、夹具遮挡下螺栓难以检测和定位的问题。其核心思路不是单纯训练通用6D估计器,而是把螺栓区域、轴向等产品先验与完整电机点云配准、多阶段坐标变换结合,分解小目标位姿估计。实验表明该流程可获取电机上螺栓的6D信息,但具体精度提升与对比增益文中未充分说明。

Category-Level 6D Object Pose Estimation in Agricultural Settings Using a Lattice-Deformation Framework and Diffusion-Augmented Synthetic Data Figure 1
arXiv preprint2025-05-30

Category-Level 6D Object Pose Estimation in Agricultural Settings Using a Lattice-Deformation Framework and Diffusion-Augmented Synthetic Data

Marios Glytsos, Panagiotis P. Filntisis, George Retsinas, Petros Maragos

6D位姿估计物体位姿类别级位姿仿真到现实

面向农业采摘中果蔬形状、尺寸和成熟度差异大且难以获取实例 CAD/深度数据的问题,PLANTPose 仅用 RGB,在类别级基准网格上同时回归 6D 位姿与晶格形变参数,并用 Stable Diffusion 增强合成纹理以缩小仿真到现实差距。在香蕉多形态基准上,其对类内变化的适应性和位姿精度显著优于 RGB 方法 MegaPose。

PCIEPose Solution for EgoExo4D Pose and Proficiency Estimation Challenge Figure 1
arXiv preprint2025-05-30

PCIEPose Solution for EgoExo4D Pose and Proficiency Estimation Challenge

Feng Chen Lenovo Research chenfeng13@lenovo.com, Kanokphan Lertniphonphan Lenovo Research klertniphonp@lenovo.com, Jun Xie Lenovo Research xiejun@lenovo.com, Zhepeng Wang Lenovo Research wangzpb@lenovo.com

Lenovo Research, University of Chinese Academy of Sciences, Tsinghua University

6D位姿估计数据集/基准

面向第一视角视频中手部细微运动、遮挡和全身动态场景带来的6D/3D姿态感知难题,本文给出PCIE_EgoPose在EgoExo4D挑战中的方案:手部采用ViT与ConvNeXt双骨干及加权融合,身体姿态融合头姿、RGB视频和DepthAnything深度并用Transformer建模时序。方法在手姿态达到8.31 PA-MPJPE、身体姿态11.25 MPJPE,并在熟练度估计Top-1达0.53,获得三项冠军;部分增益可能来自模型集成与多模态配置。

Pose-free 3D Gaussian splatting via shape-ray estimation Figure 1
arXiv preprint2025-05-29

Pose-free 3D Gaussian splatting via shape-ray estimation

Youngju Na, TaeYeon Kim, Jumin Lee, Kyu Beom Han, Woo Jae Kim, Sung‐Eui Yoon

Korea Advanced Institute of Science and Technology

6D位姿估计三维重建高斯泼溅

该文针对高斯泼溅在真实稀疏多视图中依赖精确相机位姿、SfM 易失效而导致几何错位的问题,提出 SHARE:用 Plücker ray 联合估计相机射线与形状,在潜空间构建姿态感知 canonical volume,并通过 anchor-aligned Gaussian 细化局部几何,避免显式 3D 位姿变换带来的误差放大。实验在 DTU、BlendedMVS、RealEstate10K、ACID 上优于现有 pose-free 泛化方法,且在小位姿噪声下可超过部分依赖位姿的高斯泼溅基线。

TwinTrack: Bridging Vision and Contact Physics for Real-Time Tracking of Unknown Dynamic Objects Figure 1
arXiv preprint2025-05-28

TwinTrack: Bridging Vision and Contact Physics for Real-Time Tracking of Unknown Dynamic Objects

Wen Yang, Zhixian Xie, Yiting Wang, Abhijit Tadepalli, Heni Ben Amor, Shan Lin, Wanxin Jin

School for Engineering of Matter, Transport, and Energy, School of Computing and Augmented Intelligence

6D位姿估计

面向灵巧手操作、跌落等接触密集场景中未知物体因遮挡、运动模糊导致纯视觉6D跟踪失效的问题,TwinTrack将Real2Sim与Sim2Real闭环结合:先用RGB-D重建并借接触一致性修正几何、估计质量/摩擦等物理量,再把视觉跟踪与接触动力学预测自适应融合。实验在自由落体和多指手内操作中优于视觉基线,并保持20Hz以上实时跟踪。

4DTAM: Non-Rigid Tracking and Mapping via Dynamic Surface Gaussians Figure 1
arXiv preprint2025-05-28

4DTAM: Non-Rigid Tracking and Mapping via Dynamic Surface Gaussians

Hidenobu Matsuki, Gwangbin Bae

Dyson Robotics Laboratory, Imperial College London

6D位姿估计高斯泼溅

面向机器人在动态、非刚性环境中同时定位与建图的需求,4DTAM将2D高斯表面基元与MLP形变场结合,通过可微渲染联合优化几何、外观、相机位姿和时序形变,并加入解析位姿梯度与表面正则以利用RGB-D深度信号。论文还构建含复杂物体运动和真值轨迹的合成4D-SLAM数据集;实验显示其在相机跟踪和非刚性重建上优于传统方法,但当前主要验证小场景且约1.5 fps。

MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanism Figure 1
arXiv preprint2025-05-28

MultiFormer: A Multi-Person Pose Estimation System Based on CSI and Attention Mechanism

Yanyi Qu, Haoyang Ma, Wenhui Xiong

6D位姿估计

针对视觉姿态估计受光照与隐私限制、现有 CSI 方法难以处理多人且对时频相关建模不足的问题,MultiFormer 将 CSI 拆成时间/频率双 token,用自注意力同时捕获子载波相关和时间动态,并通过多阶段 PCM/PAF 热图融合强化人体结构约束。在 MM-Fi 与自采多人数据上优于已有方法,尤其改善手腕、肘部等高机动关键点估计。

Event-based Egocentric Human Pose Estimation in Dynamic Environment Figure 1
arXiv preprint2025-05-28

Event-based Egocentric Human Pose Estimation in Dynamic Environment

Wataru Ikeda, Masashi Hatano, Ryosei Hara, Mariko Isogawa

6D位姿估计人体姿态事件相机

该文针对头戴前视自我中心人体姿态估计在低光、快速运动和动态背景下易受 RGB 模糊与干扰的问题,提出首个前视事件相机框架 D-EventEgo:先由事件体估计头部位姿,再以其条件生成全身姿态,并用运动分割模块剔除独立运动物体以稳定头姿估计。在由 EgoBody 合成的事件数据集上,方法在动态环境的 5 项指标中有 4 项优于基线。

Spectral Compression Transformer with Line Pose Graph for Monocular 3D Human Pose Estimation Figure 1
Pattern Recognition2025-05-27

Spectral Compression Transformer with Line Pose Graph for Monocular 3D Human Pose Estimation

Zenghao Zheng, Lianping Yang, Hegui Zhu, Mingrui Ye

Northeastern University, King's College London

6D位姿估计人体姿态

本文针对基于 Transformer 的单目 3D 人体姿态估计在长序列上计算量高、相邻帧冗余大的问题,提出 SCT 在层间隐藏特征上做 DCT 频谱压缩,保留低频成分并配合无参数上采样恢复时序分辨率;同时用线姿态图 LPG 将骨骼作为图节点补充 2D 关节先验。双流结构在 Human3.6M 和 MPI-INF-3DHP 上取得 SOTA,Human3.6M MPJPE 为 37.7mm,并降低计算开销。

ReassembleNet: Learnable Keypoints and Diffusion for 2D Fresco Reconstruction Figure 1
arXiv preprint2025-05-29

ReassembleNet: Learnable Keypoints and Diffusion for 2D Fresco Reconstruction

Adeela Islam, Stefano Fiorini, Stuart James, Pietro Morerio

Fondazione Istituto Italiano di Tecnologia University of Genova Durham University

6D位姿估计三维重建

面向考古壁画碎片重组中不规则形状、纹理多样和碎片数量大导致的组合爆炸,ReassembleNet将每个碎片轮廓压缩为可学习筛选的关键点,融合曲率、边缘角与局部/全局纹理特征,并用片内/片间注意力配合扩散过程迭代估计2D旋转和平移;半合成预训练用于缓解真实数据稀缺。实验称相较既有方法旋转和平移RMSE分别降低57%和87%。

HS-SLAM: A Fast and Hybrid Strategy-Based SLAM Approach for Low-Speed Autonomous Driving Figure 1
arXiv preprint2025-05-27

HS-SLAM: A Fast and Hybrid Strategy-Based SLAM Approach for Low-Speed Autonomous Driving

Kang, Bingxiang, Zou, Jie, Guofa Li, Pengwei Zhang, Jie Zeng, Kan Wang, Jie Li

6D位姿估计相机位姿

面向低速自动驾驶中视觉惯性 SLAM 在嵌入式平台上计算负担较重的问题,HS-SLAM 将 IMU 运动先验、多层直接法位姿细化与角点特征匹配结合,并在非关键帧跳过不必要的描述子计算,以替代部分恒速跟踪假设。文中在 EuRoC MAV 上报告其定位精度优于 ORB-SLAM3,平均跟踪效率提升约 15%。

Mamba-Driven Topology Fusion for Monocular 3-D Human Pose Estimation Figure 1
arXiv preprint2025-05-27

Mamba-Driven Topology Fusion for Monocular 3-D Human Pose Estimation

Zenghao Zheng, Lianping Yang, Jinshan Pan, Hegui Zhu

6D位姿估计人体姿态

针对Transformer在长时序单目3D人体姿态估计中计算量随序列长度二次增长、而原生Mamba又难以表达骨架拓扑的问题,论文提出Mamba-Driven Topology Fusion:用骨骼感知模块在球坐标中建模骨向量方向与长度,并在Mamba卷积结构中引入双向GCN,再经时空细化融合关节与骨信息。在Human3.6M和MPI-INF-3DHP上,该方法在降低计算开销的同时提升精度,消融实验支持各模块有效性。

HAND Me the Data: Fast Robot Adaptation via Hand Path Retrieval Figure 1
arXiv preprint2025-05-28

HAND Me the Data: Fast Robot Adaptation via Hand Path Retrieval

Matthew Hong, Anthony Liang, Kevin Kim, Harshitha Rajaprakash, Jesse Thomason, Erdem Bıyık

Thomas Lord Department of Computer Science, University of Southern California

6D位姿估计手部姿态机器人操作

为降低机器人学习新操作任务对专家遥操作示范的依赖,HAND用单个人手演示从无任务标签的机器人play数据中检索可用子轨迹:先以视觉特征过滤场景,再用2D相对手/夹爪路径匹配行为,并对预训练策略做LoRA微调。真实WidowX上10个任务、550次评测显示,其平均成功率超过检索基线2倍以上,任务完成率较最佳基线高3倍,且可在4分钟内完成适应。

Learning the Contact Manifold for Accurate Pose Estimation During Peg-in-Hole Insertion of Complex Geometries Figure 1
arXiv preprint2025-05-25

Learning the Contact Manifold for Accurate Pose Estimation During Peg-in-Hole Insertion of Complex Geometries

Abhay Negi, Omey M. Manyar, Dhanush Penmetsa, Satyandra K. Gupta

6D位姿估计

面向复杂非凸零件小间隙插孔中易卡滞、纯模型难处理接触不连续而纯学习需大量数据的问题,论文将接触状态视为可配准的6D接触流形:离线采样全局流形,在线用少量探测构造局部子流形,并以MLP替代kNN投影加速ICP式位姿估计。实验在0.1–1.0 mm间隙三类工业几何上达到93.3%成功率,投影快95倍且精度提升18%。

Why Not Replace? Sustaining Long-Term Visual Localization via Handcrafted-Learned Feature Collaboration on CPU Figure 1
arXiv preprint2025-05-24

Why Not Replace? Sustaining Long-Term Visual Localization via Handcrafted-Learned Feature Collaboration on CPU

Yicheng Lin, Yunlong Jiang, Xujia Jiao, Bin Han, Senior Member, IEEE

6D位姿估计手部姿态相机位姿

面向工业移动机器人跨季节、昼夜和光照变化下的长期视觉定位,论文指出学习特征不应简单替代手工特征,而应利用二者在连续跟踪与宽基线匹配上的互补性。方法以手工特征做实时相对位姿估计,并在关键帧上低频提取学习关键点进行绝对定位,通过分层优化融合地图与多帧位姿。在CPU平台实验中,该框架平均定位误差降低47%,一致性也更好。

An Inertial Sequence Learning Framework for Vehicle Speed Estimation via Smartphone IMU Figure 1
arXiv preprint2025-05-24

An Inertial Sequence Learning Framework for Vehicle Speed Estimation via Smartphone IMU

Xuan Xiao, Xiaotong Ren, Haitao Li

6D位姿估计

面向城市峡谷、隧道等GNSS不稳定且OBD/RF外设难以普及的车载导航场景,论文提出DVSE,用手机IMU序列学习估计车速,并以GNSS作弱监督。其关键在于用噪声补偿网络分离惯性误差、用姿态变换网络和手机摆放增强缓解任意放置问题,再以匹配损失处理GNSS与IMU时间戳错位。真实众包数据实验显示其在精度和运行效率上优于对比方法,但具体增益幅度需看正文表格。

Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance Figure 1
arXiv preprint2025-05-23

Pose Splatter: A 3D Gaussian Splatting Model for Quantifying Animal Pose and Appearance

Jack Goffinet, Youngjo Min, Carlo Tomasi, David E. Carlson

Department of Computer Science, Department of Biostatistics and Bioinformatics, Department of Civil and Environmental Engineering, Duke University

6D位姿估计三维重建高斯泼溅

针对动物3D姿态分析中关键点表示过稀、标注成本高,以及网格方法依赖模板和逐帧优化的问题,Pose Splatter用多相机掩码经形状雕刻得到粗体素,再由3D U-Net和MLP前向预测3D高斯并渲染,同时构造旋转不变的姿态/外观嵌入。实验在小鼠、大鼠和斑胸草雀上显示其能重建完整几何、刻画细微姿态变化,并以较低显存泛化到未见数据。

To Glue or Not to Glue? Classical vs Learned Image Matching for Mobile Mapping Cameras to Textured Semantic 3D Building Models Figure 1
arXiv preprint2025-05-23

To Glue or Not to Glue? Classical vs Learned Image Matching for Mobile Mapping Cameras to Textured Semantic 3D Building Models

Simone Gaisbauer, Prabin Gyawali, Qilin Zhang, Olaf Wysocki, Boris Jutzi

Technical University of Munich, Munich, Germany

6D位姿估计

针对移动测图中相机图像与带纹理 CityGML LoD2 建筑模型匹配缺少系统评测的问题,本文搭建由纹理面关键点反算世界坐标、再经 PnP 估计 6D 位姿的验证流程,并扩展车载/无人机数据。实验显示,SuperPoint+SuperGlue/LightGlue 等可学习匹配在自建复杂数据上明显优于 SIFT、ORB、AKAZE,传统方法常只有 0–12 个 RANSAC 内点、AUC 最高约 0.16,但受 LoD2 几何粗糙和数据坐标误差限制,更适合粗定位或相对定位。

Towards Dynamic 3D Reconstruction of Hand-Instrument Interaction in Ophthalmic Surgery Figure 1
arXiv preprint2025-05-23

Towards Dynamic 3D Reconstruction of Hand-Instrument Interaction in Ophthalmic Surgery

Ming Hu, Zhengdi Yu, Feilong Tang, Kaiwen Chen, Yulong Li, Imran Razzak, Junjun He, Tolga Birdal, MBZUAI Imperial College London, Eye Hospital, Wenzhou Medical Univeristy ming.hu@monash.edu

Monash University Shanghai AI Laboratory MBZUAI, Imperial College London Eye Hospital, Wenzhou Medical Univeristy

6D位姿估计手部姿态三维重建医学/手术

针对眼科显微手术中手—器械三维运动难以无接触、客观量化且缺少高质量标注数据的问题,论文构建 OphNet-3D 大规模多视角 RGB-D 数据集,并用结合运动先验、几何一致性、生物力学与碰撞约束的自动标注流程生成手网格和器械 6D 位姿;在此基础上提出 H-Net/OH-Net 基准模型,MPJPE 改善超过 2mm,器械 ADD-S 最高提升 23%。

PoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimation Figure 1
arXiv preprint2025-05-23

PoseBH: Prototypical Multi-Dataset Training Beyond Human Pose Estimation

Uyoung Jeong, Jonathan Freer, Seungryul Baek, Hyung Jin Chang, Kwang In Kim UNIST, POSTECH

University of Birmingham

6D位姿估计人体姿态数据集/基准

PoseBH针对姿态估计多数据集训练中骨架定义不一致、单样本只含一种标注导致监督稀疏的问题,将不同数据集关键点表示为统一嵌入空间中的非参数原型,并用关键点回归与原型匹配两种预测的一致性做跨类型自监督。实验显示其在COCO-WholeBody、AP-10K、APT-36K等全身和动物姿态上提升泛化,同时基本保持COCO、MPII、AIC人体姿态性能,并可迁移到手形和人体形状估计。

Towards Texture- And Shape-Independent 3D Keypoint Estimation in Birds Figure 1
arXiv preprint2025-05-22

Towards Texture- And Shape-Independent 3D Keypoint Estimation in Birds

Valentin Schmuker, Alex Hoi Hang Chan, Bastian Goldluecke, Information Science, Germany urs.waldmann@uni-konstanz.de

Department of Computer and Information Science, University of Konstanz, Germany, Department of Collective Behavior, Max Planck Institute of Animal Behavior, Germany, Department of Biology, University of Konstanz, Germany

6D位姿估计

针对鸟类3D姿态估计依赖外观纹理、跨环境和跨物种泛化受限的问题,本文将3D-MuPPET改为先用分割生成个体轮廓,再在轮廓上估计2D关键点并多视角三角化,同时保留多鸽身份跟踪。该纹理无关方案在3D-POP上接近原纹理模型,SAM-huge轮廓下PCK10约74.5%,但身体和尾部误差明显;零微调迁移到斑鸠、渡鸦等物种有初步效果,视角和姿态差异仍是主要瓶颈。

Object-Focus Actor for Data-efficient Robot Generalization Dexterous Manipulation Figure 1
arXiv preprint2025-05-21

Object-Focus Actor for Data-efficient Robot Generalization Dexterous Manipulation

Yihang Li, Tianle Zhang, Xuelong Wei, Jiayi Li, Lin Zhao, Dongchi Huang, Zhirui Fang, Minhua Zheng, Wenjun Dai, Xiaodong He

JD Explore Academy, JD Company, Beijing Jiaotong University

6D位姿估计机器人操作

针对灵巧手模仿学习在物体位置和背景变化下泛化差、而 VLA 又依赖大规模机器人数据的问题,OFA 利用“靠近物体后的末端操作轨迹在同一任务中高度一致”这一洞察,将6D位姿估计、到达预操作位姿的规划与局部物体聚焦策略分层结合。真实七项任务中,该方法在位置外推和背景变化下优于基线,并可用约10条示教保持较稳性能。

UPTor: Unified 3D Human Pose Dynamics and Trajectory Prediction for Human-Robot Interaction Figure 1
arXiv preprint2025-05-20

UPTor: Unified 3D Human Pose Dynamics and Trajectory Prediction for Human-Robot Interaction

Nisarga Nilavadi, Andrey Rudenko, Timm Linder

Bosch Corporate Research, Robert Bosch GmbH, Stuttgart, Germany, University of Technology Nuremberg (UTN), Germany

6D位姿估计人体姿态机器人操作

面向移动机器人在人群中安全、实时导航,UPTor针对以往人体全身姿态预测与全局轨迹预测割裂的问题,提出运动坐标变换,将3D骨架关键点和轨迹统一到全局坐标中预测,并结合骨架图注意力与非自回归Transformer。在Human3.6M、CMU-Mocap及新采集DARKO导航数据上,模型相较解耦方法更紧凑、运行更快,轨迹预测更优且姿态精度保持可比。

Recollection from Pensieve: Novel View Synthesis via Learning from Uncalibrated Videos Figure 1
arXiv preprint2025-05-19

Recollection from Pensieve: Novel View Synthesis via Learning from Uncalibrated Videos

Ruoyu Wang, Transcengram, dwawayu@gmail.com, &Yi Ma

The University of Hong Kong

6D位姿估计

该文针对新视角合成/重建训练依赖标定相机、SfM/SLAM或深度先验,难以利用海量未标定视频的问题,提出两阶段自监督框架:先用潜在相机与场景上下文做隐式重建预训练,降低直接优化3D表示的偏置与难度;再预测3D Gaussian并加入渲染与深度重投影损失,将潜在空间对齐到物理几何。实验显示其在无位姿、无深度监督下可获得较好的新视角合成质量和相机位姿估计精度。

KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture Figure 1
arXiv preprint2025-05-19

KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture

R. James Cotton

Department of PM&R, Northwestern University, Shirley Ryan AbilityLab

6D位姿估计人体姿态医学/手术

针对临床运动分析中仅有无标记运动学、难以获得地面反力、关节力矩和肌肉激活的问题,KinTwin将模仿学习用于扭矩驱动与92块下肢肌肉驱动的生物力学模型,并在467人、34小时含运动障碍数据上训练。结果显示其能精确复现健全与受损动作,验证步态时空参数和接触事件,并推断与临床状态相关的力矩/肌肉差异。

The Way Up: A Dataset for Hold Usage Detection in Sport Climbing Figure 1
arXiv preprint2025-05-19

The Way Up: A Dataset for Hold Usage Detection in Sport Climbing

Anna Maschek, David C. Schedl

University of Applied Sciences Upper Austria, Campus Hagenberg, Austria

6D位姿估计数据集/基准

面向攀岩计分、动作分析和辅助训练中“何时使用哪个岩点”仍依赖人工或专用硬件的问题,论文发布含22段视频的岩点位置、使用顺序与时间标注数据集,并用关节点与岩点重叠判定使用情况来评测2D姿态模型。结果显示ViTPose准确率最高达86%,MediaPipe以83%换取更高帧率,同时揭示自遮挡和骨架关键点定义是主要瓶颈。

Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation Figure 1
arXiv preprint2025-05-17

Keypoints as Dynamic Centroids for Unified Human Pose and Segmentation

Niaz Ahmad, Jawad Khan, Kang G. Shin, jkhanbk1@gachon.ac.kr, kgshin@umich.edu, youngmoonlee@hanyang.ac.kr

Toronto Metropolitan University, Gachon University, University of Michigan, Hanyang University

6D位姿估计人体姿态

针对拥挤、遮挡和人体快速运动下关节点重叠、实例分割像素归属困难的问题,KDC将高置信关键点视为动态质心:PoseNet用关键点圆盘与KeyCentroid提升复杂关键点定位和置信度,SegNet再以MaskCentroid在嵌入空间聚类人体像素,避免依赖人体框检测器。作者在CrowdPose、OCHuman和COCO上验证其在精度与运行效率上具备较好泛化,尤其面向拥挤遮挡场景。

ElderFallGuard: Real-Time IoT and Computer Vision-Based Fall Detection System for Elderly Safety Figure 1
arXiv preprint2025-05-17

ElderFallGuard: Real-Time IoT and Computer Vision-Based Fall Detection System for Elderly Safety

Tasrifur Riahi, Md. Azizul Hakim Bappy, Md. Mehedi Islam

Dept. of Electronics and Communication Engineering, Hajee Mohammad Danesh Science and Technology University, Dinajpur, Bangladesh

6D位姿估计

针对老人跌倒难以及时发现、穿戴式设备依赖佩戴的问题,ElderFallGuard用普通摄像头的MediaPipe人体姿态关键点训练随机森林,并叠加“俯卧姿态持续超过3秒+运动显著下降超过2秒”的时序规则,触发带截图的Telegram告警和冷却机制。系统在7200样本、12类受控姿态数据上报告准确率、精确率、召回率和F1均为100%,但文中也承认数据场景较受控,真实家庭遮挡、光照和隐私条件下效果仍需验证。

SurgPose: Generalisable Surgical Instrument Pose Estimation using Zero-Shot Learning and Stereo Vision Figure 1
arXiv preprint2025-05-16

SurgPose: Generalisable Surgical Instrument Pose Estimation using Zero-Shot Learning and Stereo Vision

Utsav Rai, Haozheng Xu, Stamatia Giannarou

6D位姿估计多视角医学/手术

面向RMIS中器械反光、遮挡且新工具缺少标注的问题,SurgPose将FoundationPose/SAM-6D等零样本RGB-D位姿框架接入双目视觉,用RAFT-Stereo替代深度传感器,并以微调Mask R-CNN改进SAM-6D分割,同时构建含真实/合成双目与真值位姿的数据集。实验显示增强版SAM-6D在未见手术器械6D位姿估计上优于FoundationPose,验证零样本路线在手术场景中的可行性。

MTevent: A Multi-Task Event Camera Dataset for 6D Pose Estimation and Moving Object Detection Figure 1
arXiv preprint2025-05-16

MTevent: A Multi-Task Event Camera Dataset for 6D Pose Estimation and Moving Object Detection

Artificial Intelligence

Lamarr Institute for Machine Learning and Artificial Intelligence

6D位姿估计事件相机数据集/基准

面向高速移动机器人中 RGB 相机易受运动模糊、固定帧率和弱光影响的问题,MTevent 提供了一个事件相机多任务数据集:用双目事件相机与 RGB 相机采集 75 个真实动态场景、16 类物体,覆盖远距离、遮挡、极端视角和光照变化,并支持 6D 位姿、运动目标检测等任务。作者用 FoundationPose 在 RGB 图像上建立基线,即使使用真值 mask,Average Recall 仅 0.22,显示该场景下传统 RGB 位姿方法明显受限。

PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation Figure 1
arXiv preprint2025-05-16

PoseBench3D: A Cross-Dataset Analysis Framework for 3D Human Pose Estimation

Saad Manzur, Bryan Vela : 1, Brandon Vela : 1, Aditya Agrawal, Lan-Anh Dang-Vu, David Li, Irvine @uci.edu

University of California, Irvine

6D位姿估计人体姿态数据集/基准

针对3D人体姿态估计在单一数据集内表现好、跨数据集因视角、相机配置和关节标注约定差异而明显退化的问题,PoseBench3D提供统一可配置的跨数据集评测框架,支持H36M、GPA、3DPW、SURREAL及姿态提升网络扩展。作者重评18种方法,给出100余组MPJPE/PA-MPJPE结果,揭示普遍泛化缺口及预处理、视角分布对结果的影响。

RefPose: Leveraging Reference Geometric Correspondences for Accurate 6D Pose Estimation of Unseen Objects Figure 1
CVPR 20252025-05-16

RefPose: Leveraging Reference Geometric Correspondences for Accurate 6D Pose Estimation of Unseen Objects

Jaeguk Kim, Jaewoo Park, Keuntek Lee, Nam Ik Cho

New Generation University College

6D位姿估计未知物体

针对单目 RGB 下未知物体缺少实例先验、2D-3D 对应难以泛化的问题,RefPose 不直接依赖固定训练物体的形状记忆,而是先用模板和光流筛选获得粗位姿,再渲染与查询更对齐的参考图和几何对应,并用相关体引导注意力估计查询对应,随后通过 render-and-compare 迭代细化位姿。在 BOP 七个数据集上,其粗估计和最终精度均超过已有方法,同时保持有竞争力的运行速度。

UMotion: Uncertainty-driven Human Motion Estimation from Inertial and Ultra-wideband Units Figure 1
arXiv preprint2025-05-14

UMotion: Uncertainty-driven Human Motion Estimation from Inertial and Ultra-wideband Units

Huakun Liu, Hiroki Ota, Xin Wei, Yutaro Hirao Monica Perusquía-Hernández, Hideaki Uchiyama, Technology, Japan @is.naist.jp @is.naist.jp

Nara Institute of Science and Technology, Japan

6D位姿估计

针对稀疏 IMU 人体动捕中姿态欠约束、漂移以及不同体型适配差的问题,UMotion 将 6 个集成 IMU-UWB 节点的惯性与节点间距离信息纳入统一的不确定性状态估计,并用个体体型约束和姿态输出反向校正传感器观测。其紧耦合 UKF 在线融合学习式形状/姿态估计,在合成与真实数据上提升了传感器稳定性和姿态精度。

APR-Transformer: Initial Pose Estimation for Localization in Complex Environments through Absolute Pose Regression Figure 1
arXiv preprint2025-05-14

APR-Transformer: Initial Pose Estimation for Localization in Complex Environments through Absolute Pose Regression

Srinivas Ravuri, Yuan Xu, Martin Ludwig Zehetner, Ketan Motlag, Sahin Albayrak

FZI Research Center for Information Technology

6D位姿估计

针对 GNSS 受限场景中初始位姿不准会拖累机器人/自动车定位的问题,APR-Transformer 将多相机图像或 LiDAR(BEV/原始点云)经 CNN backbone 与 Transformer 编解码器聚合,直接回归全局 6D 绝对位姿,并用 LiDAR-SLAM 生成监督标签以减少对 GNSS 的依赖。实验覆盖 DeepLoc、Oxford RobotCar 与自建 APR-BeIntelli 数据集,报告达到或接近 SOTA,并在实车实时初始化 NDT 等定位算法时提升弱 GNSS 下的定位效果。

Real-time Capable Learning-based Visual Tool Pose Correction via Differentiable Simulation Figure 1
arXiv preprint2025-05-13

Real-time Capable Learning-based Visual Tool Pose Correction via Differentiable Simulation

Shuyuan Yang, Zonghe Chua

Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH USA. {sxy841

6D位姿估计

面向手术机器人中线缆传动导致关节编码器位姿不准、传统视觉校正又难以实时的问题,本文用可微运动学与渲染端到端训练ViT,根据真实/预测的双目工具掩码直接回归位姿修正,并提供dVRK可微仿真与真实数据集。实验显示其将手眼平移误差降低超过50%,精度接近迭代优化法但快约4倍,RTX 3090上约22 Hz,未见数据上零样本与无标注微调也有一定泛化。

Sleep Position Classification using Transfer Learning for Bed-based Pressure Sensors Figure 1
arXiv preprint2025-05-12

Sleep Position Classification using Transfer Learning for Bed-based Pressure Sensors

Olivier Papillon, Rafik Goubran, Life Fellow IEEE, James Green, Senior Member IEEE, Julien Larivière-Chartier, Caitlin Higginson, Frank Knoefel, MD Rébecca Robillard

Carleton University, Bruyère Health Research Institute, Sleep Research Unit, University of Ottawa Institute for Mental, Health Research at the Royal, School of Psychology, University of Ottawa

6D位姿估计

该文面向睡眠呼吸障碍评估中对无侵入体位监测的需求,将床下低分辨率压力垫数据转为四类睡姿识别问题。核心做法是把ViTMAE、ViTPose等预训练Transformer迁移到单通道PSM,并利用高分辨率公开压力图作额外预训练。实验在112晚临床数据上优于TCN及SVM、XGBoost等特征工程方法,在13人高分辨率数据上ViTMAE准确率达0.994、ViTPose达0.970;但临床低分辨率场景总体精度仍受传感器分辨率和类别混淆限制。

Pose Estimation for Intra-cardiac Echocardiography Catheter via AI-Based Anatomical Understanding Figure 1
arXiv preprint2025-05-07

Pose Estimation for Intra-cardiac Echocardiography Catheter via AI-Based Anatomical Understanding

Jaeyoung Huh, Ankur Kapoor, Young-Ho Kim

Digital Technology & Innovation, Siemens Healthineers, Princeton, NJ, USA

6D位姿估计

针对ICE心腔内超声导航依赖电磁跟踪、易受干扰且无跟踪流程需大量手动调节的问题,本文提出仅从ICE图像估计导管相对左心房解剖坐标的6D位姿。方法用ViT学习图像视野与导管位置/朝向关系,并以CARTO配准数据监督训练;在851例数据上测试,平均位置误差9.48 mm,三轴方向误差约16.13°、8.98°、10.47°。

Enabling Privacy-Aware AI-Based Ergonomic Analysis Figure 1
Procedia CIRP2025-05-12

Enabling Privacy-Aware AI-Based Ergonomic Analysis

Sander De Coninck, E.R. Gamba, Bart Van Doninck, Abdellatif Bey-Temsamani, Sam Leroux, Pieter Simoens

Ghent University

6D位姿估计

面向制造业中相机式人体工学监测的隐私与合规矛盾,论文提出在相机端用生成对抗隐私滤波器仅保留姿态估计所需信息,再经多视角三角化计算3D关键点与REBA评分。实验显示该方法比模糊、噪声、像素化在隐私-效用权衡上更优,约保持75% mAP50,REBA多数与原视频一致或同风险等级,但遮挡后仍有14%帧无法匹配,高风险场景误差更明显。

Human Motion Prediction via Test-domain-aware Adaptation with Easily-available Human Motions Estimated from Videos Figure 1
arXiv preprint2025-05-13

Human Motion Prediction via Test-domain-aware Adaptation with Easily-available Human Motions Estimated from Videos

Japan @toyota-ti.ac.jp

Toyota Technological Institute

6D位姿估计

本文针对3D人体运动预测依赖昂贵动捕、训练数据主体和动作多样性不足而泛化差的问题,提出用测试域中易获取的单目视频做部署前适配:先估计2D姿态与3D人体网格,再通过网格中介转换为与动捕骨架一致的3D关节序列,并进行尺度校正后追加训练。实验显示,仅加入测试域单个视频即可在多数动作上降低短期和长期预测误差,但增益可能主要来自额外测试域数据。

When Dance Video Archives Challenge Computer Vision Figure 1
arXiv preprint2025-05-12

When Dance Video Archives Challenge Computer Vision

Philippe Colantoni, Rafique Ahmed, Prashant Ghimire, Damien Muselet, rafique.ahmed@univ-st-etienne.fr, prashant.ghimire@univ-st-etienne.fr, damien.muselet@univ-st-etienne.fr, alain.tremeau@univ-st-etienne.fr

Laboratoire Hubert Curien - UMR

6D位姿估计数据集/基准

面向舞蹈档案视频难以用传统动捕或通用姿态估计可靠解析的问题,论文构建了面向多舞者视频的3D人体姿态/SMPL-X估计流水线,并用可视分析系统性考察帧率、分辨率、舞台光照、相机位置、遮挡与服装等因素。实验表明,档案视频中的低照度、强色光、运动模糊和身体接触会显著干扰估计,结果与数据公开;但文中未充分说明相对现有方法的定量增益。

CompSLAM: Complementary Hierarchical Multi-Modal Localization and Mapping for Robot Autonomy in Underground Environments Figure 1
arXiv preprint2025-05-10

CompSLAM: Complementary Hierarchical Multi-Modal Localization and Mapping for Robot Autonomy in Underground Environments

Shehryar Khattak, Timon Homberger, Lukas Bernreiter, Julian Nubert, Olov Andersson, Roland Siegwart, Kostas Alexis, Marco Hutter

the Autonomous Systems Lab, ETH Zürich, Switzerland, the Robotic Systems Lab, ETH Zürich, Switzerland

6D位姿估计相机位姿机器人操作

面向地下、无 GPS、黑暗粉尘和几何退化环境中的机器人自主作业,CompSLAM 将视觉、热成像、深度、惯性与运动学等多源位姿线索按层级粗到细融合,以冗余互补提升定位建图鲁棒性。系统曾部署于 DARPA SubT 决赛获胜队的轮式、足式和飞行机器人,并在 740 米决赛场地数据上展示了对传感退化的稳定性,同时开源代码与数据集。

Progressive Inertial Poser: Progressive Real-Time Kinematic Chain Estimation for 3D Full-Body Pose from Three IMU Sensors Figure 1
arXiv preprint2025-05-08

Progressive Inertial Poser: Progressive Real-Time Kinematic Chain Estimation for 3D Full-Body Pose from Three IMU Sensors

Zunjie Zhu, Yan Zhao, Yihan Hu, Guoxiang Wang, Hai Qiu, Bolun Zheng, Chenggang Yan, Feng Xu

6D位姿估计人体姿态

面向VR中仅有头显和双手设备、下肢传感器佩戴不便的问题,本文提出ProgIP,用头部与双腕三枚纯IMU的加速度和旋转实时回归全身SMPL姿态。核心在于按运动链深度分区域渐进估计祖先到子关节,并用TE-biLSTM编码时序、前向运动学位置一致性约束抑制误差累积。AMASS、DIP-IMU、TotalCapture实验显示其在同输入设置下优于现有方法,效果接近六IMU方案。

Improving Global Motion Estimation in Sparse IMU-based Motion Capture with Physics Figure 1
arXiv preprint2025-05-08

Improving Global Motion Estimation in Sparse IMU-based Motion Capture with Physics

Xinyu Yi, Shaohua Pan, Feng Xu

School of Software and BNRist, Tsinghua University

6D位姿估计人体姿态

针对稀疏 6 IMU 动捕中全局平移和朝向易受噪声、漂移影响,尤其难以恢复离地或上下楼等 3D 运动的问题,论文将物理约束引入估计流程:用多接触物理优化选择能解释人体运动的 3D 静止接触,并在局部姿态估计中联合细化重力方向以约束全局朝向。实验显示该方法同时提升局部姿态与全局运动精度,并可额外估计接触、接触力、关节力矩和交互代理表面。

An Efficient Method for Accurate Pose Estimation and Error Correction of Cuboidal Objects Figure 1
IROS 20222025-05-08

An Efficient Method for Accurate Pose Estimation and Error Correction of Cuboidal Objects

Utsav Rai, Hardik Mehta, Vismay Vakharia, Aditya Choudhary, Amit Parmar, Rolif Lima, Kaushik Das

Utsav Rai, Hardik Mehta, Vismay Vakharia, Aditya Choudhary, Amit Parmar, Rolif Lima and Kaushik Das

6D位姿估计

面向仓储/竞赛中从有序或杂乱堆中高精度抓取长方体物体,本文针对全局点云配准后仍有小位姿误差、ICP修正耗时且结果不确定的问题,利用RGB-D对齐数据缩小ROI,先以Super4PCS估计初始6D位姿,再依据长方体几何设计点选择过程,在线性时间估计并修正旋转和平移误差。方法在MBZIRC 2020砖块抓取任务中验证,相比引入ICP的常规流程更快且位姿更准,但文中未充分说明具体量化增益。

Comparison of Visual Trackers for Biomechanical Analysis of Running Figure 1
arXiv preprint2025-05-07

Comparison of Visual Trackers for Biomechanical Analysis of Running

Luis F. Gomez, Gonzalo Garrido-Lopez, Julian Fierrez, Aythami Morales, Ruben Tolosana, Javier Rueda, Enrique Navarro BiDA Lab, Universidad Autónoma de Madrid, Madrid, Faculty of Physical Activity, Sports Sciences INEF, Universidad Politécnica de Madrid, Spain

BiDA Lab, Universidad Autónoma de Madrid, Madrid, Spain, Sport Biomechanics Laboratory, Faculty of Physical Activity and Sports Sciences

6D位姿估计医学/手术

针对短跑生物力学中人工标注耗时、传统动捕昂贵且无标记姿态估计精度未明的问题,论文在 VideoRun2D 数据上比较 6 类视觉跟踪器,并加入异常检测与角度融合后处理来修正常见侧视跟踪错误。实验以 40 次冲刺、5870 帧专家标注为基准,关节模型 RMSE 为 11.41°–4.37°,后处理后降至 6.99°–3.88°,说明其可用于训练分析,但距高精度医疗/伤病预防需求仍有差距。

Do We Still Need to Work on Odometry for Autonomous Driving? Figure 1
arXiv preprint2025-05-07

Do We Still Need to Work on Odometry for Autonomous Driving?

Cédric Le Gentil, Daniil Lisus, Timothy D. Barfoot

6D位姿估计相机位姿

本文反思自动驾驶里程计研究是否仍需追求更复杂传感器与算法,拿最简单的轮速计+偏航陀螺直接积分(OG)作为基线。核心洞察是,在SE(2)道路场景中,低成本本体感知已能压过许多雷达惯性SOTA,且对动态环境天然免疫;Boreas上相对平移误差达0.20%,优于次优0.26%,激光惯性虽更准但计算量高约三数量级。雪暴打滑实验表明需显著滑移才会使OG失效。

HDiffTG: A Lightweight Hybrid Diffusion-Transformer-GCN Architecture for 3D Human Pose Estimation Figure 1
arXiv preprint2025-05-07

HDiffTG: A Lightweight Hybrid Diffusion-Transformer-GCN Architecture for 3D Human Pose Estimation

Yajie Fu, Chaorui Huang, Junwei Li, Hui Kong, Yibin Tian, Huakang Li, Zhiyuan Zhang

College of Information Science and Electronic Engineering, Zhejiang University, China, Faculty of Science and Technology, University of Macau, China, College of Mechatronics and Control Engineering, Shenzhen University, China, School of AI and Advanced Computing, Xi’an Jiaotong-Liverpool University, China, School of Computing and Information Systems, Singapore Management University, Singapore

6D位姿估计人体姿态

针对单目2D到3D人体姿态提升中深度歧义、遮挡和多假设扩散推理开销大的问题,HDiffTG将Transformer的全局时空建模、GCN的骨架局部拓扑建模与扩散细化整合为轻量双流框架,并通过改写扩散目标、输出维度变换和PDE式信息流控制减少迭代与过平滑。在Human3.6M和MPI-INF-3DHP上验证,文中报告其在MPI-INF-3DHP达到SOTA,同时具备较好效率及对噪声、遮挡的鲁棒性。

One2Any: One-Reference 6D Pose Estimation for Any Object Figure 1
arXiv preprint2025-05-07

One2Any: One-Reference 6D Pose Estimation for Any Object

Mengya Liu, Siyuan Li, Ajad Chhatkuli, Prune Truong Luc Van Gool, Federico Tombari ETH Zurich, INSAIT, Google, TUM

ETH Zurich, INSAIT, Sofia University “St. Kliment Ohridski", Google

6D位姿估计

针对新物体常缺少 CAD 模型或多视角采集、而单视角匹配又易受遮挡和弱纹理影响的问题,One2Any 将相对 6D 位姿估计改写为参考条件下的坐标解码:用单张 RGB-D 参考图生成 ROPE 表征,再由 U-Net 预测查询视角的 ROC,并结合深度用 Kabsch-Umeyama 求位姿。多基准实验显示其在单参考设置下达到或接近依赖多视角/CAD 方法的精度,同时推理计算更低、速度更快。

Polar Coordinate-Based 2D Pose Prior with Neural Distance Field Figure 1
arXiv preprint2025-05-06

Polar Coordinate-Based 2D Pose Prior with Neural Distance Field

Qi Gan, Sao Mai Nguyen, Eric Fenaux, Stephan Clémençon, Mounim El Yacoubi, LTCI, Télécom Paris, Institut Polytechnique de Paris, France U2IS, ENSTA Paris, France Ef-e-science, France SAMOVAR, Télécom SudParis, France @telecom-paris.fr, @gmail.com, mounim.el_yacoubi@telecom-sudparis.eu

Laboratoire Traitement et Communication de l’Information, Yangzhou University

6D位姿估计

针对体育视频中运动模糊、遮挡和跨姿态表示域移导致的2D人体姿态估计不稳,论文用NDF学习姿态先验进行后处理,并将传统纯角度表示扩展为含肢段长度的极坐标表示,配合分离角向/径向误差的非测地距离和梯度投影增广以缓解小数据训练。长跳数据集实验显示,该方法能在多种2D姿态表示上提升姿态合理性并修正部分错误估计,但结果主要集中于单一运动场景,跨项目泛化仍需更多验证。

LiftFeat: 3D Geometry-Aware Local Feature Matching Figure 1
arXiv preprint2025-05-06

LiftFeat: 3D Geometry-Aware Local Feature Matching

Yepeng Liu, Wenpeng Lai, Zhou Zhao, Yuxuan Xiong, Jinchi Zhu, Jun Cheng, Yongchao Xu

School of Computer Science, Wuhan University, Wuhan, China, SF Technology, Shenzhen, China, Institute for Infocomm Research, A STAR, Singapore. (

6D位姿估计

针对光照剧变、弱纹理和重复纹理下仅依赖2D描述子易误匹配的问题,LiftFeat用Depth Anything v2生成伪表面法向监督,将具备尺度/平移不变性的3D几何特征与轻量2D局部描述子通过3D-GFL融合。实验覆盖相对位姿、单应和视觉定位,性能优于若干轻量SOTA,并报告边缘端7.4 ms延迟。

Artificial Behavior Intelligence: Technology, Challenges, and Future Directions Figure 1
arXiv preprint2025-05-06

Artificial Behavior Intelligence: Technology, Challenges, and Future Directions

Kanghyun Jo, Jehwan Choi, Kwanho Kim, Seongmin Kim, Duy-Linh Nguyen, Xuan-Thuy Vo, Adri Priadana, Tien-Dat Tran

Department of Electrical, Electronic and Computer Engineering, University of Ulsan, Ulsan, Korea

6D位姿估计数据集/基准

面向自动驾驶、医疗看护与社交机器人中对人类意图的理解需求,本文将人工行为智能定义为融合姿态、表情、情绪、行为序列与情境的高层推理框架。核心洞察是从单纯动作识别转向跨文化、可预测的行为理解,并讨论大模型与多模态预训练的作用;但文中主要是综述与路线图,未给出统一基准实验证明性能增益。

Dance of Fireworks: An Interactive Broadcast Gymnastics Training System Based on Pose Estimation Figure 1
arXiv preprint2025-05-05

Dance of Fireworks: An Interactive Broadcast Gymnastics Training System Based on Pose Estimation

Haotian Chen, Ziyu Liu, Xi Cheng, Chuangqi Li

6D位姿估计

针对办公室久坐与广播体操参与度低的问题,本文将移动端轻量姿态估计用于体操训练:通过摄像头提取人体关键点、计算关节角并与示范动作对比,同时把动作质量和速度映射为烟花动画反馈,以降低硬件门槛并增强动机。136人实验中,四次训练后平均关节角误差由21.3°降至9.8°,且多数用户认可其促锻炼和娱乐价值。

Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions Figure 1
IEEE Robotics and Automation Letters2025-05-05

Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions

Asma Brazi, Boris Meden, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit Université Paris-Saclay, CEA, List, LIGM, Ecole des Ponts, Univ Gustave Eiffel, CNRS, Marne-la-vallee, France

Centre National de la Recherche Scientifique, Laboratoire d'Informatique Gaspard-Monge

6D位姿估计

针对对称、遮挡导致单张 RGB 图像存在多个甚至连续有效 6D 位姿、单一位姿估计难以表达不确定性的问题,Corr2Distrib 将原本会破坏 PnP 的歧义对应转化为线索:学习兼顾物体对称性的表面描述子与局部坐标系,由单个 2D-3D 对应生成旋转假设,再经 PnP 和评分得到位姿分布。在 BOP-Distrib/T-LESS 等真实复杂场景评测中,方法在位姿分布估计和单一位姿估计上均优于已有方法,但泛化到更多物体仍受数据集规模限制。

Finger Pose Estimation for Under-screen Fingerprint Sensor Figure 1
arXiv preprint2025-05-05

Finger Pose Estimation for Under-screen Fingerprint Sensor

62321005. ( Corresponding author: Jianjiang Feng

Department of Automation, Tsinghua University, Beijing 100084, China (e-mail: ; ; ; )

6D位姿估计

面向手机屏下指纹小面积采集和大角度触摸导致的姿态估计不稳问题,论文提出 DRACO,将屏下传感器的脊线局部纹理与触控电容图的全局轮廓互补融合,并用解耦概率分布、MoE 融合和跨域知识迁移替代常规回归/热图监督。在多个公开与私有数据集上,其精度和稳定性优于既有 SOTA,并能提升后续指纹识别表现。

6D Pose Estimation on Spoons and Hands Figure 1
arXiv preprint2025-05-05

6D Pose Estimation on Spoons and Hands

Kevin Tan, Fan Yang

University of Waterloo

6D位姿估计手部姿态

该文面向饮食监测中食物摄入量与进食行为难以客观记录的问题,构建从静态进食视频跟踪手和勺子的6D位姿流程:用Grounding DINO/SAM2初始化分割,比较Cutie与SAM2视频分割,再结合UniDepth和BundleSDF估计未知物体位姿。实验在两个真实YouTube进食视频上进行,SAM2分割平均优于Cutie,BundleSDF可在部分遮挡下保持较稳定跟踪;主要失败来自运动模糊、遮挡及将食物、碗或手臂误并入目标,数据规模较小使结论仍偏初步。

Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation Figure 1
arXiv preprint2025-05-04

Continuous Normalizing Flows for Uncertainty-Aware Human Pose Estimation

Shipeng Liu, Ziliang Xiong, Bastian Wandt, Per-Erik Forssén

6D位姿估计人体姿态

本文针对人体姿态估计中回归法高效但不确定性校准差、热图法准确但计算开销大的矛盾,指出固定高斯/拉普拉斯假设与真实关键点分布错配是核心问题。方法将连续归一化流引入回归框架,训练时动态修正残差分布、推理时不增加额外计算。在 MSCOCO 与 Human3.6M 的 2D/3D 实验中,CFRE 提升了 mAP,并在 AUSE 等指标上给出更可靠的不确定性估计。

A Birotation Solution for Relative Pose Problems Figure 1
arXiv preprint2025-05-04

A Birotation Solution for Relative Pose Problems

Hongbo Zhao, 0009-0008-2198-2484 Ziwei Long, 0009-0007-1520-5526 Mengtan Zhang, 0009-0003-3468-7680 Hanli Wang, Qijun Chen, Rui Fan

6D位姿估计相机位姿

针对相对位姿估计中本质矩阵过参数化、纯旋转退化,以及无深度时平移尺度归一化易陷入局部最优的问题,论文将平移方向改写为“双旋转”表示,引入沿三轴的基变换、几何度量与SO(3)上能量优化,再选择最小能量解恢复位姿。实验覆盖多类相对位姿任务,报告精度优于现有SoTA,但具体增益来源仍需结合代码与数据进一步核验。

Near-field 5D Pose Estimation using Reconfigurable Intelligent Surfaces Figure 1
arXiv preprint2025-05-03

Near-field 5D Pose Estimation using Reconfigurable Intelligent Surfaces

Srikar Sharma Sadhu, Praful D. Mankar, Santosh Nannuru

6D位姿估计

面向6G中无需多主动锚点的低功耗定位需求,本文研究RIS辅助近场MIMO下UE的3D位置与2D朝向估计。核心做法是利用RIS平面阵与UE线阵的对称几何,将5D位姿拆成五个一维子问题,并用TLS-ESPRIT给出闭式低复杂度解。仿真显示NMSE随SNR提升而下降,增大RIS有利于角度估计;距离在低SNR下随阵面变大可能变差,但高SNR可覆盖更大近场范围。

AquaGS: Fast Underwater Scene Reconstruction with SfM-Free Gaussian Splatting Figure 1
arXiv preprint2025-05-03

AquaGS: Fast Underwater Scene Reconstruction with SfM-Free Gaussian Splatting

Junhao Shi, Jisheng Xu, Jianping He, Zhiliang Lin

School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China, School of Electronic Information and Electrical Engineering, State Key Laboratory of Ocean Engineering

6D位姿估计三维重建高斯泼溅

AquaGS针对水下图像散射、吸收导致SfM位姿估计不稳且耗时的问题,提出无需SfM的水下重建框架:用预训练MVS生成初始点云/高斯,以3DGS表达物体表面,并用NeRF分离建模半透明水体介质。实验称仅需3张图像约30秒即可完成高精度重建,并在机器人平台验证了实时应用潜力。

PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depth Figure 1
IROS 20252025-05-03

PosePilot: Steering Camera Pose for Generative World Models with Self-supervised Depth

Bu Jin, Weize Li, Baihan Yang, Zhenxin Zhu, Junpeng Jiang, Huan-ang Gao, Haiyang Sun, Kun Zhan, Hengtong Hu, Xueyang Zhang, Peng Jia, Hao Zhao

The Hong Kong University of Science and Technology, Institute for AI Industry Research (AIR), Tsinghua University

6D位姿估计相机位姿彩色深度

面向自动驾驶世界模型中视角变换不准、相机位姿难以灵活控制的问题,PosePilot将自监督深度估计的SfM几何约束引入视频生成,通过深度与自运动读出、正反向光度warp监督及位姿回归,把相机运动与场景结构演化显式耦合。实验显示,该插件式模块可用于扩散和自回归模型,在驾驶及通用视频数据上提升位姿可控性、结构一致性和运动推理能力。

T-Graph: Enhancing Sparse-view Camera Pose Estimation by Pairwise Translation Graph Figure 1
ISPRS Journal of Photogrammetry and Remote Sensing2025-05-02

T-Graph: Enhancing Sparse-view Camera Pose Estimation by Pairwise Translation Graph

Qingyu Xian, Weiqin Jiao, Hao Cheng, Berend Jan van der Zwaag, Yanqiu Huang

6D位姿估计相机位姿

针对稀疏视角下相机位姿估计容易忽略视角两两平移关系、导致全局几何约束不足的问题,T-Graph将成对图像特征经MLP预测为全连接平移图,并引入relative-t与解耦旋转的pair-t两种表示,可作为轻量分支接入RelPose++、Forge等模型。在CO3D和IMC PhotoTourism上,其在2到8视角设置中稳定提升多项指标,相机中心精度约提高1%至6%。

3D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer Figure 1
arXiv preprint2025-05-02

3D Human Pose Estimation via Spatial Graph Order Attention and Temporal Body Aware Transformer

Kamel Aouaidjia, Aofan Li, Wenhao Zhang, Chongsheng Zhang

6D位姿估计人体姿态

针对视频2D到3D人体姿态提升中,Transformer易忽略骨架局部拓扑、GCN又常用静态图且缺少姿态自适应的问题,论文提出以多阶GCN提取单帧空间关系,并用Graph Order Attention为每个关节选择更合适的邻域阶数;随后用Body Aware Transformer结合关节跨帧加权注意与中心帧偏置来建模时序。Human3.6m、MPI-INF-3DHP和HumanEva-I实验及消融显示该设计有效,代码已开源。

Are Minimal Radial Distortion Solvers Really Necessary for Relative Pose Estimation? Figure 1
arXiv preprint2025-05-01

Are Minimal Radial Distortion Solvers Really Necessary for Relative Pose Estimation?

Viktor Kocur, Yaqing Ding, Zuzana Berger Haladova, Torsten Sattler, Zuzana Kukelova

6D位姿估计相机位姿

针对相对位姿估计中相机径向畸变不可忽略、但最小畸变求解器实现复杂且运行较慢的问题,论文系统比较了专用畸变求解器与两类更简单方案:采样畸变参数后用针孔求解器,以及用神经网络预测畸变。多数据集和相机设置实验显示,实践中复杂最小径向畸变求解器通常并非必要,并给出采样先验与学习先验各自更适用的条件。

P2P-Insole: Human Pose Estimation Using Foot Pressure Distribution and Motion Sensors Figure 1
arXiv preprint2025-05-01

P2P-Insole: Human Pose Estimation Using Foot Pressure Distribution and Motion Sensors

Atsuya Watanabe, Ratna Aisuwarya, Lei Jing 0000-0002-1181-2536

University of Aizu

6D位姿估计人体姿态

针对相机式人体姿态估计受隐私、光照、遮挡和部署成本限制的问题,P2P-Insole用低于1美元的织物鞋垫集成35个足底压力传感器与IMU,通过Transformer融合压力、加速度、旋转及一二阶差分时序特征来回归3D骨架。实验显示,多模态输入和导数特征可降低姿态估计误差,并验证了传感器布局与误差的关系,适合康复、伤害预防和健康监测等低侵入场景。

Dietary Intake Estimation via Continuous 3D Reconstruction of Food Figure 1
arXiv preprint2025-05-01

Dietary Intake Estimation via Continuous 3D Reconstruction of Food

Wallace Lee

University of Waterloo

6D位姿估计三维重建

针对饮食记录依赖自报、难以量化实际摄入量的问题,本文尝试用单目视频连续重建手持食物的3D形状,结合 COLMAP、手物交互位姿优化与状态变化检测,把“咬掉一口”建模为拓扑阶段切换。玩具、松饼、甜甜圈和三明治实验显示多数情况下能定位体积/形状变化,但反光、纹理均一和视角不足会导致配准与体积误差,定量有效性仍文中未充分说明。

InterLoc: LiDAR-based Intersection Localization using Road Segmentation with Automated Evaluation Method Figure 1
arXiv preprint2025-05-02

InterLoc: LiDAR-based Intersection Localization using Road Segmentation with Automated Evaluation Method

Nguyen Hoang Khoi Tran, Julie Stephany Berrio, Mao Shan, Zhenxing Ming, Stewart Worrall

The University of Sydney

6D位姿估计点云

面向自动驾驶中路口可作为定位、建图与规划锚点但缺少可靠在线定位和人工标注评测的问题,InterLoc利用车载LiDAR道路语义分割累积成BEV,结合骨架角点、分支拓扑验证与最小二乘中心细化定位路口,并用GNSS/INS将检测结果自动匹配OSM节点评测。在SemanticKITTI八段序列上,其精度、召回和中心误差优于近期学习式基线,且对较强分割噪声仍保持较稳健。

Self-Supervised Monocular Visual Drone Model Identification through Improved Occlusion Handling Figure 1
arXiv preprint2025-04-30

Self-Supervised Monocular Visual Drone Model Identification through Improved Occlusion Handling

Stavrow A. Bahnam, Christophe De Wagter, Guido C.H.E. de Croon

the Micro Air Vehicle Lab of the Faculty, of Aerospace Engineering, Delft University of Technology, HS, Delft, The Netherlands

6D位姿估计手部姿态

针对无人机在 GPS 缺失、高速贴近障碍飞行时单目 VIO 易受运动模糊和遮挡影响、而动力学模型又依赖动捕监督的问题,论文提出先用改进遮挡损失训练自监督 PoseNet,再以其作为教师,用机载 IMU 与电机转速学习神经无人机模型。实验显示遮挡处理使里程计 RMSE 平均降低约 15%,学生模型在高速下速度估计优于教师,并接入 ROVIO 后提升激进 3D 竞速轨迹估计精度。

Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space Figure 1
IEEE Transactions on Image Processing2025-04-30

Multiview Point Cloud Registration via Optimization in an Autoencoder Latent Space

Luc Vedrenne, Sylvain Faisan, Denis Fortun

Centre National de la Recherche Scientifique

6D位姿估计点云多视角

针对多视角点云配准中成对配准+同步随视角数扩展差、生成式 GMM/EM 又易陷局部最优且难抗噪声/遮挡/离群点的问题,本文提出 POLAR:把模板与位姿联合优化转到预训练自编码器潜空间,用退化感知损失和多起点旋转搜索处理大初始姿态差。实验显示其在合成与真实数据上相较现有方法取得明显更低误差,并支持较多视角的同时配准。

Dance Style Recognition Using Laban Movement Analysis Figure 1
arXiv preprint2025-04-29

Dance Style Recognition Using Laban Movement Analysis

Muhammad Turab, Philippe Colantoni, Damien Muselet, Alain Trémeau

6D位姿估计

针对舞蹈风格识别中过往 LMA 特征偏静态、难捕捉动作过渡的问题,论文把单目 3D 姿态估计、SMPL 人体网格与显式地面估计结合,提取带滑动窗口时间上下文的 Body/Effort/Shape/Space 描述子,并用可解释方法分析特征贡献。在 AIST 单人正面 600 段视频上最高准确率达 99.18%,但跨视角、多人和跨数据集泛化文中未充分说明。

Adept: Annotation-Denoising Auxiliary Tasks with Discrete Cosine Transform Map and Keypoint for Human-Centric Pretraining Figure 1
arXiv preprint2025-04-29

Adept: Annotation-Denoising Auxiliary Tasks with Discrete Cosine Transform Map and Keypoint for Human-Centric Pretraining

Weizhen He, Yunfeng Yan, Shixiang Tang, Yiheng Deng, Yangyang Zhong, Pengxin Luo, Donglian Qi

College of Electrical Engineering, Zhejiang University, Hangzhou, Zhejiang 310027, China, School of Mechanical Engineering, Zhejiang University, Hangzhou, Zhejiang 310000, China, Ocean College, Zhejiang University Zhoushan, Zhejiang 316021, China, Hainan Institute, Zhejiang University, Sanya, Hainan 572025, China, Shanghai AI Laboratory, Shanghai, 200232, China

6D位姿估计

该文针对人体感知预训练依赖 RGB-D 深度数据、难以扩展且伪深度质量敏感的问题,提出 Adept:从 RGB 图像经 DCT 生成频域低频语义图,并结合关键点做标注去噪辅助任务,迫使骨干学习人体细粒度结构。无需深度标注,在 COCO/AIC 预训练后,姿态估计、人体解析、计数/定位和 ReID 等多任务均优于既有方法,提升从 +0.1 mAP 到 +4.50 mIoU 不等。

A Survey on Event-based Optical Marker Systems Figure 1
arXiv preprint2025-04-29

A Survey on Event-based Optical Marker Systems

Nafiseh Jabbari Tofighi, Maxime Robic, Fabio Morbidi, Pascal Vasseur

the MIS laboratory, University of Picardie Jules Verne, Rue Saint-Leu, Amiens, France

6D位姿估计事件相机综述

面向高速运动、强弱光变化下传统帧相机标记检测易延迟和失效的问题,本文综述2011–2025年事件相机与主动/被动光学标记结合的EBOMS。核心洞察是按传感器、标记设计、编码解码、事件处理与部署场景建立分类并对比,说明其在物体跟踪、6D位姿估计和光通信中利用异步低延迟、高动态范围与低功耗获得优势;作为综述,主要结果是梳理方法谱系、应用边界和开放挑战,而非给出新的实验增益。

Large-scale visual SLAM for in-the-wild videos Figure 1
arXiv preprint2025-04-29

Large-scale visual SLAM for in-the-wild videos

Shuo Sun, Torsten Sattler, Malcolm Mielle, Achim J. Lilienthal, Martin Magnusson

AASS research center, Örebro University, Sweden, Czech Technical University in Prague, Independent researcher, Technical University of Munich, Chair: Perception for Intelligent Systems

6D位姿估计相机位姿

面向随手拍/公开视频中相机未知、运动剧烈、低纹理、动态物体和小视差导致视觉 SLAM/SfM 易断轨的问题,论文构建了以 DPVO 为核心的鲁棒重建流程:先用 SfM 估计内参,再屏蔽动态与天空区域,引入单目深度约束 BA,并结合地点识别、回环和全局 BA 抑制漂移。实验在多段真实在线视频上生成更连续的大规模三维模型,较 COLMAP 等基线减少分段和局部畸变,并用地图一致性、运行时间和 NeRF 重渲染质量评估效果。

GSFeatLoc: Visual Localization Using Feature Correspondence on 3D Gaussian Splatting Figure 1
arXiv preprint2025-05-01

GSFeatLoc: Visual Localization Using Feature Correspondence on 3D Gaussian Splatting

PAGE 1, Jongwon Lee1, Timothy Bretl1

6D位姿估计相机位姿三维重建高斯泼溅

针对3DGS视觉定位中基于光度损失反复渲染优化过慢、难以实时的问题,GSFeatLoc改为只在粗初值位姿渲染一次RGBD图像,通过查询图与渲染图的特征匹配建立2D-2D对应,再借助深度提升为2D-3D并用PnP求相机位姿。其核心洞察是用显式特征对应替代迭代光度对齐。在38个场景、2700余张图像上,相比iNeRF/iComMa等基线推理从10秒级降至最快0.1秒,误差也更低,并可容忍约55°旋转和1.1尺度归一化平移的初始误差。

PRISM-DP: Spatial Pose-based Observations for Diffusion-Policies via Segmentation, Mesh Generation, and Pose Tracking Figure 1
arXiv preprint2025-05-01

PRISM-DP: Spatial Pose-based Observations for Diffusion-Policies via Segmentation, Mesh Generation, and Pose Tracking

Xiatao Sun, Yinxing Chen, Daniel Rakita

the Department of Computer Science, Yale University

6D位姿估计

针对图像条件扩散策略维度高、参数需求大,而真实开放场景中物体6D位姿又依赖标记或人工网格的问题,PRISM-DP将分割、自动网格生成与FoundationPose式位姿跟踪串联,把任务物体位姿作为低维观测训练策略。仿真和真实实验显示,它以更小模型优于同规模图像策略,并接近使用真实位姿或人工网格的性能。

Transformation & Translation Occupancy Grid Mapping: 2-Dimensional Deep Learning Refined SLAM Figure 1
arXiv preprint2025-04-28

Transformation & Translation Occupancy Grid Mapping: 2-Dimensional Deep Learning Refined SLAM

Leon Davies, Baihua Li, Mohamad Saada, Simon Sølvsten, Qinggang Meng

6D位姿估计相机位姿

针对大规模复杂室内场景中传统2D占据栅格SLAM易受里程计漂移、姿态误差和传感噪声影响而生成模糊地图的问题,论文提出TT-OGM:将3D LiDAR SLAM的位姿估计转换用于2D OGM,并用GAN做观测补全与误差修正,同时用DRL合成训练数据。实验在拉夫堡大学实采数据和Radish等地图上展示了实时运行与更清晰、准确的栅格图,但具体量化增益来源可能同时来自3D位姿估计与数据生成。

GAN-SLAM: Real-Time GAN Aided Floor Plan Creation Through SLAM Figure 1
arXiv preprint2025-04-28

GAN-SLAM: Real-Time GAN Aided Floor Plan Creation Through SLAM

Leon Davies, Baihua Li, Simon Sølvsten, Qinggang Meng

6D位姿估计相机位姿

该文针对2D占据栅格SLAM在大场景中受里程计漂移、传感器噪声、玻璃/门洞误观测和局部遮挡影响,难以直接生成可用楼层图的问题,提出将GAN嵌入SLAM流程,对栅格图实时去噪、补全并校正线性/角度偏移,同时把3D LiDAR里程计改用于2D制图。实验在Radish和真实建筑数据上显示,GAN后处理能提升多种SLAM的地图完整性与IoU,并保持部分实时性;但个别走廊被误删,且对导航任务的安全性仍需进一步验证。

Category-Level and Open-Set Object Pose Estimation for Robotics Figure 1
arXiv preprint2025-04-28

Category-Level and Open-Set Object Pose Estimation for Robotics

Peter Hönig, Matthias Hirschmanner, Markus Vincze

6D位姿估计物体位姿类别级位姿机器人操作

面向机器人抓取等任务,类别级与开放集6D位姿在形状、尺度、纹理未知及对称性消歧上仍明显弱于实例级方法。本文不是提出新模型,而是系统比较CAMERA/REAL275相关方法的数据集、指标、输入模态、架构、中间表示和求解器,指出NOCS类表示已成主流,深度/法向更利于机器人场景与对称处理;主要结果是梳理性能差异并给出向无需推理期3D模型的开放集泛化过渡的建议。

Certifiably-Correct Mapping for Safe Navigation Despite Odometry Drift Figure 1
arXiv preprint2025-04-25

Certifiably-Correct Mapping for Safe Navigation Despite Odometry Drift

Devansh R. Agrawal, Taekyung Kim, Rajiv Govindjee, Trushant Adeshara, Jiangbo Yu, Anurekha Ravikumar, Ann Arbor Correspondence: devansh@umich.edu

Jiangbo Yu, Anurekha Ravikumar, and Dimitra Panagou, University of Michigan, Ann Arbor

6D位姿估计相机位姿

针对VIO/SLAM里程计漂移会把障碍误标为空闲区、进而破坏导航安全的问题,论文提出“可认证正确”建图框架:不按累计误差膨胀障碍,而依据每步增量位姿误差收缩安全区域,使机器人局部地图始终为真实自由空间子集,并分别落到安全飞行走廊和ESDF。作者给出正确性证明,在Replica仿真和真实小车实验中,相比基线避免了已建图障碍导致的碰撞,可使小车在潜在碰撞前安全停止。

SSD-Poser: Avatar Pose Estimation with State Space Duality from Sparse Observations Figure 1
arXiv preprint2025-04-25

SSD-Poser: Avatar Pose Estimation with State Space Duality from Sparse Observations

Shuting Zhao, Linxin Bai, Liangjing Shao, Ye Zhang, Xinrong Chen

Academy for Engineering & Technology, Fudan University, Shanghai, College of Vocational and Technical Teacher Education, Shanghai Polytechnic University

6D位姿估计

面向 AR/VR 中仅由头显与双手提供稀疏观测的实时全身姿态估计,SSD-Poser 试图缓解下肢不可观测与 Transformer/扩散模型推理慢的矛盾。方法以状态空间对偶为骨干,结合注意力编码器建模时空与关节上下文,并用频率感知解码器抑制抖动。在 AMASS 上报告精度、平滑性和推理效率均优于现有方法,尤其改善下肢预测。

S3MOT: Monocular 3D Object Tracking with Selective State Space Model Figure 1
arXiv preprint2025-04-25

S3MOT: Monocular 3D Object Tracking with Selective State Space Model

Zhuohao Yan, Shaoquan Feng, Xingxing Li, Yuxuan Zhou, Chunxi Xia, Shengyu Li School of Geodesy, Geomatics

School of Geodesy and Geomatics, Wuhan University, China

6D位姿估计

单目3D多目标跟踪难以从2D视频中稳定挖掘3D时空关联,尤其在遮挡、视角变化和长序列下数据关联与6DoF运动估计易失效。S3MOT将选择性状态空间模型引入该任务,用FCOE做密集对比式Re-ID,VeloSSM建模速度时序,HSSM以全局感受野和动态权重融合多类跟踪线索。在KITTI测试集达到76.86 HOTA、31 FPS,较此前最佳提升2.63 HOTA和3.62 AssA。

SmallGS: Gaussian Splatting-based Camera Pose Estimation for Small-Baseline Videos Figure 1
arXiv preprint2025-04-22

SmallGS: Gaussian Splatting-based Camera Pose Estimation for Small-Baseline Videos

Yuxin Yao, Yan Zhang, Zhening Huang, Meshcapade @cam.ac.uk, yan@meshcapade.com

University of Cambridge

6D位姿估计相机位姿三维重建高斯泼溅

针对社交媒体等场景中小基线动态视频因视差不足、特征歧义和漂移导致相机位姿不稳的问题,SmallGS用每段首帧重建的高斯泼溅作为稳定参考,冻结场景后基于RGB与DINOv2特征渲染优化连续相机位姿,并用动态区域掩码和轨迹平滑抑制干扰与抖动。在TUM-Dynamics上相较MonST3R和DORID-SLAM显著降低ATE/RPE,显示其更适合小基线动态场景。

Dynamic Camera Poses and Where to Find Them Figure 1
arXiv preprint2025-04-24

Dynamic Camera Poses and Where to Find Them

Chris Rockwell, Joseph Tung, Tsung-Yi Lin Ming-Yu Liu, David F. Fouhey, Chen-Hsuan Lin NVIDIA

NVIDIA University of Michigan New York University

6D位姿估计相机位姿

论文面向动态互联网视频缺乏可靠相机位姿标注的问题,认为这限制了可控视频生成、视图合成与机器人仿真/模仿学习。核心贡献是从 Panda-70M 中用专家模型加 VLM 过滤可估计视频,并结合长程点跟踪、动态区域遮罩与 SfM 构建 DynPose-100K。实验显示过滤精度优于替代方案,位姿估计在多指标上最高可降误差约 90%,但部分收益可能主要来自更大规模数据与工程化筛选。

A Guide to Structureless Visual Localization Figure 1
arXiv preprint2025-04-24

A Guide to Structureless Visual Localization

Vojtech Panek 0000-0003-0601-7682, Qunjie Zhou 0000-0002-2434-2393, Yaqing Ding 0000-0002-7448-6686, Sérgio Agostinho 0000-0001-7008-1756, Zuzana Kukelova 0000-0002-1916-8829, Torsten Sattler 0000-0001-9760-4553, Laura Leal-Taixé 0000-0001-8709-1133

Faculty of Electrical Engineering, Czech Technical University (CTU) in Prague, Czech Institute of Informatics, Robotics and Cybernetics, CTU in Prague, NVIDIA, Visual Recognition Group, Faculty of Electrical Engineering, CTU in Prague

6D位姿估计相机位姿

针对基于3D模型的视觉定位在场景变化后更新困难的问题,本文系统梳理并实证比较无结构定位路线,将场景仅表示为带位姿的图像库。核心洞察是几何推理越显式,位姿精度通常越高:局部三角化后绝对位姿估计和半广义相对位姿估计明显优于相对位姿回归。实验显示无结构方法更易维护、精度接近但仍略低于最强结构化方法。

Object Pose Estimation by Camera Arm Control Based on the Next Viewpoint Estimation Figure 1
arXiv preprint2025-04-24

Object Pose Estimation by Camera Arm Control Based on the Next Viewpoint Estimation

Tomoki Mizuno, Kazuya Yabashi, Tsuyoshi Tasaki

Meijo University ,1-Shiogamaguchi,Tenpaku-ku, Nagoya, Aichi

6D位姿估计物体位姿

面向零售补货/陈列机器人,论文关注简单几何商品在当前视角缺少纹理和形状线索时,RGB-D 6D 位姿估计容易失准的问题。作者将“下一视角”作为与位姿耦合的预测目标,提出 PYNet-NV 同时估计物体位姿与更有利的相机臂观察位置,而非依赖边缘等手工几何规则。实验中位姿成功率达 77.3%,比数学模型式视角选择高 7.4 个百分点;机器人实物陈列成功率为 84.2%。

Bias-Eliminated PnP for Stereo Visual Odometry: Provably Consistent and Large-Scale Localization Figure 1
arXiv preprint2025-04-24

Bias-Eliminated PnP for Stereo Visual Odometry: Provably Consistent and Large-Scale Localization

Guangyang Zeng, Yuan Shen, Ziyang Hong, Yuze Hong, Viorela Ila, Guodong Shi, Junfeng Wu

University of Hong Kong, Shenzhen 518172, China, School of Aerospace, Mechanical and Mechatronic Engineering, University of Sydney, Australia

6D位姿估计相机位姿多视角

本文针对立体视觉里程计中PnP估计受三角化不确定性和位姿-地图误差时序耦合影响而产生偏差的问题,提出考虑不同3D点不确定性的Bias-Eli-W PnP,并用仅当前关键帧特征跟踪的新VO框架解耦误差传播。该方法在KITTI和Oxford RobotCar上降低RPE与ATE,KITTI彩色序列相较次优平均提升约24%和28%,在不规则运动下也保持较可靠定位。

GADS: A Super Lightweight Model for Head Pose Estimation Figure 1
arXiv preprint2025-04-22

GADS: A Super Lightweight Model for Head Pose Estimation

Menan Velayuthan, Asiri Gawesha, Purushoth Velayuthan, Nuwan Kodagoda, Dharshana Kasthurirathna, Pradeepa Samarasinghe

6D位姿估计

面向边缘端人机交互中的头部姿态估计,GADS试图解决现有基于人脸关键点方法模型偏大、延迟高的问题。其核心做法是将关键点按眼、脸颊、下巴等区域分组,用小型 Deep Set 提取组内表示,再以多头注意力建模组间关系,并提供结合 RGB 的 Hybrid-GADS。三套基准上其精度接近 SOTA,参数量比最轻模型少约 7.5 倍、推理快约 25 倍,相比 TokenHPE 小 4321 倍,适合资源受限部署。

Field Report on Ground Penetrating Radar for Localization at the Mars Desert Research Station Figure 1
arXiv preprint2025-04-21

Field Report on Ground Penetrating Radar for Localization at the Mars Desert Research Station

Anja Sheppard, Katherine A. Skinner

University of Michigan, Hayward St, Ann Arbor, MI 48109, USA

6D位姿估计

面向火星/月面车在无 GPS、高滑移和光照受限环境中的长期定位难题,论文探索将已用于地质探测的探地雷达作为额外定位模态。作者在 MDRS 火星类比场地用 Husky 搭载 500MHz GPR、相机/IMU 等采集两周、50 余条轨迹,并总结强光、GPS/SBAS 异常与对讲机干扰等现场问题;文中未给出定位精度增益,主要贡献是数据集与工程经验。

Vision6D: 3D-to-2D Interactive Visualization and Annotation Tool for 6D Pose Estimation Figure 1
arXiv preprint2025-04-21

Vision6D: 3D-to-2D Interactive Visualization and Annotation Tool for 6D Pose Estimation

Yike Zhang, Eduardo Davalos, Jack Noble

6D位姿估计

针对自建或真实视频中常缺少相机—物体外参、纹理少物体难以用特征/PnP标注的问题,Vision6D提出交互式3D到2D配准界面,让用户在仅有相机内参时将3D模型叠加到真实图像并手动细化6D位姿。作者在 Linemod 和 HANDAL 上将人工标注与真值比较,并通过用户研究显示该工具能较准确、直观地生成位姿标注。

Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs Figure 1
arXiv preprint2025-04-21

Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs

Chun-Hsiao Yeh, Chenyu Wang, Shengbang Tong, Ta-Ying Cheng, Ruoyu Wang Tianzhe Chu, Yuexiang Zhai, Yubei Chen, Shenghua Gao, Yi Ma, UC Berkeley, TranscEngram, NYU, UC Davis, HKU

UC Berkeley TranscEngram NYU University of Oxford UC Davis HKU

6D位姿估计多视角

面向将 MLLM 用作具身智能体时的导航、操作与三维场景理解需求,本文关注其多视角几何一致性是否可靠。作者提出 All-Angles Bench,含 90 个真实场景、2100 余个人工标注问答,覆盖计数、属性、相对距离/方向、操作和相机位姿估计。对 27 个主流 MLLM 的评测显示其与人类差距明显,主要短板在遮挡下跨视角目标对应和粗略相机位姿建立,提示需要专门的多视角模块或训练数据。

Instance-Adaptive Keypoint Learning with Local-to-Global Geometric Aggregation for Category-Level Object Pose Estimation Figure 1
arXiv preprint2025-04-21

Instance-Adaptive Keypoint Learning with Local-to-Global Geometric Aggregation for Category-Level Object Pose Estimation

Xiao Zhang, Lu Zou, Tao Lu, Yuan Yao, Zhangjin Huang, Guoping Wang

6D位姿估计物体位姿类别级位姿

针对类别级6D位姿中未见实例形状差异大、复杂几何下关键点易聚集且全局结构建模不足的问题,INKL-Pose以实例自适应关键点为核心,结合局部几何聚合与双向Mamba全局聚合,并用表面/分离损失约束关键点覆盖与多样性。其在CAMERA25、REAL275和HouseCat6D上达到SOTA,模型16.7M参数,在RTX 4090D上36 FPS。

Back on Track: Bundle Adjustment for Dynamic Scene Reconstruction Figure 1
arXiv preprint2025-04-20

Back on Track: Bundle Adjustment for Dynamic Scene Reconstruction

Daniel Cremers TU Munich, Microsoft

Munich Center for Machine Learning, University of Oxford, Microsoft

6D位姿估计三维重建

面向随手拍视频中的动态物体会破坏传统 SLAM 静态假设的问题,BA-Track 的关键思路不是剔除动态区域,而是用学习式 3D 点跟踪器分解观测运动,提取由相机运动引起的分量,使动态与静态点都可进入束调整;再用 BA 稀疏几何校正单目深度尺度。实验显示其在挑战动态场景中提升了相机位姿估计与三维重建的精度和时序一致性。

SG-Reg: Generalizable and Efficient Scene Graph Registration Figure 1
arXiv preprint2025-04-20

SG-Reg: Generalizable and Efficient Scene Graph Registration

Chuhao Liu, Zhijian Qiao, Jieqi Shi, Ke Wang, Peize Liu, Shaojie Shen

University. (

6D位姿估计

SG-Reg面向多机器人/多会话SLAM中低带宽、跨视角的地图对齐难题,针对手工语义描述子不稳、学习法依赖真值标注而泛化差的问题,将开放集语义、带空间感知的局部拓扑和物体形状融合为稀疏场景图特征,并用粗到细匹配与鲁棒后端估计位姿;其数据由视觉基础模型和语义建图自动生成。实验显示其配准成功率显著优于手工基线,较视觉回环方法召回略高且每帧仅需52KB通信。

Imitation Learning with Precisely Labeled Human Demonstrations Figure 1
arXiv preprint2025-04-18

Imitation Learning with Precisely Labeled Human Demonstrations

Yilong Song

6D位姿估计

面向通用机器人/VLA训练中机器人示教昂贵、人体视频又缺少精确动作标签的问题,本文利用手持夹爪外观可控这一洞察,将夹爪设为易分割颜色,并用RANSAC+ICP从点云中估计末端6D位姿,为人类示教生成精确动作标签。在仿真实验中,仅用这类人类示教训练的策略平均达到同量机器人示教性能的88.1%,与少量机器人示教混合还能提升表现;但缺少真实机器人验证,现实点云精度影响仍未充分说明。

Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction Figure 1
arXiv preprint2025-04-18

Mono3R: Exploiting Monocular Cues for Geometric 3D Reconstruction

Wenyu Li, Sidun Liu, Peng Qiao, China @nudt.edu.cn

National University of Defence Technology

6D位姿估计三维重建

Mono3R针对DUSt3R类多视角重建依赖匹配、在弱纹理、遮挡、低光等匹配线索不足区域退化的问题,引入单目几何估计的鲁棒先验:先用单目与双目模型分别预测点图并对齐,再以单目点云和特征引导细化多视角点图。实验覆盖DTU、7Scenes、Neural-RGBD、ETH3D和Tanks & Temples,显示其在相机位姿估计和点云精度上优于DUSt3R、Spann3R、Fast3R,室内MAA30较DUSt3R提升约13%。

ViTa-Zero: Zero-shot Visuotactile Object 6D Pose Estimation Figure 1
arXiv preprint2025-04-17

ViTa-Zero: Zero-shot Visuotactile Object 6D Pose Estimation

Hongyu Li, James Akl, Srinath Sridhar, Tye Brady, Taşkın Padır

Amazon Fulfillment Technologies & Robotics, Westborough, MA, Brown University, Providence, RI, Northeastern University, Boston, MA

6D位姿估计物体位姿

面向抓取、手内跟踪等遮挡和接触频繁场景,纯视觉6D位姿估计容易失效,而传统视触觉方法又受数据与硬件泛化限制。ViTa-Zero以任意新物体视觉位姿模型为骨干,用触觉、关节本体感知构造接触、穿透和运动学可行性检查,并以弹簧—质量式测试时优化修正不可行估计,无需触觉训练数据。真实机器人实验中,相比FoundationPose等视觉模型,ADD-S AUC平均提升55%、ADD提升60%,位置误差降低80%。

ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos Figure 1
arXiv preprint2025-04-18

ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos

Zetong Zhang, Manuel Kaufmann, Lixin Xue, Jie Song, Martin R. Oswald ETH Zürich, HKUST(GZ, HKUST

ETH Zürich HKUST(GZ) HKUST University of Amsterdam

6D位姿估计三维重建

面向机器人在人类环境中的在线感知,ODHSR解决单目野外视频中相机运动、人体姿态与人—场景稠密重建相互耦合的问题。方法以3D Gaussian Splatting统一表示人体和场景,结合SMPL引导的刚性/非刚性人体形变、单目几何先验与遮挡感知人体轮廓项进行联合优化。EMDB和NeuMan实验显示,其在人体与场景重建、全局人体姿态和新视角合成上优于或接近现有方法,并较以往人—场景重建显著提速。

Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms Figure 1
IEEE Transactions on Circuits and Systems for Video Technology2025-04-17

Unsupervised Cross-Domain 3D Human Pose Estimation via Pseudo-Label-Guided Global Transforms

Jingjing Liu, Zhiyong Wang, Xinyu Fan, Amirhossein Dadashzadeh, Honghai Liu, Majid Mirmehdi

University of Bristol, Harbin Institute of Technology, Xiamen University

6D位姿估计人体姿态

针对3D人体姿态模型跨数据集时受相机视角、位置及体型姿态差异影响而退化的问题,论文用目标域2D姿态生成伪3D标签,并通过人体中心坐标系显式求解源/目标相机坐标下的全局旋转与平移,再结合骨长骨角增强迭代适配。该方法在Human3.6M、MPI-INF-3DHP、3DPW跨域评测中超过现有方法,部分结果甚至优于目标域监督训练的MixSTE。

MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices Figure 1
arXiv preprint2025-04-16

MobilePoser: Real-Time Full-Body Pose Estimation and 3D Human Translation from IMUs in Mobile Consumer Devices

Vasco Xu, Chenfeng Gao, Henry Hoffmann, Karan Ahuja

University of Chicago, Northwestern University

6D位姿估计人体姿态

MobilePoser面向日常移动场景中相机受限、专用动捕设备侵入性强的问题,尝试仅用手机、手表、耳机等消费设备的稀疏低精度IMU恢复全身姿态和全局位移。核心做法是用可变设备掩码的多阶段LSTM先估计关节位置与旋转,再结合物理优化提升时空一致性,并融合足接触与根速度回归估计平移。实验显示其在多数据集和1–3设备配置下优于相关稀疏IMU方法,IMUPoser微调平均MPJVE约11.33 cm,并可在iPhone 15 Pro上60 fps实时运行。

Diffusion Based Robust LiDAR Place Recognition Figure 1
arXiv preprint2025-04-16

Diffusion Based Robust LiDAR Place Recognition

Benjamin Krummenacher, Jonas Frey, Turcan Tuna, Olga Vysotska, Marco Hutter

Robotic Technology (United States)

6D位姿估计点云

面向工地室内无 GNSS、重复户型和墙面导致的重定位歧义,论文将单帧 LiDAR 与激光扫描建筑网格对齐视为全局位置识别问题。核心做法是在真实网格中射线生成大量合成 LiDAR,训练带 PointNet++ 编码器的扩散回归模型,输出多候选位置分布以表达感知混淆。五个真实数据集上平均 77% 查询落在 ±2 m 内,均值误差约为基线的一半,并可作为后续全局配准初值。

Regist3R: Incremental Registration with Stereo Foundation Model Figure 1
arXiv preprint2025-04-16

Regist3R: Incremental Registration with Stereo Foundation Model

Sidun Liu, Wenyu Li, Peng Qiao, Yong Dou

College of Computer Science and Technology, National Key Laboratory of Parallel and Distributed Computing, National University of Defense Technology

6D位姿估计多视角

针对 DUSt3R 类点图基础模型在多视角扩展时计算开销大、全局对齐易累积误差的问题,Regist3R 将双目模型改造成增量式注册器:利用已注册参考视图及其世界坐标点图,直接预测新视图点图,并用链式训练、MST 视图连接和树压缩缓解漂移、降低推理次数。实验显示其在相机位姿估计和三维重建上接近优化式 SfM、优于现有多视角模型,同时在数百到上千视图的斜航空场景中保持更高效率。

CoMotion: Concurrent Multi-person 3D Motion Figure 1
arXiv preprint2025-04-16

CoMotion: Concurrent Multi-person 3D Motion

Alejandro Newell &Peiyun Hu &Lahav Lipson, Apple&Stephan R. Richter &Vladlen Koltun

6D位姿估计

CoMotion面向单目视频中多人3D姿态在线估计与跟踪,动机是拥挤、遮挡场景下传统逐帧检测再关联容易断轨且难以实时补全。其核心是用循环式“tracking by attention”直接从新帧像素更新一组已有3D人体状态,而非事后匹配检测,并通过异构图像/视频/合成数据与伪标签训练。结果显示其3D姿态精度达到同类SOTA,在PoseTrack21上相对前作MOTA提升14%、IDF1提升12%,速度约快一个数量级。

No Fuss, Just Function -- A Proposal for Non-Intrusive Full Body Tracking in XR for Meaningful Spatial Interactions Figure 1
arXiv preprint2025-04-16

No Fuss, Just Function -- A Proposal for Non-Intrusive Full Body Tracking in XR for Meaningful Spatial Interactions

Elisabeth Mayer, Thomas Odaker, Dieter Kranzlmüller

Leibniz Supercomputing Centre, Elisabeth Mayer

6D位姿估计

针对XR交互仍依赖手柄、对新手和运动障碍用户不够友好的问题,本文提出以人体姿态估计支撑非侵入式全身追踪,用低成本、无需穿戴额外硬件的方式实现空间交互。核心洞察是将“无需佩戴设备、用户不感知追踪硬件”作为设计条件,以提升可达性和沉浸感;但论文主要是概念性提案,文中未充分说明实测系统性能或用户研究结果。

An Online Adaptation Method for Robust Depth Estimation and Visual Odometry in the Open World Figure 1
arXiv preprint2025-04-16

An Online Adaptation Method for Robust Depth Estimation and Visual Odometry in the Open World

Xingwu Ji, Haochen Niu, Dexin Duan, Rendong Ying, Fei Wen, Peilin Liu

the Brain-inspired Application Technology Center (BATC), School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China (

6D位姿估计相机位姿彩色深度

针对学习式深度估计与视觉里程计在开放场景中因域偏移导致深度和位姿不可靠的问题,论文提出自监督在线适应框架:冻结主干,仅更新轻量 R-DepthNet refiner,并用 SLAM 稀疏地图与相对位姿生成伪深度和有效掩码形成闭环监督。KITTI、TUM及移动机器人实验显示其相较现有学习式方法具备更好的鲁棒性和跨环境泛化能力。

CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image Figure 1
arXiv preprint2025-04-17

CAP-Net: A Unified Network for 6D Pose and Size Estimation of Categorical Articulated Parts from a Single RGB-D Image

Jingshun Huang, Haitao Lin, Tianyu Wang, Yanwei Fu, Xiangyang Xue, Huawei, Noah’s Ark Lab

Fudan University Huawei, Noah’s Ark Lab

6D位姿估计点云彩色深度

面向机器人操作中铰接物体小部件难分割、跨类别泛化弱和仿真到真实落差大的问题,CAP-Net将RGB语义特征与点云几何融合,在单阶段网络中联合预测部件语义、实例中心偏移和NPCS,再通过聚类与对齐恢复6D位姿和尺寸;同时构建带真实感渲染与深度噪声的RGBD-Art数据集。实验显示其在该基准上显著优于现有方法,并在真实机器人任务中表现出较好的迁移鲁棒性。

DMAGaze: Gaze Estimation Based on Feature Disentanglement and Multi-Scale Attention Figure 1
arXiv preprint2025-04-15

DMAGaze: Gaze Estimation Based on Feature Disentanglement and Multi-Scale Attention

Haohan Chen, Hongjia Liu, Shiyong Lan, Wenwu Wang, Yixin Qiao, Yao Li, Guonan Deng

6D位姿估计

DMAGaze针对外观式视线估计中人脸表情、外观和姿态等无关因素干扰的问题,提出连续掩码特征解耦器,通过眼区/非眼区重建分离视线相关全局信息,并用MS-GLAM结合多尺度局部注意与带高斯相似度的Non-Local建模非线性依赖。最终融合解耦人脸特征、局部眼部特征和头姿,在MPIIFaceGaze与Rt-Gene上达到3.74°、6.17°角误差,优于已有方法。

MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model Figure 1
arXiv preprint2025-04-14

MonoDiff9D: Monocular Category-Level 9D Object Pose Estimation via Diffusion Model

Jian Liu, Wei Sun, Hui Yang, Jin Zheng, Zichen Geng, Hossein Rahmani, Ajmal Mian

Wuhu Hit Robot Technology Research Institute, Central South University, University of Western Australia, Lancaster University

6D位姿估计物体位姿类别级位姿

针对单目类别级9D位姿估计常依赖深度传感器、形状先验或CAD模型的问题,MonoDiff9D将DINOv2零样本估计的粗深度转为点云,并与RGB全局特征和时间步编码融合,条件化Transformer去噪扩散过程,从高斯噪声生成平移、旋转和尺寸。在两个常用基准上,方法在无需形状先验/CAD的设置下达到单目类别级SOTA,并接近实时。

Benchmarking 3D Human Pose Estimation Models Under Occlusions Figure 1
arXiv preprint2025-04-14

Benchmarking 3D Human Pose Estimation Models Under Occlusions

Filipa Lino, Carlos Santiago, Robotics, manuel@isr.tecnico.ulisboa.pt

Institute for Systems and Robotics, LARSyS

6D位姿估计人体姿态数据集/基准

遮挡会使2D关键点检测误差传导到3D人体姿态重建,但常用Human3.6M基准难以反映真实遮挡。本文用带逐帧/逐关节遮挡标注的BlendMimic3D,设计基于真实2D检测器噪声的遮挡评测协议,对9个2D到3D提升模型做全局与逐关节分析。结果显示各架构均明显退化,扩散模型也未展现天然鲁棒性,手腕、脚等远端关节最脆弱。

Differentially Private 2D Human Pose Estimation Figure 1
arXiv preprint2025-04-15

Differentially Private 2D Human Pose Estimation

Kaushik Bhargav Sivangi, Paul Henderson, Fani Deligianni School of Computing Science

School of Computing Science, University of Glasgow

6D位姿估计人体姿态

面向医疗、家庭等敏感场景中人体姿态估计的隐私泄露风险,论文系统研究差分隐私训练在2D HPE上的精度损失,并提出Feature-Projective DP:用低维梯度子空间投影降低DP噪声,同时仅对敏感特征加噪、保留公共视觉线索。在MPII与HumanART上优于普通DP-SGD,ε=0.8时达到82.61% PCKh@0.5,并在跨数据集上取得51.6 AP。

TT3D: Table Tennis 3D Reconstruction Figure 1
arXiv preprint2025-04-14

TT3D: Table Tennis 3D Reconstruction

Thomas Gossard, Andreas Ziegler

University of Tübingen

6D位姿估计三维重建

针对乒乓球转播多为单目、2D轨迹受视角和遮挡限制的问题,TT3D构建了从在线视频恢复整场回合3D状态的流水线。其关键在于用球运动与反弹物理搜索最小重投影误差的反弹状态,并通过球桌分割自动标定相机、跟踪变焦与位姿,还可在不依赖人体或球拍跟踪的情况下推断旋转。实验中桌面分割达到0.92 mIoU、70 FPS,标定在桌面平面方向约5% MRAE,支持较可靠的3D球轨迹与球员姿态重建。

Efficient 2D to Full 3D Human Pose Uplifting including Joint Rotations Figure 1
arXiv preprint2025-04-14

Efficient 2D to Full 3D Human Pose Uplifting including Joint Rotations

Katja Ludwig, Yuliia Oksymets, Robin Schön, Daniel Kienzle, Rainer Lienhart Chair for Machine Learning, Computer Vision, Germany @uni-a.de

Chair for Machine Learning & Computer Vision, University of Augsburg, Germany

6D位姿估计人体姿态

面向体育生物力学分析,传统3D HPE定位准但缺少关节旋转,HMR有旋转却定位较弱,而HPE+IK又计算昂贵。本文在UU 2D-to-3D uplift框架上直接回归含关节旋转的完整3D人体姿态,并比较旋转表示、损失与有/无旋转监督训练。结果显示其旋转估计达到SOTA,关节定位优于HMR,且比IK方案快约150倍。

NeRF-Based Transparent Object Grasping Enhanced by Shape Priors Figure 1
arXiv preprint2025-04-14

NeRF-Based Transparent Object Grasping Enhanced by Shape Priors

Yi Han, Zixin Lin, Dongjie Li, Lvping Chen, Yongliang Shi, Gan Ma

Y. Shi is with Tsinghua University, China

6D位姿估计三维重建

针对透明物体因反射/折射导致深度相机失效、学习法又依赖高质量标注数据的问题,本文用 instant-ngp 式 NeRF 做多视角桌面场景重建,再结合几何驱动位姿估计与 DeepSDF 形状先验补全稀疏/缺失点云,并接入 GraspNet 进行 6D 抓取预测。实验在真实机器人和杂乱透明物体场景中验证了可获得更完整三维信息和可执行抓取,但具体定量增益与消融细节文中片段未充分说明。

EasyREG: Easy Depth-Based Markerless Registration and Tracking using Augmented Reality Device for Surgical Guidance Figure 1
arXiv preprint2025-04-13

EasyREG: Easy Depth-Based Markerless Registration and Tracking using Augmented Reality Device for Surgical Guidance

Yue Yang

Stanford University

6D位姿估计彩色深度医学/手术

面向AR手术导航中标记物部署繁琐、遮挡和离群点导致无标记精度不足的问题,EasyREG仅用HoloLens 2原生ToF深度传感器,将高精度鲁棒配准与实时6DoF跟踪分成两模块:通过深度误差校正、人机交互区域过滤、曲率感知采样的TEASER++全局对齐和ICP精修初始化,再用快速ICP持续更新位姿。仿真和真实实验显示,其配准优于现有方案,跟踪性能与工业方案相当。

SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flow Figure 1
arXiv preprint2025-04-12

SCFlow2: Plug-and-Play Object Pose Refiner with Shape-Constraint Scene Flow

Qingyuan Wang, Rui Song, Jiaojiao Li, Kerui Cheng, David Ferstl, MagicLeap

State Key Laboratory of ISN, Xidian University Taiyuan University of Technology MagicLeap

6D位姿估计物体位姿

SCFlow2针对现有6D位姿细化在新物体上需重训、2D匹配噪声大且多假设效率低的问题,将目标3D形状先验与3D场景流中的刚体运动嵌入结合,把深度作为迭代正则纳入循环匹配网络。其作为即插即用后处理,在BOP新物体评测中无需微调即可提升多种SOTA方法,并用单一位姿假设取得较高精度和效率。

A Constrained Optimization Approach for Gaussian Splatting from Coarsely-posed Images and Noisy Lidar Point Clouds Figure 1
arXiv preprint2025-04-12

A Constrained Optimization Approach for Gaussian Splatting from Coarsely-posed Images and Noisy Lidar Point Clouds

Jizong Peng, Tze Ho Elden Tse, Kai Xu, Wenchao Gao, Angela Yao dConstruct Robotics, @comp.nus.edu.sg

dConstruct Robotics National University of Singapore

6D位姿估计点云三维重建高斯泼溅

该文针对3DGS依赖精确SfM位姿和干净点云、难以直接用于多相机SLAM/Lidar粗初始化的问题,提出将相机位姿分解为相机到设备中心与设备到世界两级优化,并用参数敏感性预条件、log-barrier可行域约束及极线/重投影几何正则联合细化内外参与高斯表示。实验在自采室内外数据和两个公开基准上优于多模态3DGS及COLMAP辅助方法,同时显著减少预处理时间。

BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splatting Figure 1
arXiv preprint2025-04-12

BIGS: Bimanual Category-agnostic Interaction Reconstruction from Monocular Videos via 3D Gaussian Splatting

Jeongwan On, Kyeonghwan Gwak, Gunyoung Kang, Junuk Cha, Soohyun Hwang, Hyein Hwang, Seungryul Baek UNIST, South Korea

Ulsan National Institute of Science and Technology

6D位姿估计类别级位姿三维重建高斯泼溅

面向单目视频中双手与未知物体交互的三维重建,BIGS针对双手遮挡严重、无物体模板的问题,将手和物体分别建模为3D Gaussian后再联合优化交互对齐;物体侧引入扩散模型SDS补全不可见表面,手部侧利用MANO先验并共享左右手规范高斯以累积有限视角信息。在ARCTIC和HO3D上,其手姿态、物体重建和渲染指标均达到SOTA。

The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation Figure 1
arXiv preprint2025-04-11

The Invisible EgoHand: 3D Hand Forecasting through EgoBody Pose Estimation

Masashi Hatano, Zhifan Zhu, Hideo Saito

Keio University University of Bristol

6D位姿估计手部姿态人体姿态

该文针对第一视角中双手常因出画而无法仅靠可见轨迹预测、且既有方法多忽略手指关节的问题,提出 EgoH4:用扩散式 Transformer 联合去噪身体与双手关节,并加入手部可见性预测和 3D-2D 重投影约束,以身体姿态为不可见手提供运动约束。在 Ego-Exo4D 上构建 156K/34K 序列评测,整体手轨迹 ADE 降低 3.4cm,手姿态 MPJPE 降低 5.1cm。

MBE-ARI: A Multimodal Dataset Mapping Bi-directional Engagement in Animal-Robot Interaction Figure 1
arXiv preprint2025-04-11

MBE-ARI: A Multimodal Dataset Mapping Bi-directional Engagement in Animal-Robot Interaction

Ian Noronha, Advait Prasad Jawaji, Juan Camilo Soto, Jiajun An, Yan Gu, Upinder Kaur

Purdue University West Lafayette

6D位姿估计机器人操作数据集/基准

该工作针对动物—机器人交互缺少可训练数据与行为标注的问题,采集四足机器人与奶牛互动的多视角同步 RGB-D 数据,并按任务阶段、活动和姿态进行结构化标注。其核心价值在于把耳眼、体态、步态等非语言线索纳入双向交互建模,同时提供面向四足动物的 39 点全身姿态估计器;在 MBE-ARI 上报告 mAP 92.7%,优于既有动物姿态基准,为后续感知与交互策略提供基准。

Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Review Figure 1
Sensors2025-04-11

Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Review

Claudio Cimarelli, Jose Andres Millan-Romera, Holger Voos, Jose Luis Sanchez-Lopez

University of Luxembourg

6D位姿估计

针对传统帧相机在高速运动、强光照变化和低功耗场景中的延迟、冗余与动态范围不足问题,本文综述事件相机从硬件演进到算法生态的进展,重点梳理特征、跟踪、光流以及深度/位姿估计等事件数据处理方法。主要结果是给出面向机器人、自动驾驶等应用的技术图谱,并指出普及仍受传感器限制、算法适配和产业落地缺口制约。

Multi-person Physics-based Pose Estimation for Combat Sports Figure 1
arXiv preprint2025-04-11

Multi-person Physics-based Pose Estimation for Combat Sports

Hossein Feiz, David Labbé, Thomas Romeas, Jocelyn Faubert, Montreal, Canada @etsmtl.ca Université de Montréal, Canada @umontreal.ca

David Labbé

6D位姿估计

针对拳击等格斗场景中高速动作、遮挡和近距离对抗导致的多人3D姿态难题,论文将稀疏多视角2D跟踪、极线约束身份一致性、加权三角化与运动学优化串联,并加入多人物理轨迹优化来抑制穿模、脚滑和地面碰撞。实验在Shelf及新采集精英拳击多视角数据上达到或优于现有方法,同时发布带标注数据集。

Towards Unconstrained 2D Pose Estimation of the Human Spine Figure 1
arXiv preprint2025-04-10

Towards Unconstrained 2D Pose Estimation of the Human Spine

Muhammad Saif Ullah Khan, Stephan Krauß

German Research Center for Artificial Intelligence (DFKI)

6D位姿估计

现有人体姿态数据集通常把脊柱简化为颈-骨盆的刚性段,难以服务运动分析、康复和真实动画中的细粒度脊柱运动评估。本文提出 SpineTrack,在真实与 Unreal 合成数据中标注 9 个脊柱关键点,并用主动学习与 OpenSim 生物力学校验提升标注一致性;同时以知识蒸馏和解剖正则扩展现有姿态模型为 SpinePose。实验显示其在通用和体育场景中提升脊柱跟踪精度,且不明显损害整体人体姿态估计表现。

BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation Figure 1
arXiv preprint2025-04-10

BoxDreamer: Dreaming Box Corners for Generalizable Object Pose Estimation

Yuanhong Yu, Xingyi He, Chen Zhao, Junhao Yu, Jiaqi Yang, Ruizhen Hu Yujun Shen, Xing Zhu, Xiaowei Zhou, Ant Group, EPFL

Zhejiang University Xiangjiang Laboratory Ant Group, EPFL Chongqing University Northwestern Polytechnical University Shenzhen University

6D位姿估计物体位姿

BoxDreamer面向稀疏参考视角和遮挡下的未知物体6D位姿估计,指出检索式依赖密集视角、匹配式依赖完整点云而鲁棒性不足。其核心是把3D包围盒八个角点作为中间语义表示,用稀疏重建得到3D角点,再由参考引导的Transformer合成目标视图2D角点,并通过PnP求位姿。在YCB-Video和Occluded-LINEMOD等实验中优于现有检索/匹配方法,显示出更好的稀疏视角泛化与遮挡适应性。

DLTPose: 6DoF Pose Estimation From Accurate Dense Surface Point Estimates Figure 1
arXiv preprint2025-04-09

DLTPose: 6DoF Pose Estimation From Accurate Dense Surface Point Estimates

Akash Jadhav, Michael Greenspan Dept. of Electrical, Computer Engineering, Kingston, Ontario, Canada

Dept. of Electrical and Computer Engineering, Ingenuity Labs Research Institute, Queen’s University, Kingston, Ontario, Canada

6D位姿估计

针对6D位姿估计中稀疏关键点易受遮挡影响、稠密坐标回归又不够精确的问题,DLTPose让RGB-D网络预测每像素到至少四个关键点的径向距离,并用新的DLT求解物体坐标系下的稠密表面点,再经RANSAC-Umeyama估计位姿;同时通过对称感知的关键点重排缓解对称物体标注不一致。在LINEMOD、Occlusion LINEMOD和YCB-Video上取得优于现有方法的结果,优势集中在遮挡和对称物体场景。

Two by Two: Learning Multi-Task Pairwise Objects Assembly for Generalizable Robot Manipulation Figure 1
arXiv preprint2025-04-09

Two by Two: Learning Multi-Task Pairwise Objects Assembly for Generalizable Robot Manipulation

Yu Qi, Yuanchen Ju, Tianming Wei, Chi Chu, Lawson L.S. Wong, IIIS

Shanghai Qi Zhi Institute Northeastern University IIIS, Tsinghua University, Shanghai Jiao Tong University Shanghai AI Laboratory

6D位姿估计机器人操作

面向家用机器人中插接、盖合、摆放等日常双物体装配,论文指出传统碎片/工业零件装配基准难以刻画功能与空间关系。其核心贡献是构建含517对物体、18类任务及位姿/对称标注的2BY2数据集,并提出按“承载物体再装配物体”顺序预测的两步SE(3)等变位姿估计框架。实验显示其在全部任务上优于既有形状装配方法,平移和旋转RMSE分别平均改善0.046与8.97,机器人实验证明一定泛化性。

GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes Figure 1
IEEE Robotics and Automation Letters2025-04-09

GraspClutter6D: A Large-scale Real-world Dataset for Robust Perception and Grasping in Cluttered Scenes

Seunghyeok Back, Joosoon Lee, Kangmin Kim, Heeseon Rho, Geonhyup Lee, Raeyoung Kang, Sangbeom Lee, Sangjun Noh, Youngjin Lee, Taeyeop Lee, Kyoobin Lee

Korea Institute of Machinery & Materials (KIMM), Gwangju Institute of Science and Technology (GIST)

6D位姿估计数据集/基准

针对现有抓取/6D位姿数据集多为轻遮挡、单一桌面场景而难以支撑真实杂乱操作的问题,GraspClutter6D构建了包含1000个高密集真实场景、200物体、75种环境配置的RGB-D数据集,并提供736K个6D位姿与9.3B个6-DoF抓取标注。基准显示现有分割、位姿和抓取方法在高遮挡下明显受限,而用该数据训练的抓取网络在仿真和真实实验中优于现有数据集训练结果,增益可能主要来自更贴近真实杂乱场景的scale/data。

Setup-Invariant Augmented Reality for Teaching by Demonstration with Surgical Robots Figure 1
arXiv preprint2025-04-09

Setup-Invariant Augmented Reality for Teaching by Demonstration with Surgical Robots

Alexandre Banks, Richard Cook, Septimiu E. Salcudean, Life Fellow, IEEE

6D位姿估计机器人操作医学/手术

针对手术机器人新手训练依赖专家现场指导、且AR示教难以适配不同机器人摆位的问题,本文提出开源 dV-STEAR:将专家操作按训练任务注册并以3D幽灵器械回放,实现对setup joint变化不敏感的示教。系统在dVRK上验证,配准误差为3.86±2.01 mm;24人实验显示其提升绕线速度、降低碰撞时间,提高抓放任务成功率,并改善双手使用均衡性与挫败感。

HGMamba: Enhancing 3D Human Pose Estimation with a HyperGCN-Mamba Network Figure 1
arXiv preprint2025-04-09

HGMamba: Enhancing 3D Human Pose Estimation with a HyperGCN-Mamba Network

Anonymous Authors, Hu Cui, Tessai Hayama

Nagaoka University of Technology

6D位姿估计人体姿态

该文关注从2D人体关键点提升到3D姿态时,高质量或真值2D输入下现有方法对局部人体结构建模不足的问题。HGMamba以双流块结合多粒度Hyper-GCN局部关节/肢体先验与Shuffle-Mamba全局时空扫描,并自适应融合两类特征。在Human3.6M和MPI-INF-3DHP上,HGMamba-B分别取得38.65 mm和14.33 mm的P1误差,报告为SOTA。

Leveraging Synthetic Adult Datasets for Unsupervised Infant Pose Estimation Figure 1
arXiv preprint2025-04-08

Leveraging Synthetic Adult Datasets for Unsupervised Infant Pose Estimation

Sarosij Bose, Hannah Dela Cruz, Arindam Dutta, Elena Kokkoni, Konstantinos Karydis, Riverside, USA @ucr.edu, @ece.ucr.edu

Konstantinos Karydis, Amit K. Roy-Chowdhury, University of California, Riverside, USA

6D位姿估计仿真到现实数据集/基准

针对婴儿姿态标注稀缺、隐私限制及成人模型跨域到婴儿时受解剖差异和遮挡影响而泛化差的问题,论文提出SHIFT,将合成成人数据预训练模型以Mean-Teacher伪标签做无监督适配,并加入婴儿姿态流形先验与关键点到分割的可见性一致性约束。实验在多个婴儿基准上较现有UDA方法约提升5%,并较监督婴儿姿态方法报告约16%优势。

SAP-CoPE: Social-Aware Planning using Cooperative Pose Estimation with Infrastructure Sensor Nodes Figure 1
arXiv preprint2025-04-08

SAP-CoPE: Social-Aware Planning using Cooperative Pose Estimation with Infrastructure Sensor Nodes

Minghao Ning, Yufeng Yang, Shucheng Huang, Jiaming Zhong, Keqi Shu, Chen Sun, Ehsan Hashemi, Amir Khajepour

6D位姿估计

面向医院、商场等人群密集室内场景,论文针对车载/机载感知视野受限、遮挡严重且传统避障忽略行人心理舒适区的问题,提出 SAP-CoPE:用天花板基础设施传感节点进行不确定性建模的 3D 人体姿态估计,并将人体朝向与个人空间场嵌入 MPC 规划。真实实验显示其可生成更平滑、保持更合适间距且行驶时间更优的社会感知轨迹。

POMATO: Marrying Pointmap Matching with Temporal Motion for Dynamic 3D Reconstruction Figure 1
arXiv preprint2025-04-08

POMATO: Marrying Pointmap Matching with Temporal Motion for Dynamic 3D Reconstruction

Songyan Zhang, Yongtao Ge, Jinyuan Tian, Guangkai Xu, Hao Chen, Chen Lv, Chunhua Shen

Nanyang Technological University, Singapore, Zhejiang University, China, The University of Adelaide, Australia

6D位姿估计三维重建

POMATO面向动态场景中几何重建与跨帧匹配分离带来的误差累积问题,将DUSt3R式pointmap扩展为显式3D匹配表示,并加入基于时间自注意力的运动模块以保持视频帧间尺度一致、建模动态区域。实验显示其在视频深度估计、3D点跟踪和相机位姿估计等任务上均取得更好表现。

Learning Affine Correspondences by Integrating Geometric Constraints Figure 1
arXiv preprint2025-04-10

Learning Affine Correspondences by Integrating Geometric Constraints

Engineering, Vision Navigation, China. ETH Zurich, Switzerland. HUN-REN SZTAKI, Hungary

College of Aerospace Science and Engineering, National University of Defense Technology, China, Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation, China, ETH Zurich, Switzerland

6D位姿估计

针对传统仿射对应依赖稀疏检测器、在弱纹理和大视角变化下数量与精度不足的问题,论文将密集匹配与几何约束结合,设计关键点尺度/方向估计器,并用 Affine Sampson Distance 等损失监督局部仿射几何学习。实验显示其在图像匹配中获得更多、更准的对应,并在多组真实数据的相对位姿估计上优于基线。

A Convex and Global Solution for the P $n$ P Problem in 2D Forward-Looking Sonar Figure 1
arXiv preprint2025-04-10

A Convex and Global Solution for the P $n$ P Problem in 2D Forward-Looking Sonar

Jiayi Su, Jingyu Qian, Liuqing Yang, Yufan Yuan, Yanbing Fu, Jie Wu, Yan Wei, Fengzhong Qu

6D位姿估计

面向浑浊水下环境中光学相机受限、2D前视声呐位姿估计研究不足的问题,论文将FLS的PnP通过正交近似转化为3D点到线配准,并用对偶最优求解器保证全局解,同时以零空间分析处理共面退化。仿真显示其较未做重投影优化的SOTA精度明显更高,优化后相当或略优,但高噪声下tz估计和实时性仍是短板。

3R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS Figure 1
arXiv preprint2025-04-05

3R-GS: Best Practice in Optimizing Camera Poses Along with 3DGS

Zhisheng Huang, Peng Wang, Jingdong Zhang, Yuan Liu, Xin Li, Wenping Wang, Technology

Texas A&M University, Hong Kong University, Hong Kong University of Science and Technology

6D位姿估计相机位姿三维重建高斯泼溅

3R-GS针对3DGS高度依赖精确SfM位姿、而MASt3R/DUSt3R等前馈重建虽鲁棒但精度不足的问题,主张不要直接做朴素联合优化,而是用3DGS-MCMC降低初始化敏感性,并引入MLP位姿细化与极线距离损失利用跨图像几何约束。实验显示其在不完美相机注册下仍能提升新视角合成质量和6D相机位姿精度,同时保持较好效率。

A Geometric Approach For Pose and Velocity Estimation Using IMU and Inertial/Body-Frame Measurements Figure 1
arXiv preprint2025-04-02

A Geometric Approach For Pose and Velocity Estimation Using IMU and Inertial/Body-Frame Measurements

Sifeddine Benahmed, Soulaimane Berkane, T. HAMEL

Centre National de la Recherche Scientifique

6D位姿估计

针对IMU积分易漂移、EKF依赖局部线性化且在强非线性下稳定性有限的问题,论文将姿态、位置、速度及辅助变量嵌入SE5(3),把惯性系/机体系观测统一为右不变输出,使旋转与平移误差解耦,并用Riccati方程设计时变增益。在一致可观条件下证明观测器几乎全局渐近稳定,仿真中于立体视觉辅助INS和GPS辅助INS均能收敛并表现出一定抗噪能力。

Robust Human Registration with Body Part Segmentation on Noisy Point Clouds Figure 1
arXiv preprint2025-04-04

Robust Human Registration with Body Part Segmentation on Noisy Point Clouds

Kai Lascheit 1, Daniel Barath 1, Marc Pollefeys 1, Leonidas Guibas 3, Francis Engelmann 3

ETH Zurich, Microsoft, Stanford University, Google

6D位姿估计点云

面向真实点云中的噪声、遮挡和背景杂波导致人体 SMPL-X 配准不稳的问题,论文提出 SegFit,将身体部位分割作为语义约束:先用部位质心初始化姿态与朝向,再全局优化网格配准,并反过来用拟合网格细化点级部位标签。在 InterCap、EgoBody、BEHAVE 上,相比 ArtEq、NICP、Human3D 等方法,姿态建模误差最高约提升十倍,分割精度最高提升 22%。

Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Video Figure 1
Lecture notes in computer science2025-04-04

Endo3R: Unified Online Reconstruction from Dynamic Monocular Endoscopic Video

Jiaxin Guo, Wenzhen Dong, Tianyu Huang, Hao Ding, Ziyi Wang, Haomin Kuang, Qi Dou, Yun-hui Liu

Chinese University of Hong Kong, Johns Hopkins University, Shanghai Jiao Tong University

6D位姿估计三维重建

Endo3R面向动态、弱纹理内窥镜单目视频中尺度一致三维重建困难的问题,尝试用单阶段基础模型同时预测全局点图、视频深度、位姿与内参。其关键在于将DUSt3R式成对重建扩展为在线长序列重建,引入基于Sampson距离筛除不可靠token的双记忆机制,并用动态感知光流损失做自监督训练。在SCARED和Hamlyn上,论文报告其零样本深度预测与相机位姿估计优于对比方法且具在线效率。

Cooperative Inference for Real-Time 3D Human Pose Estimation in Multi-Device Edge Networks Figure 1
arXiv preprint2025-04-03

Cooperative Inference for Real-Time 3D Human Pose Estimation in Multi-Device Edge Networks

Hyun-Ho Choi, Kangsoo Kim, Ki-Ho Lee, Kisong Lee

6D位姿估计人体姿态

面向多设备边缘网络中3D人体姿态估计的算力与传输受限问题,论文提出协同推理:终端用轻量模型和双置信阈值筛出不确定图像,仅将其交由边缘服务器强模型复核,并联合优化各设备阈值与传输时间。实验表明该策略可在满足端到端时延约束下显著降低MPJPE,揭示了阈值选择带来的精度—时延权衡。

BOP Challenge 2024 on Model-Based and Model-Free 6D Object Pose Estimation Figure 1
arXiv preprint2025-04-03

BOP Challenge 2024 on Model-Based and Model-Free 6D Object Pose Estimation

Van Nguyen Nguyen 1, Stephen Tyree 2, Andrew Guo 3, Médéric Fourmy 4, Anas Gouda 5, Taeyeop Lee 6

Yann Labbé, NVIDIA, University of Toronto, KAIST, NAVER LABS, Heidelberg University, Google, Meta

6D位姿估计物体位姿数据集/基准

这篇基准论文针对6D位姿估计从实验室走向真实开放场景的需求,扩展BOP 2024:新增无3D模型、仅凭参考视频建档的model-free任务,更实用的6D检测设定,以及含AR/VR高分辨率采集的BOP-H3数据集。结果显示未见物体位姿进展明显,FreeZeV2.1较GenFlow精度高22%,Co-op以0.8秒/图更具实用性;但未见物体2D检测仍落后已见物体约35%,成为主要瓶颈。

PicoPose: Progressive Pixel-to-Pixel Correspondence Learning for Novel Object Pose Estimation Figure 1
arXiv preprint2025-04-03

PicoPose: Progressive Pixel-to-Pixel Correspondence Learning for Novel Object Pose Estimation

Lihua Liu, Jiehong Lin, Zhenxin Liu, Kui Jia

South China University of Technology The University of Hong Kong, The Chinese University of, Hong Kong, Shenzhen

6D位姿估计物体位姿未知物体

PicoPose面向机器人快速部署中仅用RGB估计未知物体6D位姿的问题,针对模板匹配易产生噪声对应和外点的痛点,提出从DINOv2特征粗匹配、全局2D仿射平滑到局部偏移细化的渐进像素对应学习,再用PnP/RANSAC求姿态。在七个BOP核心数据集上取得RGB设定SOTA,显示较强零样本泛化,但仍依赖多视角模板,实时性与模板效率有待改进。

Dual-stream Transformer-GCN Model with Contextualized Representations Learning for Monocular 3D Human Pose Estimation Figure 1
arXiv preprint2025-04-02

Dual-stream Transformer-GCN Model with Contextualized Representations Learning for Monocular 3D Human Pose Estimation

Mingrui Ye, Lianping Yang, Hegui Zhu, Zenghao Zheng, Xin Wang, Yantao Lou

6D位姿估计人体姿态

针对单目3D人体姿态估计中的深度歧义、3D标注稀缺以及全局/局部时空建模失衡,论文提出Transformer-GCN双流框架,并通过遮蔽2D姿态特征的上下文化表示自蒸馏进行预训练,以利用未标注2D数据学习运动表征。方法在Human3.6M上达到38.0mm MPJPE、31.9mm P-MPJPE,在MPI-INF-3DHP上达到15.9mm MPJPE,并展示一定野外泛化能力。

ForestVO: Enhancing Visual Odometry in Forest Environments through ForestGlue Figure 1
IEEE Robotics and Automation Letters2025-04-02

ForestVO: Enhancing Visual Odometry in Forest Environments through ForestGlue

Thomas Pritchard, Saifullah Ijaz, Ronald Clark, Basaran Bahadir Kocer

Computing Department, Imperial College London, Department of Computer Science, University of Oxford, School of Civil, Aerospace and Design Engineering, University of Bristol

6D位姿估计相机位姿

森林中树冠遮挡、光照变化和重复纹理会削弱视觉里程计的特征匹配,限制无人机等轻量平台导航。ForestVO通过面向森林数据重训的ForestGlue改造SuperPoint并结合LightGlue/SuperGlue,支持灰度、RGB、RGB-D和双目输入,再用Transformer由匹配点坐标回归相对位姿。实验中仅用512关键点即可达到10°阈值LO-RANSAC AUC 0.745;在TartanAir森林序列上RPE为1.09 m、KITTI score为2.33%,动态场景较DSO提升约40%。

AP-CAP: Advancing High-Quality Data Synthesis for Animal Pose Estimation via a Controllable Image Generation Pipeline Figure 1
arXiv preprint2025-04-01

AP-CAP: Advancing High-Quality Data Synthesis for Animal Pose Estimation via a Controllable Image Generation Pipeline

Lei Wang, Yujie Zhong, Xiaopeng Sun, Jingchun Cheng, Chengjian Feng, Qiong Cao, Lin Ma, Zhaoxin Fan

Meituan Inc., Beihang University

6D位姿估计

针对动物姿态估计中真实标注数据稀缺、传统3D渲染合成成本高且域差明显的问题,AP-CAP用可控扩散生成管线结合种子图、目标姿态和文本描述,并通过模态融合、姿态调整、caption增强合成带标注数据,构建混合MPCH数据集;实验显示其在多种估计器的域内与跨域评测中均提升性能和泛化能力,增益可能主要来自更大且更多样的数据。

Easi3R: Estimating Disentangled Motion from DUSt3R Without Training Figure 1
arXiv preprint2025-03-31

Easi3R: Estimating Disentangled Motion from DUSt3R Without Training

Xingyu Chen, Yue Chen, Yuliang Xiu, Andreas Geiger, Tübingen AI Center easi3r.github.io

Zhejiang University Westlake University, Max Planck Institute for Intelligent Systems, University of Tübingen, Tübingen AI Center

6D位姿估计

针对动态视频中物体运动破坏静态 SfM/DUSt3R 假设、且4D数据不足导致训练式方法依赖大规模微调的问题,Easi3R发现 DUSt3R 注意力已隐含相机与物体运动信息,通过推理时分解并重加权注意力来分割动态区域、恢复相机位姿和4D点图,无需训练;在真实动态视频上优于多种需动态数据训练或先验模型的方法。

LiM-Loc: Visual Localization with Dense and Accurate 3D Reference Maps Directly Corresponding 2D Keypoints to 3D LiDAR Point Clouds Figure 1
arXiv preprint2025-03-31

LiM-Loc: Visual Localization with Dense and Accurate 3D Reference Maps Directly Corresponding 2D Keypoints to 3D LiDAR Point Clouds

Masahiko Tsuji, Hitoshi Niigaki, Ryuichi Tanida NTT Corporation, Japan

NTT Corporation, Japan

6D位姿估计相机位姿点云

LiM-Loc针对SfM依赖图像匹配导致3D参考图稀疏、关键点三维位置误差大的问题,利用已标定相机与LiDAR,将2D关键点直接对应到点云,并通过球壳压缩/隐藏点移除减少遮挡造成的2D-3D错误。该方法可接入多种局部特征,在室内外数据集上提升PnP相机6D位姿估计精度,说明更密更准的参考图是主要增益来源。

PhysPose: Refining 6D Object Poses with Physical Constraints Figure 1
arXiv preprint2025-03-30

PhysPose: Refining 6D Object Poses with Physical Constraints

Martin Malenickýn, Martin Cífka, Médéric Fourmy, Louis Montaut, Justin Carpentier, Josef Sivic, Vladimir Petrik, Robotics, Cybernetics

Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, Faculty of Electrical Engineering, Czech Technical University in Prague

6D位姿估计物体位姿

PhysPose针对现有6D位姿估计常出现物体悬空、互相穿透等物理不一致,导致机器人抓取失败的问题,将非穿透、重力支撑和场景几何作为后处理优化约束,且可用两视图估计桌面几何。在YCB-Video与HOPE-Video上提升3D相关BOP指标,并在真实Panda拣放任务中提高成功率,说明增益主要来自深度与接触关系的物理修正。

Improving Indoor Localization Accuracy by Using an Efficient Implicit Neural Map Representation Figure 1
arXiv preprint2025-03-30

Improving Indoor Localization Accuracy by Using an Efficient Implicit Neural Map Representation

Certificate of Reproducibility

University of Bonn

6D位姿估计

本文针对室内移动机器人在已知地图中的全局定位精度与实时性矛盾:传统占据栅格表达受分辨率限制,已有隐式神经地图又查询和训练开销较大。作者提出高效神经地图 ENM,用稠密特征网格加轻量网络同时预测 SDF 与方向相关 PSDF,并嵌入 MCL 观测模型。实验显示 ENM-MCL 相比占据栅格和既有神经地图定位更准,收敛后可实时跟踪,全局定位接近实时。

SparseLoc: Sparse Open-Set Landmark-based Global Localization for Autonomous Navigation Figure 1
arXiv preprint2025-03-30

SparseLoc: Sparse Open-Set Landmark-based Global Localization for Autonomous Navigation

Pranjal Paul, Bhat, Vineeth, Tejas Salian, Mohammad Omama, Krishna Murthy Jatavallabhula, Naveen Arulselvan, K. Madhava Krishna

Pranjal Paul 1, Vineeth Bhat 1, Tejas Salian1, Mohammad Omama2, Krishna Murthy Jatavallabhula3, Naveen Arulselvan4, Madhava Krishna1

6D位姿估计

SparseLoc针对城市级自动导航中稠密LiDAR/HD地图存储与计算成本高、GPS不可靠且稀疏地图泛化差的问题,提出用视觉语言基础模型零样本提取开放集静态地标,并以带语义的地标簇质心构建稀疏拓扑-度量地图,再结合改进的蒙特卡洛定位与late optimization回溯优化位姿。在KITTI上仅用约1/500稠密点数达到接近稠密方法的效果,平均全局定位误差低于5m和2°,较已有稀疏方法精度提升超过5倍,并展示跨序列定位和导航可用性。

HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimation Figure 1
arXiv preprint2025-03-30

HiPART: Hierarchical Pose AutoRegressive Transformer for Occluded 3D Human Pose Estimation

Hongwei Zheng 1 Equal Contribution, Han Li 1 Equal Contribution, Wenrui Dai 2 Corresponding Authors, Ziyang Zheng 2 Corresponding Authors, Chenglin Li, Junni Zou, Shanghai, China @sjtu.edu.cn

Shanghai Jiao Tong University, Shanghai, China

6D位姿估计人体姿态

针对遮挡场景下2D到3D人体姿态提升受稀疏2D骨架输入限制的问题,HiPART将关键点先生成层级稠密2D姿态再用于lifting。其核心是用VQ-VAE式多尺度骨架token化与骨架感知对齐学习离散层级表示,并设计适配非欧式骨架的自回归生成策略。实验显示,在Human3.6M、3DPW和3DPW-Occ上单帧设置达到SOTA,且以更低参数和计算量超过或接近多帧方法。

Incorporating GNSS Information with LIDAR-Inertial Odometry for Accurate Land-Vehicle Localization Figure 1
arXiv preprint2025-03-29

Incorporating GNSS Information with LIDAR-Inertial Odometry for Accurate Land-Vehicle Localization

Jintao Cheng, Bohuan Xue, Shiyang Chen, Qiuchi Xiang, Xiaoyu Tang

South China Normal University, Charles III University of Madrid

6D位姿估计相机位姿点云

针对高速行驶、长轨迹或几何退化场景下 LiDAR/视觉里程计易累积漂移且重定位慢的问题,本文将 GNSS 全局位姿与速度、IMU 预积分和 LiDAR 惯性里程计融合到先验 3D 点云地图中,并提出 Dynamic-ICP 通过局部区域选择加速配准与重定位。实验在 HK、KITTI 等数据集及不同建图方式上与 ICP/LOAM 等方法比较,RMSE 更低、稳定性更好,但具体增益来源仍部分依赖先验地图质量。

FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video Figure 1
arXiv preprint2025-03-29

FRAME: Floor-aligned Representation for Avatar Motion from Egocentric Video

Andrea Boscolo Camiletto, Jian Wang, Eduardo Alvarado, Rishabh Dabral, Thabo Beeler, Marc Habermann, Christian Theobalt

Max Planck Institute for Informatics, Saarland Informatics Campus, Saarbr¨ucken Research Center for Visual Computing, Interaction and AI, Google, Switzerland

6D位姿估计

针对头戴自视角动捕中遮挡严重、真实标注数据稀缺导致下肢不准、脚滑和穿地的问题,FRAME用更接近VR设备的轻量采集架构构建了规模约为既有真实数据6倍的SELF数据集,并将双目图像与设备6D位姿显式变换到地面对齐坐标系融合。实验显示其较SOTA将MPJPE降低28%,可在消费级硬件上约300 FPS运行,但部分增益可能主要来自真实数据规模扩大。

ForcePose: A Deep Learning Approach for Force Calculation Based on Action Recognition Using MediaPipe Pose Estimation Combined with Object Detection Figure 1
arXiv preprint2025-03-28

ForcePose: A Deep Learning Approach for Force Calculation Based on Action Recognition Using MediaPipe Pose Estimation Combined with Object Detection

Nandakishor M, Vrinda Govind V, Anuradha Puthalath, Anzy L, Swathi P S, Aswathi R, Devaprabha A R, Varsha Raj, Midhuna Krishnan K, Akhila Anilkumar T V, Yamuna P V

6D位姿估计

针对人-物交互中的受力测量依赖力板、传感器且难以走出实验室的问题,ForcePose将MediaPipe人体33点姿态、SSD MobileNet物体检测与时序网络结合,从视频中联合建模接触位置、关节运动和物体变化,直接回归力大小与方向。文中在850段标注视频上报告力大小MAE为5.83 N、方向误差7.4°,较既有视觉方法提升27.5%,并可在普通硬件实时运行。

GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion Figure 1
Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (ICCV), 2025, pp. 25335-253452025-03-28

GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray Diffusion

Li-Heng Chen, Zi-Xin Zou, Chang Liu, Tianjiao Jing, Yan-Pei Cao, Shi-Sheng Huang, Hongbo Fu, Hua Huang

Beijing Normal University VAST Hong Kong University of Science and Technology

6D位姿估计三维重建

该文针对无位姿、多视角尤其稀疏视角下相机重叠不足导致SfM和联合重建不稳定的问题,提出GCRayDiffusion:将相机表示为带深度属性的神经束射线,用扩散模型做基于射线的位姿束调整,并以全场景triplane-SDF条件约束去噪,再把射线采样的表面点用于SDF几何正则。实验在Objaverse、GSO等数据集上显示,其位姿估计优于COLMAP、RelPose++、PoseDiffusion、RayDiffusion等,并得到更一致的表面重建,优势在稀疏输入下更明显。

NeRF-based Point Cloud Reconstruction using a Stationary Camera for Agricultural Applications Figure 1
arXiv preprint2025-03-27

NeRF-based Point Cloud Reconstruction using a Stationary Camera for Agricultural Applications

Kibon Ku, Talukder Z Jubery, Elijah Rodriguez, Aditya Balu, Soumik Sarkar, Adarsh Krishnamurthy, Ames

Iowa State University, Ames, IA, USA

6D位姿估计点云三维重建

面向室内高通量植物表型中相机难以绕物体运动、昂贵传感器不宜移动的问题,论文提出 SC-NeRF:用单个固定相机拍摄转台上的植株,经 COLMAP 估计位姿并做坐标变换,将“物体旋转”转化为等效“相机运动”,再训练标准 NeRF,并用 ROI 过滤背景生成千万级点云。实验在多种植物上得到接近 100 的 F-score,说明固定相机也可获得高保真重建;主要瓶颈仍是位姿估计耗时。

Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Video Figure 1
arXiv preprint2025-03-27

Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Video

David Yifan Yao, Albert J. Zhai, Shenlong Wang

University of Illinois at Urbana-Champaign

6D位姿估计

Uni4D针对真实单目视频中动态场景缺少4D真值、相机位姿/几何/运动需联合求解的问题,提出无需训练的多阶段能量优化框架,把深度、密集跟踪、动态分割等视觉基础模型输出视为4D世界的2D投影,并结合几何与运动先验逐步估计相机、静态/动态结构和3D运动。在Sintel、DAVIS、TUM-Dynamics、Bonn等数据集上,其相机位姿与几何质量优于动态4D建模基线,视觉效果更稳定。

Reconstructing Humans with a Biomechanically Accurate Skeleton Figure 1
arXiv preprint2025-03-27

Reconstructing Humans with a Biomechanically Accurate Skeleton

Yan Xia, Xiaowei Zhou, Etienne Vouga, Qixing Huang

The University of Texas at Austin, Zhejiang University

6D位姿估计医学/手术

针对SMPL等人体模型骨架不符合解剖结构、易产生超出关节限制的姿态,论文提出HSMR,从单张图像用Transformer回归SKEL生物力学骨架参数,并通过SMPL到SKEL的伪标注转换与训练中迭代优化缓解无真值数据问题。实验显示其在常规3D人体重建指标上接近现有方法,在极端姿态和视角下更稳健,关节旋转也更符合生物力学约束。

OccRobNet : Occlusion Robust Network for Accurate 3D Interacting Hand-Object Pose Estimation Figure 1
arXiv preprint2025-03-27

OccRobNet : Occlusion Robust Network for Accurate 3D Interacting Hand-Object Pose Estimation

Mallika Garg, Pyari Mohan Pradhan, Debashis Ghosh

ECE Department

6D位姿估计物体位姿手部姿态

本文针对手物交互和双手交互中遮挡导致关节归属与3D姿态估计不稳的问题,提出OccRobNet:先用CNN/FPN预测热图,再以CIET提取上下文信息,并通过自注意力关联关节身份、交叉注意力回归手和物体位姿,辅以sigmoid/softmax注意力抑制无关像素。实验在InterHand2.6M、HO3D和H2O-3D上报告优于Keypoint Transformer等方法,如H2O-3D关节精度约提升8%、带平移约提升14%。

RapidPoseTriangulation: Multi-view Multi-person Whole-body Human Pose Triangulation in a Millisecond Figure 1
arXiv preprint2025-03-27

RapidPoseTriangulation: Multi-view Multi-person Whole-body Human Pose Triangulation in a Millisecond

Germany daniel.bermuth@uni-a.de

University of Augsburg, Germany, University of Augsburg

6D位姿估计人体姿态多视角

面向机器人协作、运动分析等场景,多视角多人3D姿态需要在遮挡下实时融合2D检测且能跨相机配置泛化。RapidPoseTriangulation采用免学习的代数三角化流程,通过跨视角配对、重投影误差过滤、3D提案分组与全身关键点重三角化生成多人全身姿态。文中在多个未见数据集上显示其比现有方法更可靠且显著更快,可达毫秒级,提示复杂学习式融合并非总是必要。

STAMICS: Splat, Track And Map with Integrated Consistency and Semantics for Dense RGB-D SLAM Figure 1
arXiv preprint2025-03-27

STAMICS: Splat, Track And Map with Integrated Consistency and Semantics for Dense RGB-D SLAM

Yongxu Wang, Xu Cao, Weiyun Yi, Zhaoxin Fan

6D位姿估计相机位姿点云彩色深度

STAMICS针对RGB-D稠密SLAM中过度依赖几何、跨帧语义易漂移的问题,将语义约束嵌入3D Gaussian Splatting重建,并用图聚类维护时间一致性,同时引入开放词表识别未见物体。实验显示其在相机位姿估计与地图质量上优于现有方法、降低重建误差,但具体增益来源仍需结合完整消融判断。

Recurrent Feature Mining and Keypoint Mixup Padding for Category-Agnostic Pose Estimation Figure 1
arXiv preprint2025-03-27

Recurrent Feature Mining and Keypoint Mixup Padding for Category-Agnostic Pose Estimation

Junjie Chen, Weilong Chen, Yifan Zuo, Economics @jxufe.edu.cn

Jiangxi University of Finance and Economics

6D位姿估计类别级位姿

针对类别无关姿态估计中,现有热图池化与交叉注意力难以为像素级关键点定位提供细粒度、结构感知特征的问题,FMMP用可变形注意力在支持图和查询图上循环挖掘多尺度关键点及其连接关系特征,并以关键点 mixup padding 替代零填充来增强监督。在 MP-100 上较 SOTA 提升 3.2% PCK@0.05,表明改进主要来自更充分的特征挖掘与填充监督。

DINeMo: Learning Neural Mesh Models with no 3D Annotations Figure 1
arXiv preprint2025-03-26

DINeMo: Learning Neural Mesh Models with no 3D Annotations

Weijie Guo, Guofeng Zhang, Wufei Ma

Johns Hopkins University, Peking University

6D位姿估计

DINeMo针对类别级3D/6D位姿估计中神经网格模型依赖昂贵3D标注、难以扩展的问题,利用视觉基础模型产生伪对应关系,并通过结合局部外观相似性与全局姿态上下文的双向生成流程过滤/细化对应,再配合Grounded-SAM掩码提升遮挡下推理鲁棒性。车类实验显示其显著优于零/少样本方法,将与全监督方法的差距缩小67.3%,且加入更多无标注图像后可继续有效扩展。

Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors Figure 1
arXiv preprint2025-03-25

Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors

Yuke Lou, Yiming Wang, Zhen Wu, Rui Zhao, Wenjia Wang, Mingyi Shi, Taku Komura

The University of Hong Kong, ETH Zurich, Stanford University, Tencent

6D位姿估计

针对3D人-物交互数据昂贵且类别/动作覆盖窄的问题,本文绕开受限HOI数据集的端到端训练,利用预训练多模态模型生成时序一致的2D交互先验,再通过人体姿态估计、可泛化类别级6D物体位姿估计与物理跟踪提升到3D。实验显示其可生成开放词汇、语义更丰富且物理更可信的HOI,但成功率仍受2D生成质量、物体可见性和精细手部操作限制。

Vanishing Depth: A Depth Adapter with Positional Depth Encoding for Generalized Image Encoders Figure 1
arXiv preprint2025-03-25

Vanishing Depth: A Depth Adapter with Positional Depth Encoding for Generalized Image Encoders

Paul Koch, Jörg Krüger, Oliver Heimann, Ankit Chowdhury

6D位姿估计彩色深度

面向机器人操作中依赖绝对3D几何的任务,作者指出现有通用视觉编码器多缺少公制度量深度理解。Vanishing Depth通过自监督深度补全式训练,将预训练RGB编码器扩展为RGBD编码器,并用位置深度编码、深度随机化和多尺度尺度不变损失提升对深度分布与稀疏度变化的稳定性,推理时无需微调编码器。在SUN-RGBD分割、Void深度补全、NYUv2场景分类及6D位姿估计上均优于DINOv2、EVA-02、Omnivore等非微调基线。

Visuo-Tactile Object Pose Estimation for a Multi-Finger Robot Hand with Low-Resolution In-Hand Tactile Sensing Figure 1
arXiv preprint2025-03-25

Visuo-Tactile Object Pose Estimation for a Multi-Finger Robot Hand with Low-Resolution In-Hand Tactile Sensing

Lukas Mack, Felix Grüninger, Benjamin A. Richardson, Regine Lendway, Katherine J. Kuchenbecker, Joerg Stueckler

University of Augsburg, Max Planck Institute for Intelligent Systems

6D位姿估计物体位姿手部姿态机器人操作

针对多指手抓取时手部严重遮挡导致纯视觉6D物体位姿估计失稳的问题,论文将RGB-D视觉估计、本体感知与手掌/指节内侧的低分辨率二值触觉接触融合到因子图中,并用SDF几何约束和鲁棒代价处理离群读数。仿真中在17个YCB物体上,高遮挡和视觉噪声下触觉显著提升位姿鲁棒性;真实ISyHand原型也实现约13.3Hz的合理跟踪。

Semi-SD: Semi-Supervised Metric Depth Estimation via Surrounding Cameras for Autonomous Driving Figure 1
arXiv preprint2025-03-25

Semi-SD: Semi-Supervised Metric Depth Estimation via Surrounding Cameras for Autonomous Driving

Yusen Xie, Zhengmin Huang, Shaojie Shen, Jun Ma

6D位姿估计彩色深度

面向自动驾驶环视相机的纯视觉方案,论文针对单目/多相机深度估计中的尺度歧义、时空约束利用不足和边界模糊问题,提出 Semi-SMD:用统一时空语义 Transformer 融合相邻环视帧,并将预测深度与相机外参纳入联合位姿估计,同时用深度世界模型构造曲率损失作半监督约束。在 DDAD 与 nuScenes 上取得环视相机度量深度估计 SOTA,收敛和深度质量均有提升。

DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarios Figure 1
arXiv preprint2025-03-25

DynOPETs: A Versatile Benchmark for Dynamic Object Pose Estimation and Tracking in Moving Camera Scenarios

Xiangting Meng, Jiaqi Yang, Mingshu Chen, Chenxin Yan, Yujiao Shi, Wenchao Ding, Laurent Kneip

ShanghaiTech University, Mobile Peception Lab

6D位姿估计物体位姿数据集/基准

针对现有6D位姿数据集多假设相机或物体静止、难以评估移动相机下动态物体的问题,DynOPETs提供含175个物体实例的RGB-D序列、CAD模型及相机/物体同步6DoF标注。其关键在于融合绝对位姿估计、基于点跟踪的相对估计、全局EKF平滑和位姿图优化,降低无标记动态场景标注成本;作者用18种方法系统评测,显示该基准可暴露现有方法在真实动态场景中的差距。

Pose-Based Fall Detection System: Efficient Monitoring on Standard CPUs Figure 1
arXiv preprint2025-03-25

Pose-Based Fall Detection System: Efficient Monitoring on Standard CPUs

Vinayak Mali (24AI60R13, Saurabh Jaiswal (24AI60R46

Department of Artificial Intelligence, Indian Institue of Technology Kharagpur

6D位姿估计

面向养老院跌倒监测中穿戴传感器依从性差、CNN 视频方案算力成本高的问题,论文用固定摄像头结合 MediaPipe 姿态关键点,在标准 CPU 上提取身高比、躯干-腿角度、头地距离等阈值特征,并用 20 帧缓冲与投票抑制短暂姿态变化导致的误报。在 GMDCSA-24 数据集上报告准确率 86.86%、精确率 85.23%、召回率 93.75%,但阈值选择和真实复杂场景泛化仍文中未充分说明。

From Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splatting Figure 1
arXiv preprint2025-03-25

From Sparse to Dense: Camera Relocalization with Scene-Specific Detector from Feature Gaussian Splatting

Zhiwei Huang, Hailin Yu, Yichun Shentu, Jin Yuan, SenseTime Research

State Key Lab of CAD & CG, Zhejiang University, SenseTime Research

6D位姿估计相机位姿三维重建高斯泼溅

针对传统稀疏 SfM 定位在弱纹理场景匹配不足、NeRF/GS 定位常依赖初始位姿且易受光照影响的问题,STDLoc 将特征蒸馏到 3D Gaussian 中,先用面向匹配的高斯采样与场景专属检测器建立稀疏 2D-3D 对应并 PnP 初始化,再以密集特征场对齐细化位姿。室内外实验显示其在定位精度和召回率上超过现有方法。

Analyzing the Synthetic-to-Real Domain Gap in 3D Hand Pose Estimation Figure 1
arXiv preprint2025-03-25

Analyzing the Synthetic-to-Real Domain Gap in 3D Hand Pose Estimation

Zhuoran Zhao, Linlin Yang, Pengzhan Sun, Pan Hui, Angela Yao, Technology (Guangzhou, China, Singapore zzhao074@connect.hkust-gz.edu.cn, lyang@cuc.edu.cn, panhui@ust.hk, @comp.nus.edu.sg

The Hong Kong University of Science and Technology (Guangzhou), China, Communication University of China, China, National University of Singapore, Singapore

6D位姿估计手部姿态仿真到现实

针对单目 RGB 3D 手部姿态估计中合成数据仍难替代真实标注的问题,本文构建可控高质量手部合成管线,系统拆解外观、前臂、频谱统计、姿态分布、物体遮挡与骨架拓扑对 sim-to-real 差距的影响。结果显示,加入这些关键因素后,仅用合成数据训练可接近真实数据精度,合成与真实混合训练还能提升域内和跨域泛化。

Any6D: Model-free 6D Pose Estimation of Novel Objects Figure 1
arXiv preprint2025-03-25

Any6D: Model-free 6D Pose Estimation of Novel Objects

Taeyeop Lee, Bowen Wen, Minjun Kang, Gyuree Kang, In So Kweon, Kuk-Jin Yoon KAIST NVIDIA

KAIST, NVIDIA

6D位姿估计未知物体

Any6D针对机器人在新环境中遇到无CAD模型、无多视角参考的未知物体时难以估计6D位姿的问题,仅用单张RGB-D锚点图像同时估计物体尺度与位姿。其关键在于结合图像到3D生成、2D/3D联合对象对齐和render-and-compare假设筛选,以缓解遮挡、视角不重叠和跨环境变化。实验在REAL275、Toyota-Light、HO3D、YCBINEOAT、LM-O上相对现有方法取得明显提升。

Structure-Aware Correspondence Learning for Relative Pose Estimation Figure 1
arXiv preprint2025-03-24

Structure-Aware Correspondence Learning for Relative Pose Estimation

Yihan Chen, Wenfei Yang, Huan Ren, Shifeng Zhang, zhangshifeng@sangfor.com.cn @ustc.edu.cn

University of Science and Technology of China, National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory

6D位姿估计相机位姿

该文针对相对位姿估计在大视角变化、可见重叠很小时显式特征匹配不可靠且3D密集匹配开销大的问题,提出SAC-Pose:用可学习查询和重建损失提取能表征物体结构的稀疏关键点,再通过结合相对位置的自注意力与跨图注意力建模图内/图间结构关系,直接回归3D-3D对应并用加权SVD求位姿。在CO3D、Objaverse和LineMOD上优于已有方法,CO3D平均角误差降低5.7°。

TrackID3x3: A Dataset and Algorithm for Multi-Player Tracking with Identification and Pose Estimation in 3x3 Basketball Full-court Videos Figure 1
arXiv preprint2025-03-24

TrackID3x3: A Dataset and Algorithm for Multi-Player Tracking with Identification and Pose Estimation in 3x3 Basketball Full-court Videos

Kazuhiro Yamada, Li Yin, Qingrui Hu, Ning Ding, Shunsuke Iwashita, Jun Ichikawa, Kiwamu Kotani, Calvin Yeung, Keisuke Fujii

Nagoya University, Nagoya Institute of Technology, Shizuoka University, Ryutsu Keizai University

6D位姿估计数据集/基准

针对3x3篮球缺少面向业余固定机位的公开标注数据,本文发布TrackID3x3,覆盖室内/室外固定相机与无人机全场视频,并同时标注多人跟踪、身份与姿态;还定义去除场地检测的Track-ID任务及基线。实验中Indoor/Outdoor的TI-HOTA达85.53%/71.03%,姿态PDJ均超77%,但遮挡导致ID交换仍是主要瓶颈。

Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learning Figure 1
arXiv preprint2025-03-23

Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learning

Xiang Fang, Shihua Zhang, Hao Zhang, Tao Lu, Huabing Zhou, Jiayi Ma

Wuhan University Wuhan Institute of Technology

6D位姿估计

该文针对两视图匹配中外点比例高、MLP难区分真伪匹配而注意力方法又需存储完整上下文的问题,提出 CorrMamba:用 Mamba 的选择性压缩上下文并抑制外点,同时通过基于 Gumbel-Softmax 的可微因果序列构造缓解关键点无序性,并加入局部图上下文增强。实验显示其在相对位姿估计和视觉定位上达到 SOTA,室外 AUC@20° 较前方法提升 2.58 个百分点。

Co-op: Correspondence-based Novel Object Pose Estimation Figure 1
arXiv preprint2025-03-22

Co-op: Correspondence-based Novel Object Pose Estimation

Sungphill Moon, Hyeontae Son, Dongcheol Hur, Sangwook Kim NAVER LABS @naverlabs.com

NAVER LABS

6D位姿估计物体位姿未知物体

针对新物体6D位姿估计中需重训或依赖大量模板导致低效的问题,Co-op将单张RGB图与CAD渲染模板之间的对应关系作为核心线索:粗估阶段用patch分类结合offset回归寻找半稠密匹配并PnP求解,精修阶段估计概率稠密flow并通过可微PnP学习置信度。该方法无需针对新物体微调,在BOP七个核心数据集上以更少模板取得领先精度并保持较快速度。

Image as an IMU: Estimating Camera Motion from a Single Motion-Blurred Image Figure 1
arXiv preprint2025-03-21

Image as an IMU: Estimating Camera Motion from a Single Motion-Blurred Image

Jerred Chen

University of Oxford, Department of Computer Science

6D位姿估计

高速相机运动下,运动模糊会使传统 VO/SfM 和位姿估计失效,而额外 IMU 又带来同步与漂移问题。本文的关键洞察是把模糊方向和长度视为运动线索:从单张模糊图预测稠密 motion flow 与单目深度,再在线性最小二乘中恢复曝光期间的 6DoF 瞬时速度,等价于“图像 IMU”。作者用 ScanNet++v2 合成真实感模糊数据并在真实数据上端到端微调;真实基准上角速度和线速度估计优于 MASt3R、COLMAP 等方法,并支持实时运行。

Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors Figure 1
arXiv preprint2025-03-21

Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priors

Wonbong Jang, Philippe Weinzaepfel, Vincent Leroy Lourdes Agapito, Jerome Revaud UCL, Naver Labs Europe @ucl.ac.uk, firstname.lastname@naverlabs.com

UCL Naver Labs Europe

6D位姿估计三维重建

针对 DUSt3R/MASt3R 只能吃 RGB、难以利用真实系统中相机内参、位姿或稀疏/稠密深度先验的问题,Pow3R 在同一 Transformer 点图回归框架中以轻量条件注入任意先验子集,并用随机模态子集训练以适配不同测试条件。实验显示其在无先验时接近 DUSt3R,有先验时在三维重建、深度补全、多视角深度/MVS 和位姿估计上取得一致提升,并支持高分辨率滑窗推理与点云补全。

ContactFusion: Stochastic Poisson Surface Maps from Visual and Contact Sensing Figure 1
arXiv preprint2025-03-20

ContactFusion: Stochastic Poisson Surface Maps from Visual and Contact Sensing

Aditya Kamireddypalli, João Moura, Russell Buchanan, Sethu Vijayakumar, Subramanian Ramamoorthy

Aditya Kamireddypalli 1 , João Moura 1 , Russell Buchanan 2 , Sethu Vijayakumar 1 , Subramanian Ramamoorthy, School of Informatics, University of Edinburgh, Scotland

6D位姿估计

面向紧公差装配中 RGB-D 位姿误差常超过插入容差的问题,ContactFusion 将孔位估计视为可迭代更新的体占据建图:用 SPSR 构建随机泊松表面地图,并通过基于拒绝采样与摩擦锥筛选的接触占据传感器,把腕部力/力矩推断出的局部接触信息融合进点云地图。仿真验证其能定位接触点,peg-in-hole 实验显示融合接触后孔位姿估计得到改善;真实 KUKA 上仅做定性验证,实际装配成功率增益文中未充分说明。

Probabilistic Prompt Distribution Learning for Animal Pose Estimation Figure 1
arXiv preprint2025-03-20

Probabilistic Prompt Distribution Learning for Animal Pose Estimation

Jiyong Rao, Brian Nlong Zhao, Yu Wang School of Computer Science, Technology, briannlz@stanford.edu, yuwangtj@yeah.net

School of Computer Science and Technology, Tongji University Stanford University

6D位姿估计

面向多物种动物姿态估计中外观差异大、长尾类别和跨物种泛化弱的问题,论文将CLIP等视觉语言模型的提示从单一确定模板扩展为可学习的概率提示分布,并用多提示属性、分布采样、多样性损失及空间级跨模态融合来刻画关键点的颜色、位置、形状等不确定描述。实验称在AP-10K、AnimalKingdom等基准的监督与零样本设置下达到SOTA,显示文本提示的概率化建模有助于未见物种泛化。

PoseTraj: Pose-Aware Trajectory Control in Video Diffusion Figure 1
arXiv preprint2025-03-20

PoseTraj: Pose-Aware Trajectory Control in Video Diffusion

Longbin Ji, Lei Zhong, Pengfei Wei

University of Edinburgh Nanyang Technological University

6D位姿估计

PoseTraj针对现有轨迹引导视频生成只在2D平移上可靠、遇到隐含大角度旋转时缺乏6D位姿理解的问题,提出以3D包围盒作中间监督的两阶段位姿感知预训练,并构建含旋转轨迹的PoseTraj-10K合成数据,再通过相机解耦在真实视频上微调。实验显示其在VIPSeg等基准上较DragNUWA、DragAnything提升轨迹跟随精度和视频真实感,尤其适合带旋转的物体拖拽。

Automating 3D Dataset Generation with Neural Radiance Fields Figure 1
arXiv preprint2025-03-20

Automating 3D Dataset Generation with Neural Radiance Fields

Paul Schulz, Thorsten Hempel, Ayoub Al-Hamadi

6D位姿估计数据集/基准

针对6D位姿估计依赖大量精标3D数据、而目标物3D模型获取昂贵的问题,论文把Radiance Fields重建目标物网格/纹理并接入合成数据生成器,形成从2D图像到带标注数据集的自动流程。作者在6个复杂度不同物体上训练位姿网络,并在手持与桌面场景测试,显示合成数据可取得较强实用性能,但具体相对增益来源仍不完全清晰。

Learning to Efficiently Adapt Foundation Models for Self-Supervised Endoscopic 3D Scene Reconstruction from Any Cameras Figure 1
arXiv preprint2025-03-20

Learning to Efficiently Adapt Foundation Models for Self-Supervised Endoscopic 3D Scene Reconstruction from Any Cameras

Beilei Cui 1 Co-first authors, Long Bai 2 Co-first authors, Mobarakol Islam 3 Co-first authors, An Wang, Zhiqi Ma, Yiming Huang, Feng Li, Zhen Chen, Zhongliang Jiang, Nassir Navab, Hongliang Ren

6D位姿估计三维重建

针对内窥镜三维重建缺少深度真值、相机内参常未知且基础模型存在医疗域差距的问题,论文提出 Endo3DAC:冻结深度基础模型,仅训练 GDV-LoRA 与轻量解码头,在单一网络中自监督估计深度、相对位姿和内参,并通过尺度/偏移优化完成重建。四个内窥镜数据集实验显示其深度与位姿优于现有方法,同时可训练参数更少。

EdgeRegNet: Edge Feature-based Multimodal Registration Network between Images and LiDAR Point Clouds Figure 1
arXiv preprint2025-03-19

EdgeRegNet: Edge Feature-based Multimodal Registration Network between Images and LiDAR Point Clouds

Yuanchao Yue, Hui Yuan, Senior Member, IEEE, Qinglong Miao, Xiaolong Mao, Raouf Hamzaoui, Peter Eisert

6D位姿估计点云

针对图像—LiDAR点云跨模态配准中下采样损失精度、异构特征难匹配的问题,EdgeRegNet转而从原始图像和点云提取边缘像素/边缘点,在保留关键信息的同时降低匹配规模,并通过注意力特征交换与最优匹配层缓解模态差异、建立2D-3D对应。论文在KITTI和nuScenes上验证了优于现有方法的配准精度。

GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation Figure 1
arXiv preprint2025-03-20

GIVEPose: Gradual Intra-class Variation Elimination for RGB-based Category-Level Object Pose Estimation

Ziqin Huang, Gu Wang, Chenyangguang Zhang, Ruida Zhang, Xiu Li, tsinghua.edu.cn

Tsinghua University, Pengcheng Laboratory

6D位姿估计物体位姿类别级位姿

该文面向仅用 RGB 的类别级 6D 位姿估计,针对现有几何引导回归依赖 NOCS 图时会混入类内实例形状差异、削弱类别级位姿预测的问题,提出由类别共识模型生成的 IVFC 坐标图,并用 DCAE 从 NOCS 逐步消除实例特有信息。GIVEPose 在 NOCS 与 Wild6D 等合成和真实数据上超过已有 RGB 方法。

Distilling 3D distinctive local descriptors for 6D pose estimation Figure 1
arXiv preprint2025-03-20

Distilling 3D distinctive local descriptors for 6D pose estimation

Amir Hamza, Andrea Caraffa, Davide Boscaini, Fabio Poiesi Fondazione Bruno Kessler

University of Trento

6D位姿估计

该文针对 GeDi 局部 3D 描述子在零样本 6D 位姿估计中效果好但推理过慢的问题,提出 dGeDi:用 PTV3 学生网络蒸馏 GeDi,并通过“模型特征离线预算、场景可见点在线对应迁移”降低训练存储与计算,同时用按配准误差加权的损失抑制非显著教师描述子的噪声监督。在 5 个 BOP 数据集上,其推理约加速 170 倍,集成 FreeZe 后仍保持有竞争力的精度。

Validation of Human Pose Estimation and Human Mesh Recovery for Extracting Clinically Relevant Motion Data from Videos Figure 1
arXiv preprint2025-03-18

Validation of Human Pose Estimation and Human Mesh Recovery for Extracting Clinically Relevant Motion Data from Videos

Sport Science

School of Computer Science, University of Lincoln, School of Psychology, Sport Science, and Wellbeing

6D位姿估计人体姿态

面向临床小空间、低速动作评估中传统光学 MoCap 昂贵笨重、IMU 仍需佩戴的问题,本文用10名受试者的下蹲、弓步、坐站等任务,对视频式人体姿态/网格恢复与IMU、12相机MoCap进行对照验证。核心洞察是无标记方法虽受遮挡、服装和光照影响,但在临床相关运动学指标上与两类基准总体一致,换来更短部署时间和更低操作门槛。

SIR-DIFF: Sparse Image Sets Restoration with Multi-View Diffusion Model Figure 1
arXiv preprint2025-03-18

SIR-DIFF: Sparse Image Sets Restoration with Multi-View Diffusion Model

Yucheng Mao, Boyang Wang, Nilesh Kulkarni, Ann Arbor

University of Michigan, Ann Arbor

6D位姿估计多视角

SIR-Diff关注机器人与3D视觉中常见的稀疏多视角退化输入:单图复原会破坏跨视角几何一致性,进而影响重建或位姿等下游任务。论文将复原建模为联合多视角扩散生成,引入统一退化编码器、2D/3D混合卷积和跨视角3D自注意力来融合互补信息。在Scannet++、ETH3D、CO3D上,其去模糊和超分辨率零样本结果优于单图及视频方法,并提升视角一致性、特征匹配和3D重建质量。

SCJD: Sparse Correlation and Joint Distillation for Efficient 3D Human Pose Estimation Figure 1
arXiv preprint2025-03-18

SCJD: Sparse Correlation and Joint Distillation for Efficient 3D Human Pose Estimation

Weihong Chen, Xuemiao Xu, Haoxin Yang, Yi Xie, Peng Xiao, Cheng Xu, Huaidong Zhang

South China University of Technology, The Hong Kong Polytechnic University, The Chinese University of Hong Kong

6D位姿估计人体姿态

针对多帧3D人体姿态估计依赖密集序列和大模型导致推理慢、现有蒸馏又忽略关节空间关系与时序相关的问题,SCJD让学生网络使用稀疏相关帧以减少冗余,并通过动态关节嵌入、邻接关节注意力和时序一致性蒸馏向轻量模型传递教师的空间与时间知识。实验显示其在保持相近精度下最高获得6.15倍加速,体现了较好的速度—精度折中。

Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approach Figure 1
arXiv preprint2025-03-18

Foundation Feature-Driven Online End-Effector Pose Estimation: A Marker-Free and Learning-Free Approach

Tianshu Wu, Jiyao Zhang, Shiqian Liang, Zhengxiao Han, Hao Dong 🖂 🖂 ^{ } start_FLOATSUPERSCRIPT 🖂 end_FLOATSUPERSCRIPT

Peking University

6D位姿估计

针对传统手眼标定依赖标记与离线采集、学习式机器人位姿方法泛化差且需整臂可见的问题,FEEPE利用CAD渲染图与目标图的DINOv2基础特征建立2D-3D对应,经PnP估计末端6D位姿,并用多历史关键帧、时间信息和机器人先验缓解局部观测与对称歧义。实验表明其可在无训练、无标记条件下跨机器人/末端泛化,精度达到约1mm。

Learning Shape-Independent Transformation via Spherical Representations for Category-Level Object Pose Estimation Figure 1
arXiv preprint2025-03-19

Learning Shape-Independent Transformation via Spherical Representations for Category-Level Object Pose Estimation

Huan Ren, Wenfei Yang, Xiang Liu, Shifeng Zhang, Sangfor Technologies rh_hr_666@mail.ustc.edu.cn, @ustc.edu.cn

University of Science and Technology of China, National Key Laboratory of Deep Space Exploration, Deep Space Exploration Laboratory, Jianghuai Advance Technology Center, Dongguan University of Technology

6D位姿估计物体位姿类别级位姿

本文针对类别级6D位姿中NOCS点对应受物体形状差异影响、跨实例语义不一致的问题,提出SpherePose:用HEALPix均匀球面作为共享代理形状,将观测点特征投影到球面锚点,学习形状无关的球面对应;并结合SO(3)不变特征、球面注意力与双曲对应损失提升旋转估计精度。在CAMERA25、REAL275和HouseCat6D上取得优于既有方法的结果,表明增益主要来自球面表示与对应学习设计。

STEP: Simultaneous Tracking and Estimation of Pose for Animals and Humans Figure 1
arXiv preprint2025-03-20

STEP: Simultaneous Tracking and Estimation of Pose for Animals and Humans

Harish Katti, Soumyaratna Debnath, Yamuna Swami, Shanmuganathan Raman

6D位姿估计

STEP针对视频姿态估计依赖逐帧检测框、难以同时保持目标身份的问题,将Transformer判别式模型预测用于联合定位、跟踪与关键点估计;GMSP与OMRA使模型无需预设关键点目标状态,并通过置信度记忆更新利用时序连续性。实验覆盖多种动物与人类数据集,显示在仅首帧给框时仍具竞争力,在使用逐帧真值框的top-down设置下超过多种现有方法。

UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimation Figure 1
arXiv preprint2025-03-17

UniHOPE: A Unified Approach for Hand-Only and Hand-Object Pose Estimation

Yinqiao Wang, Hao Xu, Pheng-Ann Heng, Chi-Wing Fu

Department of Computer Science and Engineering, Institute of Medical Intelligence and XR, The Chinese University of Hong Kong

6D位姿估计物体位姿手部姿态

UniHOPE针对现有手部姿态估计与手-物体姿态估计方法彼此割裂、跨场景性能下降的问题,提出统一的单目框架:用物体开关按抓取状态决定是否估计物体位姿,并以抓取感知特征融合抑制无物体时的干扰;同时通过扩散生成去遮挡手图像和多层特征增强学习遮挡不变表示。论文在三个常用基准上报告了手-only与手-物体场景的SOTA结果。

Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation Figure 1
arXiv preprint2025-03-17

Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation

Nassim Ali Ousalah, Anis Kacem, Enjie Ghorbel, Emmanuel Koumandakis, Djamila Aouada

SnT, University of Luxembourg, Luxembourg, Cristal Lab, ENSI, University of Manouba

6D位姿估计

面向机器人、AR和航天等场景中6DoF位姿估计模型过大、难以实时部署的问题,本文指出教师模型的关键点预测并非同等可靠,提出不确定性感知蒸馏:在预测层用教师集成估计关键点不确定性并通过非平衡Sinkhorn降低高不确定点权重,同时将该对齐关系用于特征层关键区域蒸馏。LINEMOD与SPEED+实验显示,轻量学生模型优于已有蒸馏式高效位姿估计方法。

PoseSyn: Synthesizing Diverse 3D Pose Data from In-the-Wild 2D Data Figure 1
arXiv preprint2025-03-17

PoseSyn: Synthesizing Diverse 3D Pose Data from In-the-Wild 2D Data

CTO Division, LG Electronics @lge.com

AI Lab, CTO Division, LG Electronics

6D位姿估计

针对真实场景中3D人体位姿估计缺少昂贵3D标注、室内数据域偏导致泛化差的问题,PoseSyn从野外2D姿态数据出发,先用EEM找出目标估计器易错样本,再用结合文本与粗3D姿态的MSM生成邻近运动序列,并通过人体动画模型合成带外观与背景的3D训练对。实验显示其在多数据集、多架构上稳定提升,最高精度增益约14%。

Gun Detection Using Combined Human Pose and Weapon Appearance Figure 1
arXiv preprint2025-03-15

Gun Detection Using Combined Human Pose and Weapon Appearance

Amulya Reddy Maligireddy, Manohar Reddy Uppula, Nidhi Rastogi, Yaswanth Reddy Parla

Rochester Institute of technology

6D位姿估计人体姿态

面向公共场所监控中人工查验成本高、单纯枪械外观检测易误报漏报的问题,论文将人体姿态线索与武器外观识别联合建模,并构建约9500张来自IMFDB、Monash、网页采集及生成图像的数据集以增强场景多样性。其核心洞察是持枪风险需结合人与枪的空间/动作上下文判断;但摘录中定量实验结果未充分说明,实际增益来源可能主要来自数据扩充与模型融合。

TACO: Taming Diffusion for in-the-wild Video Amodal Completion Figure 1
arXiv preprint2025-03-15

TACO: Taming Diffusion for in-the-wild Video Amodal Completion

Ruijie Lu, Yixin Chen, Yu Liu, Jiaxiang Tang, Junfeng Ni, Diwen Wan, Gang Zeng

State Key Laboratory of General Artificial Intelligence, Peking University, State Key Laboratory of General Artificial Intelligence, BIGAI, Tsinghua University

6D位姿估计

针对野外视频中物体被遮挡时难以跨帧一致补全、进而影响重建和6D位姿估计的问题,TACO将预训练视频扩散模型改造成条件式视频无模态补全器,并用真实视频叠加一致遮挡构造约20万对多难度数据,配合渐进微调提升泛化。实验显示其在VAC上优于既有方法,零样本VAS接近SOTA,并可作为下游重建与6D位姿估计的增强模块。

Bring Your Rear Cameras for Egocentric 3D Human Pose Estimation Figure 1
arXiv preprint2025-03-14

Bring Your Rear Cameras for Egocentric 3D Human Pose Estimation

Hiroyasu Akada, Jian Wang, Vladislav Golyanik, Christian Theobalt, SIC

Max Planck Institute for Informatics, SIC

6D位姿估计人体姿态

针对头显前置相机在全身自我中心姿态估计中易受自遮挡、视野不足影响的问题,论文首次系统评估加入后置相机的价值,并指出简单拼接前后视角会因2D关节检测不可靠而受限。其提出基于Transformer的多视角热图细化模块,利用热图不确定性融合前后互补信息;在新建Ego4View-Syn/RW数据集上,相比现有方法MPJPE提升超过10%。

Online Test-time Adaptation for 3D Human Pose Estimation: A Practical Perspective with Estimated 2D Poses Figure 1
arXiv preprint2025-03-14

Online Test-time Adaptation for 3D Human Pose Estimation: A Practical Perspective with Estimated 2D Poses

Communication, CUC School of Information, Communication Engineering, CUC @comp.nus.edu.sg

Department of Computer Science, National University of Singapore, State Key Laboratory of Media Convergence and Communication, CUC, School of Information and Communication Engineering, CUC

6D位姿估计人体姿态

该文针对3D人体姿态在线测试时自适应中“实际只能获得有噪声2D估计”的落差,指出直接沿用逐帧适应会传播错误。方法用2D置信度区分样本,结合跨视频自适应聚合、单样本两阶段优化和邻近高置信样本局部增强,在抑制噪声更新的同时保留2D监督信息;在两个大规模基准上较现有方法最高降低18.0% MPJPE。

Fast and Robust Localization for Humanoid Soccer Robot via Iterative Landmark Matching Figure 1
arXiv preprint2025-03-14

Fast and Robust Localization for Humanoid Soccer Robot via Iterative Landmark Matching

Ruochen Hou, Mingzhang Zhu, Hyunwoo Nam, Gabriel I. Fernandez, Dennis W. Hong

6D位姿估计机器人操作

面向RoboCup人形足球机器人在视野受限、步态振动和算力有限下的实时定位需求,论文用YOLOv8检测场地角点、T形点、十字和球门柱,并提出迭代地标匹配:以历史位姿为初值做一对一关联、位姿估计与离群剔除,再可融合IMU,避免MCL逐粒子匹配开销。实验显示ILM比ICP更不易受初值误差影响,比200粒子aMCL更快且更准,在ARTEMIS上约1 kHz运行,位置RMSE 0.2 m、朝向RMSE 3.5°。

Clothes-Changing Person Re-identification Based On Skeleton Dynamics Figure 1
arXiv preprint2025-03-13

Clothes-Changing Person Re-identification Based On Skeleton Dynamics

Asaf Joseph Shmuel Peleg

The Hebrew University of Jerusalem

6D位姿估计

针对换装行人重识别中外观特征易失效且可能泄露隐私的问题,本文转向仅利用人体骨架的形状与运动信息:先用姿态估计提取关节/骨骼序列,再以时空GCN学习身份描述子,并在测试阶段通过多片段聚合、Re-Ranking和投票提升匹配稳定性。在CCVID上结合不同姿态估计器取得SOTA,说明骨架动态可在不依赖服装外观的条件下提供有效身份线索。

Consistent multi-animal pose estimation in cattle using dynamic Kalman filter based tracking Figure 1
Smart Agricultural Technology2025-03-13

Consistent multi-animal pose estimation in cattle using dynamic Kalman filter based tracking

Maarten Perneel, Ines Adriaens, Ben Aernouts, Jan Verwaeren

Ghent University

6D位姿估计

针对牛群行为监测中人工观察成本高、既有视觉模型多为单一任务且难以复用的问题,论文将自底向上的多动物关键点姿态估计与无边界框的 KeySORT 跟踪结合,用自适应 Kalman 滤波直接跟踪不完整骨架以提升时序一致性并降低计算负担。实验显示模型可高精度检测最高约 80% 的真值关键点,昼夜视频性能下降有限,构建骨架后关键点坐标稳定性明显改善。

6D Object Pose Tracking in Internet Videos for Robotic Manipulation Figure 1
arXiv preprint2025-03-13

6D Object Pose Tracking in Internet Videos for Robotic Manipulation

Georgy Ponimatkin, Martin Cífka, Tomáš Souček, Médéric Fourmy Yann Labbé, Vladimír Petrík, Robotics, Cybernetics

Yann Labbé, Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, Faculty of Electrical Engineering, Czech Technical University in Prague

6D位姿估计物体位姿机器人操作

这篇论文面向从公开视频中学习机器人操作,解决真实教学视频里无精确物体网格、拍摄条件不可控且动作细微连续的问题。方法以相似 CAD 检索、6D 对齐和单目深度/LLM 尺度校准获得开放物体位姿,再结合视频点跟踪平滑轨迹并通过轨迹优化重定向到机械臂。实验在 YCB-V、HOPE-Video 和自建教学视频标注集上优于现有 RGB 6D 位姿方法,并展示了估计运动可迁移到仿真和真实 7 轴机械臂。

VicaSplat: A Single Run is All You Need for 3D Gaussian Splatting and Camera Estimation from Unposed Video Frames Figure 1
arXiv preprint2025-03-13

VicaSplat: A Single Run is All You Need for 3D Gaussian Splatting and Camera Estimation from Unposed Video Frames

Zhiqi Li, Chengrui Dong, Yiming Chen, Zhangchi Huang

Zhejiang University, Westlake University

6D位姿估计三维重建高斯泼溅

VicaSplat针对无位姿视频帧中快速三维重建与新视角合成仍依赖SfM或逐场景优化的问题,提出一次前向即可同时估计相机位姿和3D Gaussian的框架。其关键是在Transformer中加入可学习相机token,跨视角聚合并调制视觉特征,再分别预测位姿与高斯参数。实验显示其在多视图输入上优于既有基线,在ScanNet上无需微调也具备较强跨数据集泛化。

Physics-Aware Human-Object Rendering from Sparse Views via 3D Gaussian Splatting Figure 1
arXiv preprint2025-03-12

Physics-Aware Human-Object Rendering from Sparse Views via 3D Gaussian Splatting

Weiquan Wang, Jun Xiao, Yi Yang, Yueting Zhuang, Long Chen

Computer Science, Zhejiang University, Hangzhou 310027, China (e-mail, The Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong (e-mail

6D位姿估计三维重建高斯泼溅

面向稀疏视角下人-物交互渲染中易出现遮挡歧义、穿模或悬空接触的问题,HOGS 将人体与物体表示为动态 3D Gaussian,并在统一渲染中结合分实体优化、姿态细化与接触预测,用接触/分离损失直接约束几何一致性。实验显示其在人-物和手-物数据集上取得领先渲染质量,作者报告相对 3DGS 方法 PSNR 提升 3.4 dB 且保持实时效率。

GenHPE: Generative Counterfactuals for 3D Human Pose Estimation with Radio Frequency Signals Figure 1
arXiv preprint2025-03-12

GenHPE: Generative Counterfactuals for 3D Human Pose Estimation with Radio Frequency Signals

Shuokang Huang, Julie A. McCann

Imperial College London

6D位姿估计人体姿态

针对RF人体姿态估计在跨被试、跨环境时易受人体差异与环境噪声等域特定混杂影响而泛化下降的问题,GenHPE用骨架条件生成模型合成“移除”身体部位的反事实RF信号,并通过信号差分近似消除混杂,约束编码器学习域无关表示。在WiFi、UWB和毫米波三类公开数据上,其跨域3D姿态误差优于现有方法,跨被试最多降低52.2mm,跨环境降低10.6mm。

MonoSLAM: Robust Monocular SLAM with Global Structure Optimization Figure 1
arXiv preprint2025-03-12

MonoSLAM: Robust Monocular SLAM with Global Structure Optimization

Bingzheng Jiang, Jiayuan Wang, Han Ding, Lijun Zhu

School of International Education, Wuhan University of Technology, Wuhan, China

6D位姿估计相机位姿

针对单目 SLAM 在低纹理场景中点特征不足、共视约束有限而导致跟踪漂移的问题,MonoSLAM 将点、线与由线构造的消失点联合建模,通过加权融合在世界坐标系中形成全局结构基元,并用其关联无重叠视野的多帧图像,构建多帧重投影因子图优化相机位姿与结构。多数据集实验显示其轨迹精度优于现有方法,优势主要体现在纹理稀缺和结构复杂场景。

Better Together: Unified Motion Capture and 3D Avatar Reconstruction Figure 1
arXiv preprint2025-03-12

Better Together: Unified Motion Capture and 3D Avatar Reconstruction

Arthur Moreau, Mohammed Brahimi, Richard Shaw, Athanasios Papaioannou Thomas Tanay, Zhensong Zhang

Huawei Noah’s Ark Lab TU Munich

6D位姿估计人体姿态三维重建

该文针对传统流程将人体姿态估计与可驱动头像重建分开处理、关键点监督不够精确且会拖累渲染质量的问题,提出用多视角视频中可渲染人体模型的像素级光度对齐来联合优化两者。方法将3D Gaussian绑定到个性化网格,并用时间相关MLP拟合平滑姿态序列。实验显示,在高难瑜伽动作上相较关键点方法身体/手部关节误差分别降低35%/45%,新视角合成PSNR约提升2dB。

Acoustic Neural 3D Reconstruction Under Pose Drift Figure 1
arXiv preprint2025-03-11

Acoustic Neural 3D Reconstruction Under Pose Drift

Tianxiang Lin, Mohamad Qadri, Kevin Zhang, Adithya Pediredla, Christopher A. Metzler, Michael Kaess

Carnegie Mellon University, University of Maryland, College Park, Dartmouth College

6D位姿估计三维重建

该文针对前视声呐三维重建对位姿精度高度敏感的问题:水下里程计漂移会使神经声学重建产生明显伪影。核心做法是在 NeuSIS 式可微声学渲染中把每帧 6DoF 声呐位姿也设为可学习变量,仅由重建损失反传联合优化隐式 SDF 场与位姿,并分析收敛特性。真实与仿真、多几何目标实验表明,即使存在较大位姿漂移,仍能恢复较高保真的三维表面。

Keypoint Semantic Integration for Improved Feature Matching in Outdoor Agricultural Environments Figure 1
IEEE Robotics and Automation Letters2025-03-11

Keypoint Semantic Integration for Improved Feature Matching in Outdoor Agricultural Environments

Rajitha de Silva, Jacob Swindell, Jonathan A. Cox, Marija Popović, César Cadena, Cyrill Stachniss, Riccardo Polvara

Lincoln University - Pennsylvania, University of Lincoln, Delft University of Technology, ETH Zurich, University of Bonn

6D位姿估计

针对葡萄园中树干、立柱等重复结构导致局部特征描述子混淆、进而影响相对位姿估计和视觉定位的问题,论文提出 KSI:将关键点所在的语义实例掩码经自编码器压缩为语义嵌入,并只增强语义区域内的原始描述子,兼容 SIFT、ORB、SuperPoint、R2D2 等方法。作者还构建 SemanticBLT 数据集;在跨月份葡萄园实验中,该方法在多种关键点和描述子组合上平均提升匹配准确率 12.6%。

Keypoint Detection and Description for Raw Bayer Images Figure 1
arXiv preprint2025-03-11

Keypoint Detection and Description for Raw Bayer Images

Jiakai Lin, Jinchang Zhang, Guoyu Lu

Binghamton University

6D位姿估计

面向SLAM、定位和6D位姿等机器人前端在算力与内存受限平台上的需求,本文绕开ISP与RGB重建,直接在Raw Bayer图像上做关键点检测和描述子学习。核心在于设计适配Bayer排列的专用卷积核,保留跨颜色采样位置的相关性,而非简单拆成四通道。实验显示其在Raw输入上优于现有方法,并在大旋转、尺度变化下更稳定。

SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Driving Figure 1
arXiv preprint2025-03-11

SGNetPose+: Stepwise Goal-Driven Networks with Pose Information for Trajectory Prediction in Autonomous Driving

Akshat Ghiya, Ali K. AlShami, Jugal Kalita

University of Colorado Colorado Springs

6D位姿估计

面向自动驾驶中行人轨迹难以仅由检测框刻画的问题,SGNetPose+在SGNet的逐步目标预测框架中加入由ViTPose提取的骨架关节与身体角度,并用双编码器融合姿态和边界框时序信息,同时通过水平翻转扩充数据。在JAAD_pose与PIE_pose上,结合姿态的版本优于原SGNet并报告达到SOTA;但具体增益中姿态特征与数据增强各自贡献仍需结合消融判断。

Better Pose Initialization for Fast and Robust 2D/3D Pelvis Registration Figure 1
arXiv preprint2025-03-10

Better Pose Initialization for Fast and Robust 2D/3D Pelvis Registration

Yehyun Suh, J. Ryan Martin

6D位姿估计

针对单视角骨盆2D/3D配准对初始位姿高度敏感、易陷入局部最优且迭代耗时的问题,论文用一个ResNet回归器先给出“足够接近”的6D位姿初始化,再交给现有优化式DRR配准细化。实验在模拟X光/CT数据上显示,该初始化可提升多种优化器的旋转和平移精度,并减少收敛迭代;但验证仅含25例CT,真实临床泛化仍文中未充分说明。

HumanMM: Global Human Motion Recovery from Multi-shot Videos Figure 1
arXiv preprint2025-03-10

HumanMM: Global Human Motion Recovery from Multi-shot Videos

Yuhong Zhang

Tsinghua University IDEA Research Johns Hopkins University University of Chicago HKUST HKU

6D位姿估计

该文针对野外长视频常含多镜头切换、直接切段会破坏长时人体运动连续性的问题,提出 HumanMM 在世界坐标系恢复全局人体运动。核心做法是结合镜头切换检测、遮挡人体的增强 VO/SLAM 相机估计、跨镜头朝向与姿态对齐,以及运动整合器抑制脚滑。在新建 ms-Motion 多镜头基准和相关实验中,方法相较既有单镜头或相机空间对齐方案取得更稳定、精度更高的全局运动恢复结果。

AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movements Figure 1
arXiv preprint2025-03-11

AthletePose3D: A Benchmark Dataset for 3D Human Pose Estimation and Kinematic Validation in Athletic Movements

Nagoya, Japan Center for Advanced Intelligence Project, RIKEN, Osaka, Japan @g.sp.m.is.nagoya-u.ac.jp

Graduate School of Informatics, Nagoya University, Nagoya, Japan

6D位姿估计人体姿态数据集/基准

现有3D人体姿态数据多偏日常或受控动作,难以覆盖竞技体育中的高速、高加速度姿态。AthletePose3D构建含12类运动、约130万帧和16.5万姿态的大规模基准,并系统评测单目2D/3D姿态模型及运动学波形一致性。结果显示常规数据训练模型在运动场景误差较高,微调后SOTA MPJPE由234mm降至98mm,但速度估计仍存在局限。

Multi-Robot System for Cooperative Exploration in Unknown Environments: A Survey Figure 1
arXiv preprint2025-03-10

Multi-Robot System for Cooperative Exploration in Unknown Environments: A Survey

Chuqi Wang 1* 1* ^{ } start_FLOATSUPERSCRIPT 1* end_FLOATSUPERSCRIPT, Chao Yu 1* 1* ^{ } start_FLOATSUPERSCRIPT 1* end_FLOATSUPERSCRIPT, Xin Xu, Yinuo Chen 1 1 ^{ } start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Yuman Gao 2 2 ^{ } start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Xinyi Yang 1 1 ^{ } start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Wenhao Tang 3 3 ^{ } start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Feng Gao 1 1 ^{ } start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Zhuozhu Jian 3 3 ^{ } start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Xinlei Chen 3 3 ^{ } start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Fei Gao 2 2 ^{ } start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Boyu Zhou 5 5 ^{ } start_FLOATSUPERSCRIPT 5 end_FLOATSUPERSCRIPT, Yu Wang 1 1 ^{ } start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Fellow, IEEE

Tsinghua University, Beijing, 100084, China, Zhejiang University, Zhejiang, 310009, China, Tsinghua Shenzhen International Graduate School, Shanghai Artificial Intelligence Laboratory, Shanghai, 200030, China, Southern University of Science and Technology

6D位姿估计机器人操作综述

面向GNSS受限、尺度大、地形复杂且通信间歇的野外未知环境探索,本文综述多机器人协同探索系统,并将问题归纳为定位建图、协同规划与通信三大模块;核心洞察是把全局/相对位姿估计、地图融合、目标生成、任务分配和受限通信统一到系统框架中讨论。主要结果是给出技术谱系、DARPA SubT等实用案例及未解挑战,而非提出新的算法或量化性能增益。

Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motion Figure 1
Lecture notes in computer science2025-03-12

Endo-FASt3r: Endoscopic Foundation model Adaptation for Structure from motion

Mona Sheikh Zeinoddin, Mobarak I. Hoque, Zafer Tandogdu, Greg L. Shaw, Matthew J. Clarkson, Evangelos B. Mazomenos, Danail Stoyanov

6D位姿估计

面向机器人辅助手术中内窥镜场景光照变化、弱纹理和遮挡导致的单目深度与相机位姿估计困难,Endo-FASt3r首次在自监督框架中同时将基础模型用于深度和位姿;其将Reloc3r改为可收敛的Reloc3rX,并提出结合低秩/全秩更新的DoMoRA以适应大域偏移。在SCARED、Hamlyn和StereoMIS上,位姿ATE较已有方法提升约7%–10%,深度AbsRel提升约2%。

Multi-Modal 3D Mesh Reconstruction from Images and Text Figure 1
arXiv preprint2025-03-10

Multi-Modal 3D Mesh Reconstruction from Images and Text

Melvin Reka, Tessa Pulli, Markus Vincze

the Automation and Control Institute, TU Wien

6D位姿估计三维重建

针对未知物体6D位姿估计常依赖训练模型或预先CAD模型的问题,本文把语言提示引入少样本三维重建:用GroundingDINO+SAM按文本分割目标,经VGGSfM估计稀疏点云,再由SuGAR生成并清理网格。实验评估了几何、纹理质量,并分析视角、图像数量与重叠度对效率和质量的影响;但文中未充分说明相对现有方法的定量增益。

PoseLess: Depth-Free Vision-to-Joint Control via Direct Image Mapping with VLM Figure 1
arXiv preprint2025-03-11

PoseLess: Depth-Free Vision-to-Joint Control via Direct Image Mapping with VLM

Alan Dao (Gia Tuan Dao, Dinh Bach Vu, Tuan Le Duc Anh, bach@menlo.ai, charles@menlo.ai, yuuki@menlo.ai Equal contribution

Menlo Research

6D位姿估计彩色深度

针对传统机械手视觉控制依赖6D/3D位姿、深度与标注数据而易产生级联误差的问题,PoseLess尝试用VLM图像投影和Transformer解码器将单目2D图像直接映射到关节角,并用随机关节与域随机化生成纯合成训练数据。实验显示其在无需人工标注和深度输入下可获得有竞争力的关节角预测,并具备零样本现实迁移及机器人到人手的跨形态泛化,但具体增益来源与量化优势文中未充分说明。

AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation Figure 1
arXiv preprint2025-03-09

AxisPose: Model-Free Matching-Free Single-Shot 6D Object Pose Estimation via Axis Generation

Yang Zou : 1, Zhaoshuai Qi : 1 : 2, Yating Liu, Zihao Xu, Weipeng Sun, Weiyi Liu, Xingyuan Li, Jiaqi Yang

Northwestern Polytechnical University, Dalian University of Technology

6D位姿估计物体位姿

AxisPose针对现有6D位姿方法依赖CAD/深度/参考图和2D-3D匹配流程复杂、弱纹理或遮挡下不稳的问题,提出从单张RGB直接生成物体2D三轴潜在表示:用扩散模型学习轴分布,并以几何一致性损失引导去噪,再通过三轴反投影恢复6D位姿。论文报告其在跨实例设置下无需参考图即可取得稳健表现,并具备向未见物体泛化的潜力。

NeuraLoc: Visual Localization in Neural Implicit Map with Dual Complementary Features Figure 1
arXiv preprint2025-03-08

NeuraLoc: Visual Localization in Neural Implicit Map with Dual Complementary Features

Hongjia Zhai, Boming Zhao, Hai Li, Xiaokun Pan, Yijia He, Zhaopeng Cui, Hujun Bao, Guofeng Zhang

State Key Lab of CAD&CG, Zhejiang University

6D位姿估计相机位姿

NeuraLoc针对NeRF定位方法缺少几何约束或需显式存储大量点特征的问题,将3D关键点描述子与语义上下文特征隐式编码进神经地图,并用相似度分布对齐缩小2D/3D特征域差,再以双特征匹配图建立2D-3D对应求6D相机位姿。实验显示其相对近期NeRF定位方法训练约快3倍、模型存储减少约45倍,精度达到或优于同类方法。

Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Vision Figure 1
arXiv preprint2025-03-08

Fish2Mesh Transformer: 3D Human Mesh Recovery from Egocentric Vision

David C. Jeong, Aditya Puranik, James Vong, Vrushabh Abhijit Deogirikar Ryan Fell, Julianna Dietrich, Maria Kyrarini, CA [dcjeong, aspuranik, jvong, vdeogirikar, rfell, jdietrich, mkyrarini, ckitts] @scu.edu

Santa Clara University

6D位姿估计

该文针对头戴鱼眼相机下自我人体网格恢复的数据稀缺、畸变和自遮挡问题,提出 Fish2Mesh:在 Swin Transformer 中加入基于等距柱状几何的自我位置嵌入,并用多任务头联合回归 SMPL、相机平移及 2D/3D 关节约束;同时借助 4D-Human 和第三人称相机弱监督扩充训练数据。实验显示其优于既有 3D HMR 方法,但具体增益中模型设计与数据扩充的占比仍需进一步拆解。

ReJSHand: Efficient Real-Time Hand Pose Estimation and Mesh Reconstruction Using Refined Joint and Skeleton Features Figure 1
arXiv preprint2025-03-08

ReJSHand: Efficient Real-Time Hand Pose Estimation and Mesh Reconstruction Using Refined Joint and Skeleton Features

Shan An, Senior Member, IEEE, Shipeng Dai, Mahrukh Ansari, Yu Liang, Ming Zeng, Konstantinos A. Tsintotas, Changhong Fu, Hong Zhang, Fellow

University of Thrace, Xanthi 67132, Greece

6D位姿估计手部姿态三维重建

面向灵巧操作中低成本、实时采集人手示教数据的需求,ReJSHand从单目RGB图像估计3D手姿态并重建网格。其核心是用2D/3D关键点生成器、扩展块与特征交互块细化关节和骨架特征,并结合多头自注意力与坐标注意力生成网格顶点。在FreiHand上达到72 FPS,PA-MPJPE 6.3 mm、PA-MPVPE 6.4 mm,兼顾速度与精度。

Differentiable Rendering-based Pose Estimation for Surgical Robotic Instruments Figure 1
arXiv preprint2025-03-07

Differentiable Rendering-based Pose Estimation for Surgical Robotic Instruments

Zekai Liang, Zih-Yun Chiu, Florian Richter, Michael C. Yip

University of California, San Diego

6D位姿估计机器人操作医学/手术

针对 dVRK 等腱驱手术机器人关节读数误差、器械链条部分可见导致传统标定和基于关键点/PnP 初始化不稳的问题,论文用可微渲染匹配器械几何原语,引入面向手术臂朝向的位姿假设空间、多种子优化和几何约束损失。实验在标定一致性与真实操作任务中优于既有单帧初始化方法,可作为无标记手术工具跟踪初始化方案。

Multi-Grained Feature Pruning for Video-Based Human Pose Estimation Figure 1
arXiv preprint2025-03-07

Multi-Grained Feature Pruning for Video-Based Human Pose Estimation

Zhigang Wang, Shaojing Fan, Zhenguang Liu, Zheqi Wu, Sifan Wu, Yingying Jiao

College of Computer Science and Technology, Zhejiang Gongshang University, Hangzhou, China, School of Computing, National University of Singapore, Singapore, The State Key Laboratory of Blockchain and Data Security, Zhejiang University, Hangzhou, China, Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security, Hangzhou, China, College of Computer Science and Technology, Jilin University, Changchun, China, College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China

6D位姿估计人体姿态

针对视频人体姿态估计中相邻帧 token 冗余、低分辨率 Transformer 难以保留细粒度线索的问题,论文提出 FTP-Pose:用多粒度特征编码器分别建模关键帧高分辨率空间细节与多帧低分辨率时序信息,并通过密度峰值聚类动态剪枝语义较弱 token。实验在三个大规模数据集达到新 SOTA,PoseTrack2017 为 87.4 mAP,推理速度较基线提升 93.8%。

Persistent Object Gaussian Splat (POGS) for Tracking Human and Robot Manipulation of Irregularly Shaped Objects Figure 1
arXiv preprint2025-03-07

Persistent Object Gaussian Splat (POGS) for Tracking Human and Robot Manipulation of Irregularly Shaped Objects

Justin Yu, Kush Hari, Karim El-Refai, Arnav Dalal, Justin Kerr, Chung Min Kim, Richard Cheng, Muhammad Zubair Irshad

Toyota Research Institute, Los Altos, CA

6D位姿估计机器人操作高斯泼溅

面向工厂/家庭中无 CAD、形状不规则且会被人或机器人反复移动的物体,POGS 将 3D Gaussian Splat 扩展为可编辑的对象级持久特征场,融合 CLIP/DINO/Detic 语义、视觉与分组特征,并用单个双目相机在线优化 6D 位姿,避免每次扰动后重扫。实机中物体复位平均位姿误差 2.92 cm,最多连续成功 12 次;工具伺服可从 30°扰动中恢复,抓取内扰动恢复率 80%,但跟踪仅约 5Hz且遮挡鲁棒性仍有限。

SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting Figure 1
arXiv preprint2025-03-07

SplatPose: Geometry-Aware 6-DoF Pose Estimation from Single RGB Image via 3D Gaussian Splatting

Linqi Yang, Xiongwei Zhao, Qihao Sun, Ke Wang, Ao Chen, Peng Kang

Harbin Institute of Technology, Shenzhen Institute of Information Technology

6D位姿估计三维重建高斯泼溅

SplatPose瞄准单张 RGB 进行 6DoF 位姿估计时对初始位姿敏感、易出现旋转歧义,而深度或多视角方案部署成本高的问题。其核心是将 3DGS 显式几何与双注意力射线评分网络结合,把位置与朝向评分解耦,并通过由粗到细的特征对齐进一步修正位姿。在三个基准上,文中报告其单 RGB 设置达到 SOTA,精度接近依赖深度或多视角的方法。

GaussianCAD: Robust Self-Supervised CAD Reconstruction from Three Orthographic Views Using 3D Gaussian Splatting Figure 1
arXiv preprint2025-03-07

GaussianCAD: Robust Self-Supervised CAD Reconstruction from Three Orthographic Views Using 3D Gaussian Splatting

Zheng Zhou, Zhe Li, Bo Yu, Lina Hu, Liang Dong, Zijian Yang, Xiaoli Liu, Ning Xu, Ziwei Wang, Yonghao Dang, Jianqin Yin

Shanghai Electric (China), State Grid Corporation of China (China), Beijing University of Posts and Telecommunications

6D位姿估计三维重建高斯泼溅

该工作针对工业 CAD 草图重建中矢量草图和 3D 真值难获取、且传统规则方法对噪声敏感的问题,将三视图正交 CAD 重建重新表述为稀疏视角三维重建。GaussianCAD 通过草图过滤、前景着色与手工计算正交相机位姿,把栅格草图转成适配 3D Gaussian Splatting 的自监督输入,从而绕开 3D 监督和 DSL 约束。在 Sub-Fusion360 上,文中报告其重建精度优于既有方法,并在噪声输入下更稳健。

MarsLGPR: Mars Rover Localization with Ground Penetrating Radar Figure 1
arXiv preprint2025-03-06

MarsLGPR: Mars Rover Localization with Ground Penetrating Radar

Anja Sheppard 1 ^{ }, Student Member, IEEE, Katherine A. Skinner 1 ^{ }, Member

Department of Robotics, University of Michigan, Ann Arbor, MI USA

6D位姿估计

面向火星车在无 GPS、强光照变化且沙地易打滑环境中的实时定位,论文将原本用于地质探测的探地雷达复用为定位传感器,提出基于 Transformer 的 GPRFormer 预测一维相对位移,并与 IMU、轮编码器通过 EKF 融合。在火星类比场地实验中,GPR 位移估计优于轮编码器,且在高滑移区域显著改善多模态定位,同时发布 MarsLGPR 数据集。

ReynoldsFlow: Exquisite Flow Estimation via Reynolds Transport Theorem Figure 1
arXiv preprint2025-03-09

ReynoldsFlow: Exquisite Flow Estimation via Reynolds Transport Theorem

Australia yuhsi@student.unimelb.edu.au, Taiwan ctw@math.nctu.edu.tw

The University of Melbourne, National Yang Ming Chiao Tung University

6D位姿估计

面向传统光流依赖亮度恒定、小运动假设以及深度光流训练成本高、HSV 可视化转 RGB 易引入感知失真的问题,论文用 Reynolds 输运定理将光流重解释为光场输运,提出免训练的 Reynolds flow,并构造融合图像强度、光流与 Reynolds flow 幅值的 RGB 表示 ReynoldsFlow+。在 UAVDB、Anti-UAV 检测和 GolfDB 姿态估计上作为预处理特征取得 SOTA,显示出较好的鲁棒性与边缘部署潜力。

Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames Figure 1
arXiv preprint2025-03-05

Active 6D Pose Estimation for Textureless Objects using Multi-View RGB Frames

Jun Yang affiliationmark, Wenjie Xue affiliationmark, Sahar Ghavidel affiliationmark, Steven L. Waslander affiliationmark

University of Toronto Institute for Aerospace Studies and Robotics Institute, ON, Canada, Epson Canada Ltd, ON, Canada

6D位姿估计多视角

针对无纹理、反光或透明物体在单视角 RGB 下易受尺度/深度歧义、对称性和遮挡影响的问题,论文提出仅用多视角 RGB 的主动 6D 位姿框架:先估计平移以约束深度,再用规范尺度模板匹配估计姿态,并以信息论不确定性选择下一最佳视角。实验在 ROBI、TOD 和 T-ROBI 上显示,同视角数下优于现有 RGB 方法,且用更少视角达到较高精度。

Machine Learning in Biomechanics: Key Applications and Limitations in Walking, Running, and Sports Movements Figure 1
arXiv preprint2025-03-05

Machine Learning in Biomechanics: Key Applications and Limitations in Walking, Running, and Sports Movements

Center for Digital Health, authors contributed equally, Shared senior authorship

Department of Sports Science, University of Kaiserslautern-Landau (RPTU), Institute of Sports Science, Johannes Gutenberg-University Mainz, Institute of Creative Media Technologies, St. Pölten University of Applied Sciences, Institute of Health Sciences & Center for Digital Health and Social Innovation

6D位姿估计

该综述针对步行、跑步与运动生物力学中数据采集依赖昂贵实验室、处理耗时且多维信号难解释的问题,梳理机器学习在姿态估计、特征/事件估计、聚类探索和自动分类中的作用。核心洞察是ML可把IMU、视频等简化传感数据转化为可用生物力学指标并辅助分析,但效果受数据与标注稀缺、可解释性不足限制;文中主要给出应用版图与挑战总结,未充分说明统一定量增益。

Improving 6D Object Pose Estimation of metallic Household and Industry Objects Figure 1
arXiv preprint2025-03-05

Improving 6D Object Pose Estimation of metallic Household and Industry Objects

Thomas Pöllabauer, Michael Gasser, Tristan Wirth, Sarah Berkei, Volker Knauthe, Arjan Kuijper

Thomas Pöllabauer, Technical University Darmstadt, Germany, Fraunhofer Institute for Computer Graphics Research IGD, Germany

6D位姿估计物体位姿

针对金属家用与工业物体因反光、高光和环境映射导致6D位姿估计精度下降的问题,论文构建了含60类金属物体、复杂光照/背景的BOP兼容PBR数据集,并在GDRNPP上加入关键点热图学习与材质参数估计头以提供几何和视觉线索。实验显示两类改动均可带来约25%性能提升,复杂形状物体收益最大。

Tiny Lidars for Manipulator Self-Awareness: Sensor Characterization and Initial Localization Experiments Figure 1
arXiv preprint2025-03-05

Tiny Lidars for Manipulator Self-Awareness: Sensor Characterization and Initial Localization Experiments

Giammarco Caroleo, Alessandro Albini, Daniele De Martini, Timothy D. Barfoot, Perla Maiolino

Science Oxford, University of Oxford, Robotics Research (United States)

6D位姿估计点云

面向协作机械臂在动态工位中以低成本、轻量化方式感知并定位周围目标,本文研究仅依赖 8×8 VL53L5CX 微型 ToF LiDAR 的粗糙点云定位。核心在于先系统标定量测随距离与入射角变化的偏差和噪声,再将其写入概率束模型并用粒子滤波估计目标位姿。实验显示,该传感器模型相较“无噪声”假设和数据手册置信度两种基线能提升定位精度,但更复杂场景泛化仍需进一步验证。

Direct Sparse Odometry with Continuous 3D Gaussian Maps for Indoor Environments Figure 1
arXiv preprint2025-03-05

Direct Sparse Odometry with Continuous 3D Gaussian Maps for Indoor Environments

Jie Deng, Fengtian Lang, Zikang Yuan, Xin Yang

6D位姿估计相机位姿高斯泼溅

面向室内机器人/AR中依赖先验地图的单目定位,论文指出离散点云与密集图像关联时常用插值补深会在空洞和遮挡边界引入几何不一致,并传递到位姿优化。方法将先验点云转为连续3D Gaussian地图,在DSO式直接法中渲染与像素对齐的深度,为高梯度点提供无需插值的约束。两套公开数据集上较既有先验地图VO/VIO取得更低轨迹误差,消融和可视化支持增益主要来自更稳定的深度关联。

Supervised Visual Docking Network for Unmanned Surface Vehicles Using Auto-labeling in Real-world Water Environments Figure 1
Ocean Engineering2025-03-05

Supervised Visual Docking Network for Unmanned Surface Vehicles Using Auto-labeling in Real-world Water Environments

Yijie Chu, Ziniu Wu, Yong Yue, Eng Gee Lim, Paolo Paoletti, Xiaohui Zhu

Hebei University of Science and Technology, University of Bristol, Xi’an Jiaotong-Liverpool University, University of Liverpool

6D位姿估计

面向无人水面艇在港口/站点自主回坞仍依赖人工遥控或外部定位的问题,论文提出带自动标注的数据采集与监督学习流程,将图像与相对位姿成对生成,并用NDPE直接预测码头相对6D位姿,减少手工特征、相机标定和外部标记依赖,供PBVS与底层控制使用。真实水域实验表明,该方法对距离变化和艇速扰动较鲁棒,可完成实际视觉自主停靠验证。

SCORE: Saturated Consensus Relocalization in Semantic Line Maps Figure 1
arXiv preprint2025-03-05

SCORE: Saturated Consensus Relocalization in Semantic Line Maps

Haodong Jiang, Xiang Zheng, Yanglin Zhang, Qingcheng Zeng, Yiqian Li, Ziyang Hong, Junfeng Wu

Chinese University of Hong Kong, Shenzhen, Hong Kong University of Science and Technology, University of Hong Kong

6D位姿估计相机位姿

针对视觉重定位中地图存储量与精度难兼顾的问题,SCORE用带语义标签的3D线段替代重特征点/深度特征地图,但由此带来严重一对多匹配歧义。论文核心是Sat-CM鲁棒估计及其全局加速求解器,在最高99.5%外点下仍可估计PnL位姿;ScanNet++实验显示其仅需代表性基线0.01%–0.1%的存储,运行时间相近且精度具实用性。

Monocular Person Localization under Camera Ego-motion Figure 1
arXiv preprint2025-03-04

Monocular Person Localization under Camera Ego-motion

Yu Zhan, Hanjing Ye, Hong Zhang

Southern University of Science and Technology

6D位姿估计

面向四足机器人等平台在崎岖地形中相机姿态剧烈变化导致的单目行人定位失准问题,论文将定位转化为轻量位姿优化:用四点人体模型建立2D-3D对应,单帧联合估计相机滚转/俯仰与人的3D位置,避免依赖固定相机或易漂移里程计。公开数据、自建四足机器人数据和真实跟随实验中,该方法定位误差低于几何与学习基线,并在机载小主机上实现约40 FPS部署。

PIDLoc: Cross-View Pose Optimization Network Inspired by PID Controllers Figure 1
arXiv preprint2025-03-04

PIDLoc: Cross-View Pose Optimization Network Inspired by PID Controllers

School of Elctrical Engineering, KAIST, Hanwha Aerospace @kaist.ac.kr @hanwha.com

Urban Robotics Lab, School of Elctrical Engineering, KAIST

6D位姿估计

针对城市峡谷等 GNSS 受限场景中跨视角位姿优化易受大初值误差和重复纹理影响的问题,PIDLoc 将 PID 控制思想映射为 P/I/D 三个特征关系分支,分别建模局部差异、全局聚合上下文和差异梯度,并用空间感知位姿估计器提升一致性。在 KITTI 与 FMAVS 上达到 SOTA,KITTI 位置误差较此前方法降低 37.8%。

DQO-MAP: Dual Quadrics Multi-Object mapping with Gaussian Splatting Figure 1
arXiv preprint2025-03-04

DQO-MAP: Dual Quadrics Multi-Object mapping with Gaussian Splatting

Haoyuan Li, Ziqin Ye, Yue Hao, Weiyang Lin, Chao Ye

6D位姿估计物体位姿三维重建高斯泼溅

面向机器人导航等需要物体级场景理解的任务,DQO-MAP试图弥合传统几何基元位姿准但缺纹理、3DGS重建细但难实例化的缺口。方法将双二次曲面用于6D物体位姿与尺度估计,并以物体ID管理实例级高斯,实现CPU管理、GPU并行优化和快速物体提取。实验显示其在合成与真实数据上提升了位姿精度、重建质量和效率,但具体增益在多大程度来自检测器与工程并行化仍需结合完整消融判断。

Category-level Meta-learned NeRF Priors for Efficient Object Mapping Figure 1
arXiv preprint2025-03-05

Category-level Meta-learned NeRF Priors for Efficient Object Mapping

Saad Ejaz, Hriday Bavle, Laura Ribeiro, Holger Voos, Jose Luis Sanchez-Lopez

University of Luxembourg

6D位姿估计类别级位姿三维重建

针对类别级物体建图中 DeepSDF 先验难以刻画尖锐几何且训练开销高的问题,PRENOM 将元学习得到的类别级 NeRF 初始化作为先验,并为不同类别用多目标遗传算法搜索轻量架构,结合先验引导的概率射线采样以加速收敛。在合成数据上较无先验 NeRF 的 Chamfer 距离降低 21%,在含噪真实数据上平均重建指标提升 13%,位姿和尺寸精度相当且训练时间约减少 5 倍。

RUSSO: Robust Underwater SLAM with Sonar Optimization against Visual Degradation Figure 1
IEEE/ASME Transactions on Mechatronics2025-03-03

RUSSO: Robust Underwater SLAM with Sonar Optimization against Visual Degradation

Shu Pan, Ziyang Hong, Zhangrui Hu, Xiandong Xu, Wenjie Lu, Liang Hu

Harbin Institute of Technology, Tianjin University

6D位姿估计相机位姿

针对水下浑浊、弱纹理等导致视觉 SLAM 退化甚至初始化失败的问题,RUSSO 将双目相机、IMU 与前视成像声呐纳入统一非线性优化;在视觉退化时用声呐特征跟踪估计 3DoF 位姿,为 IMU 传播提供先验,并用声呐辅助初始化。仿真、水池和海试表明,相比现有视觉惯性 SLAM,其在困难视觉条件下定位更稳、漂移更小。

ecg2o: A Seamless Extension of g2o for Equality-Constrained Factor Graph Optimization Figure 1
arXiv preprint2025-03-03

ecg2o: A Seamless Extension of g2o for Equality-Constrained Factor Graph Optimization

Anas Abdelkarim, Holger Voos, Daniel Görges

6D位姿估计

针对因子图在最优控制等场景中难以精确处理系统动力学等 equality constraints 的问题,本文将 KKT 条件嵌入 Gauss-Newton/LM 求解流程,并以边的形式在 g2o 中原生表达约束,形成 header-only 库 ecg2o。实验以自动驾驶速度跟踪控制为例,对比软约束和增广拉格朗日方法,显示其在保证约束可行性的同时减少权重/超参数调节并加快收敛。

Convex Hull-based Algebraic Constraint for Visual Quadric SLAM Figure 1
arXiv preprint2025-03-03

Convex Hull-based Algebraic Constraint for Visual Quadric SLAM

Xiaolong Yu, Junqiao Zhao, Shuangfu Song, Zhongyang Zhu, Zihan Yuan, Chen Ye, Tiantian Feng

Institute of Intelligent Vehicles, Tongji University, Shanghai, China

6D位姿估计相机位姿

论文针对现有 Quadric SLAM 中 bbox、圆锥或轮廓约束不够精确、难以真正提升相机定位的问题,提出基于实例分割轮廓凸包的代数平面约束,去除凹形轮廓带来的多视角不一致,并将其用于物体重建、前端位姿估计和后端 BA。在公开数据集上,该方法同时适用于单目与 RGB-D SLAM,相比既有二次曲面 SLAM 提升了物体建图与定位精度。

Floorplan-SLAM: A Real-Time, High-Accuracy, and Long-Term Multi-Session Point-Plane SLAM for Efficient Floorplan Reconstruction Figure 1
arXiv preprint2025-03-04

Floorplan-SLAM: A Real-Time, High-Accuracy, and Long-Term Multi-Session Point-Plane SLAM for Efficient Floorplan Reconstruction

Haolin Wang, Zeren Lv, Hao Wei, Haijiang Zhu, Yihong Wu

Chinese Academy of Sciences, Institute of Automation, Beijing University of Chemical Technology

6D位姿估计相机位姿三维重建

针对室内机器人实时获取结构化楼层图时依赖离线全局地图、昂贵传感器或高算力的问题,Floorplan-SLAM将平面提取、点-面位姿估计、后端优化与多会话地图合并紧耦合,仅用双目相机和CPU增量重建平面化户型图。其关键在紧凑平面参数空间的鲁棒提取和带轨迹约束的优化建模;在VECtor及自采数据上实现25–45 FPS,并将1000平方米场景重建从16小时44分降至9.4分钟。

BGM2Pose: Active 3D Human Pose Estimation with Non-Stationary Sounds Figure 1
arXiv preprint2025-03-01

BGM2Pose: Active 3D Human Pose Estimation with Non-Stationary Sounds

JST Presto mariko.isogawa@keio.jp

Keio University, NTT Corporation, Yoshimitsu Aoki, Tokyo University of Science, Keio University, JST Presto

6D位姿估计人体姿态

BGM2Pose针对相机受遮挡、弱光和隐私限制,以及传统声学姿态估计依赖刺耳chirp信号的问题,尝试用日常背景音乐作为主动感知源。其核心在于用对比式姿态提取模块抑制音乐自身的非平稳变化,并用频率注意力从有限且变化的频带中捕捉人体运动扰动。作者构建AMPL数据集,实验显示其优于既有声学方法,具备更自然部署的潜力。

BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket Sports Figure 1
arXiv preprint2025-02-28

BST: Badminton Stroke-type Transformer for Skeleton-based Action Recognition in Racket Sports

Jing-Yuan Chang

National Tsing Hua University

6D位姿估计

羽毛球击球动作短促且类别差异细微,仅靠骨架动作难以区分,且需判断由哪名球员完成击球。BST通过击球片段裁剪,将人体骨架、球路轨迹与场地位置结合,并把球路作为核心线索输入Transformer进行单打击球类型识别。在ShuttleSet、BadmintonDB及TenniSet上超过既有SOTA,说明球轨迹对拍类运动动作识别的增益显著。

Cutting-edge 3D reconstruction solutions for underwater coral reef images: A review and comparison Figure 1
ISPRS Journal of Photogrammetry and Remote Sensing2025-02-27

Cutting-edge 3D reconstruction solutions for underwater coral reef images: A review and comparison

Jiageng Zhong, Ming Li, Armin Gruen, Konrad Schindler, Xuan Liao, Qinghua Guo

Wuhan University, State Key Laboratory of Information Engineering in Surveying Mapping and Remote Sensing, Wuhan University of Technology, ETH Zurich, Wuhan Business University, Hong Kong Polytechnic University, Peking University

6D位姿估计三维重建

针对珊瑚礁监测中水下成像退化、结构复杂和算力受限导致三维重建难以落地的问题,本文系统梳理并比较相机位姿估计与稠密表面重建两阶段的传统、深度学习、NeRF/GS等方案。核心洞察是将前沿视觉方法放到真实与仿真珊瑚数据上统一评测,而非只看通用基准;主要结果是给出面向实际建模的选型建议,并指出复杂纹理、遮挡、重叠不足和资源约束仍是关键瓶颈,具体量化增益文中未充分说明。

BEV-DWPVO: BEV-based Differentiable Weighted Procrustes for Low Scale-drift Monocular Visual Odometry on Ground Figure 1
IEEE Robotics and Automation Letters2025-02-27

BEV-DWPVO: BEV-based Differentiable Weighted Procrustes for Low Scale-drift Monocular Visual Odometry on Ground

Yufei Wei, Sha Lu, Wangtao Lu, Rong Xiong, Yue Wang

Zhejiang University

6D位姿估计相机位姿

针对地面车辆单目视觉里程计长期运行中的尺度漂移,BEV-DWPVO将透视图像提升到具有统一度量尺度的BEV特征图,并借助地面平面假设把位姿估计从6DoF简化为3DoF;其在BEV中进行关键点提取与匹配,再用可微加权Procrustes求解位姿,仅需位姿监督端到端训练。在NCLT、Oxford和KITTI长序列评测中,多数指标优于传统和学习式MVO,尤其在NCLT/Oxford上降低了相对平移与旋转误差,显示BEV尺度锚定有助于抑制漂移。

SegLocNet: Multimodal Localization Network for Autonomous Driving via Bird's-Eye-View Segmentation Figure 1
arXiv preprint2025-02-28

SegLocNet: Multimodal Localization Network for Autonomous Driving via Bird's-Eye-View Segmentation

Zijie Zhou, Zhangshuo Qi, Luqi Cheng, Guangming Xiong

6D位姿估计

针对城市环境中 GNSS 易失效、HD 地图成本高而 SD/OSM 地图精度与泛化不足的问题,SegLocNet 将多视角图像和 LiDAR 转为 BEV 语义分割,再与先验二维地图穷举匹配估计自车位姿,避免直接回归带来的黑箱和过拟合。其二值地图掩码统一表示可兼容 HD 与 SD 地图;在 nuScenes 和 Argoverse 上优于现有方法,显示出无 GNSS 定位和跨地图泛化能力。

RUBIK: A Structured Benchmark for Image Matching across Geometric Challenges Figure 1
arXiv preprint2025-02-27

RUBIK: A Structured Benchmark for Image Matching across Geometric Challenges

Thibaut Loiseau, Guillaume Bourmaud

Laboratoire IMS, Universit´e de Bordeaux, France

6D位姿估计数据集/基准

现有图像匹配/相机位姿基准难以按几何因素定位方法失效边界,RUBIK基于nuScenes构建16.5K对图像,用重建6DoF位姿与稠密共视图,将重叠率、尺度比和视角差量化为33个难度格。对14种方法的评测显示,无检测器方法成功率较高但耗时显著增加,最佳方法也仅在54.8%样本上成功,低重叠、大尺度差和极端视角仍是主要瓶颈。

QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects Figure 1
the AAAI Conference on Artificial Intelligence 20252025-02-27

QORT-Former: Query-optimized Real-time Transformer for Understanding Two Hands Manipulating Objects

Elkhan Ismayilzada, MD Khalequzzaman Chowdhury Sayem, Yihalem Yimolal Tiruneh, Mubarrat Tajoar Chowdhury, Muhammadjon Boboev, Seungryul Baek

Ulsan National Institute of Science and Technology

6D位姿估计手部姿态

面向AR/VR、机器人等需要实时理解双手操作物体的场景,QORT-Former针对现有Transformer手-物体联合位姿估计计算量过高的问题,减少到108个查询和1层解码器,并将查询按左右手与物体划分,融合接触图信息,配合图像/查询特征三步联合更新。在H2O与FPHA上同时提升双手、物体6D位姿精度,并在RTX 3090TI上达到53.5 FPS。

Accurate Pose Estimation for Flight Platforms based on Divergent Multi-Aperture Imaging System Figure 1
arXiv preprint2025-02-27

Accurate Pose Estimation for Flight Platforms based on Divergent Multi-Aperture Imaging System

Shunkun Liang, Bin Li, Banglei Guan, Yang Shang, Xianwei Zhu, Qifeng Yu

6D位姿估计

针对飞行平台视觉定位中单相机视场与分辨率难以兼得的问题,论文设计了由五个长焦、无重叠视场相机组成的发散多孔径成像系统,并用三维标定场完成内外参统一标定,将其建模为广义相机;随后把绝对位姿估计写成带拉格朗日乘子的非线性优化问题。真实标定与飞行实验显示可达到厘米级位置精度和角分级姿态精度。

Increasing the Task Flexibility of Heavy-Duty Manipulators Using Visual 6D Pose Estimation of Objects Figure 1
arXiv preprint2025-02-26

Increasing the Task Flexibility of Heavy-Duty Manipulators Using Visual 6D Pose Estimation of Objects

Pauli Mustalahti, Tuomo Kivelä, Jouni Mattila

6D位姿估计

针对重载长臂机械臂因结构柔性导致刚体运动学难以精确定位的问题,论文将眼在手相机的物体/工具6D位姿估计与基于视觉SLAM的运动标定结合,用图像中的位姿误差引导姿态和位置对齐,并仅用合成数据训练网络。在5米臂真实实验中,非深度轴平均工具定位误差低于2毫米,表明该方案可提升非刚性重载机械臂的任务适应性。

EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity Figure 1
arXiv preprint2025-02-25

EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activity

Dominik Hollidt, Paul Streli, Jiaxi Jiang, Yasaman Haghighi, Changlin Qian, Xintong Liu, Switzerland firstname.lastname@inf.ethz.ch

Department of Computer Science, ETH Zürich, Switzerland

6D位姿估计数据集/基准多视角

针对以头戴相机为主的自我中心感知难以覆盖下肢和多视角身体运动的问题,EgoSim提出可配置的身体佩戴多相机仿真器,用真实动捕驱动并用弹簧臂模拟松动安装带来的运动伪影,同时发布含119小时合成与5小时真实六相机数据的MultiEgoView。实验表明,合成预训练再用真实数据微调可显著降低真实3D人体位姿误差,但跨被试泛化仍偏弱。

Learning Structure-Supporting Dependencies via Keypoint Interactive Transformer for General Mammal Pose Estimation Figure 1
International Journal of Computer Vision2025-02-25

Learning Structure-Supporting Dependencies via Keypoint Interactive Transformer for General Mammal Pose Estimation

Tianyang Xu, Jiyong Rao, Xiaoning Song, Zhenhua Feng, Xiao-Jun Wu

Jiangnan University, University of Surrey

6D位姿估计

本文针对跨物种哺乳动物姿态估计中外观、体型和姿态差异大且数据规模有限的问题,提出 KITPose:通过关键点聚类生成身体部位提示,并用不做空间切分的 Keypoint Interactive Transformer 建模关键点间结构依赖,配合 GHRL 与自适应权重缓解关键点不均衡。在 AP10K 上达到 77.9 AP,较 HRFormer 高 2.2,并在 AnimalKingdom 与 COCO 迁移实验中显示一定泛化性。

V-HOP: Visuo-Haptic 6D Object Pose Tracking Figure 1
arXiv preprint2025-02-24

V-HOP: Visuo-Haptic 6D Object Pose Tracking

Hongyu Li, Mingxi Jia, Tuluhan Akbulut, Yu Xiang, George Konidaris, Srinath Sridhar

Brown University, The University of Texas at Dallas

6D位姿估计物体位姿

V-HOP针对接触/手内操作中视觉易遮挡、纯触觉方法跨夹爪与传感器泛化差、逐帧估计不连贯的问题,将触觉读数与关节本体感知统一为点云式触觉表示,并用Transformer融合视觉基础模型特征进行6D位姿跟踪。实验在多夹爪仿真、FeelSight和真实Barrett Hand上验证,较FoundationPose在自建集ADD-S提升约5%,较NeuralFeels提升32%且快10倍,接入规划后任务成功率平均提高40%。

Orchestrating Joint Offloading and Scheduling for Low-Latency Edge SLAM Figure 1
IEEE Transactions on Mobile Computing, 20252025-02-23

Orchestrating Joint Offloading and Scheduling for Low-Latency Edge SLAM

Yao Zhang, Yuyi Mao, Hui Wang, Zhiwen Yu, Song Guo, Jun Zhang, Liang Wang, Bin Guo

Northwestern Polytechnical University, Macau University of Science and Technology, Harbin Engineering University, Hong Kong University of Science and Technology

6D位姿估计相机位姿

面向移动机器人本地算力不足且边缘 SLAM 负载、用户精度/时延需求随输入变化的问题,论文提出多边缘服务器协同的联合卸载与调度框架:用区域特征预测做重要性感知压缩,结合压缩/解压与任务卸载配置,并以输入依赖的约束强化学习调度 SLAM 任务。实验显示其在提升相机位姿估计精度的同时,相比典型边缘 SLAM 最多节省 47% 通信成本,并能更好满足动态用户约束。

DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion Figure 1
arXiv preprint2025-02-23

DeProPose: Deficiency-Proof 3D Human Pose Estimation via Adaptive Multi-View Fusion

Jianbin Jiao, Xina Cheng, Kailun Yang, Xiangrong Zhang, Licheng Jiao

the School of Artificial Intelligence, Xidian University, China

6D位姿估计人体姿态多视角

本文针对真实多视角人体3D姿态估计中遮挡、噪声和视角缺失导致性能下降的问题,提出端到端的 DeProPose,绕开传统2D到3D多阶段流程,并用基于投影误差与绝对误差的自适应多视角融合为不同视角动态赋权。作者还构建 DA-3DPE 缺陷场景数据集;实验显示其在缺陷感知和常规场景均优于现有方法,但具体增益来源仍可能与新数据设定有关。

RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes Figure 1
arXiv preprint2025-02-21

RGB-Only Gaussian Splatting SLAM for Unbounded Outdoor Scenes

Sicheng Yu, Chong Cheng, Yifan Zhou, Xiaojun Yang, Hao Wang

The Hong Kong University of Science and Technology (GuangZhou). \dagger

6D位姿估计相机位姿三维重建高斯泼溅

针对现有3DGS-SLAM多依赖RGB-D或室内小场景、在无界户外RGB-only条件下深度尺度不稳的问题,OpenGS-SLAM用跨帧一致的pointmap回归替代单帧深度先验,并将位姿估计与3DGS渲染做端到端联合优化,配合自适应尺度映射。Waymo实验中其跟踪误差降至既有3DGS方法的9.8%,新视角合成也达到SOTA。

SiMHand: Mining Similar Hands for Large-Scale 3D Hand Pose Pre-training Figure 1
arXiv preprint2025-02-21

SiMHand: Mining Similar Hands for Large-Scale 3D Hand Pose Pre-training

Nie Lin, Takehiko Ohkawa, Yifei Huang, Mingfang Zhang, Minjie Cai, Ming Li, Ryosuke Furuta, caiminjie@hnu.edu.cn, li-ming948@g.ecc.u-tokyo.ac.jp

The University of Tokyo, Hunan University

6D位姿估计手部姿态

SiMHand针对3D手部姿态估计标注稀缺、以往预训练未充分利用野外视频中大量无标注手图像的问题,构建约200万张Ego4D/100DOH手图像,并用2D姿态挖掘跨图像的相似手作为对比学习正样本,再按样本距离自适应加权损失。相较只靠同图增强的SimCLR/PeCLR,该方法在FreiHand、DexYCB、AssemblyHands上分别较PeCLR提升约15%、10%、4%,但部分收益可能也来自更大规模数据。

Nonlinear Dynamical Systems for Automatic Face Annotation in Head Tracking and Pose Estimation Figure 1
arXiv preprint2025-02-21

Nonlinear Dynamical Systems for Automatic Face Annotation in Head Tracking and Pose Estimation

Thoa Thieu, Roderick Melnik

6D位姿估计

面向头部跟踪与姿态估计中的3D人脸关键点自动标注,论文关注非线性面部运动和遮挡、噪声导致的状态估计不稳定问题。其主要贡献是用统一状态空间框架系统比较EKF与UKF在54个3D人脸标志点上的确定性和随机场景表现。结果显示,无噪声时UKF因更好刻画高阶非线性而MSE更低;加入测量噪声和遮挡后,EKF反而更稳健,提示实际部署需按噪声条件选择滤波器。

Design of a Visual Pose Estimation Algorithm for Moon Landing Figure 1
arXiv preprint2025-02-20

Design of a Visual Pose Estimation Algorithm for Moon Landing

PAGE 1, Atakan SÜSLÜ1, Betül Rana KURAN1, Halil Ersin SÖKEN1

1) Department of Aerospace Engineering, Middle East Technical University, Ankara, Turkey

6D位姿估计

面向月球定点着陆中惯导误差随时间漂移的问题,本文设计了一种基于月面陨石坑的绝对视觉6D位姿估计算法:利用已知陨石坑数据库、相机观测到的相对方向和距离,结合非线性最小二乘估计位置、QUEST估计姿态,并在Matlab月球硬着陆仿真中验证。结果显示估计精度受参与陨石坑数量影响,但增加上限带来的精度提升并非线性,需在精度与计算量之间折中。

Hier-SLAM++: Neuro-Symbolic Semantic SLAM with a Hierarchically Categorical Gaussian Splatting Figure 1
arXiv preprint2025-02-20

Hier-SLAM++: Neuro-Symbolic Semantic SLAM with a Hierarchically Categorical Gaussian Splatting

Boying Li, Vuong Chi Hao, Peter J. Stuckey, Ian Reid, Hamid Rezatofighi

Faculty of Information Technology, Monash University, Australia, VinUniversity, Vietnam, Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates

6D位姿估计相机位姿三维重建高斯泼溅

针对语义高斯泼溅 SLAM 在类别增多时每个高斯需存储高维语义分布、导致内存与优化成本上升的问题,Hier-SLAM++将语义、形状和尺寸先验组织成由 LLM 与 3D 生成模型辅助构建的层级符号树,并配套 one-hot/二进制嵌入及层内、层间语义损失;同时用前馈 3D 模型提供深度先验以支持单目输入。实验显示其在合成与真实数据上定位、建图和语义理解达到或接近 SOTA,并显著降低存储与训练时间。

EfficientPose 6D: Scalable and Efficient 6D Object Pose Estimation Figure 1
arXiv preprint2025-02-19

EfficientPose 6D: Scalable and Efficient 6D Object Pose Estimation

Zixuan Fang, Thomas Pöllabauer, Tristan Wirth, Sarah Berkei, Volker Knauthe, Arjan Kuijper

Thomas Pöllabauer

6D位姿估计物体位姿

面向质检、机器人抓取等实时场景中6D位姿估计“快而准”难兼顾的问题,本文以GDRNPP为基线设计40种候选架构,通过调整骨干网络与Geo Head降低推理开销,并提出AMIS按数据集和时间预算筛选精度—速度折中模型。在LM-O、YCB-V、T-LESS、ITODD上,AMIS选出的模型相较GDRNPP覆盖更宽推理时延区间并保持或逐步提升精度。

Active Illumination for Visual Ego-Motion Estimation in the Dark Figure 1
arXiv preprint2025-02-19

Active Illumination for Visual Ego-Motion Estimation in the Dark

Francesco Crocetti, Alberto Dionigi, Raffaele Brilli, Gabriele Costante, Paolo Valigi

the Department of Engineering, University of Perugia, Perugia, Italy

6D位姿估计

面向灾害、地下等黑暗场景中 VO/V-SLAM 因特征不足而易失效的问题,论文将窄束 LED 装到可动机械臂上,用低照增强网络和特征区域检测来选择高纹理区域,并通过云台/机械臂主动把光束指向这些区域,而非固定照明或全局强照。在真实机器人实验中,相比传统固定光源,位姿估计误差最高降低约 75%。

Object-Pose Estimation With Neural Population Codes Figure 1
arXiv preprint2025-02-19

Object-Pose Estimation With Neural Population Codes

Heiko Hoffmann, Richard Hoffmann

Magimine, LLC

6D位姿估计物体位姿

面向装配中对称零件导致旋转标注不唯一、直接回归难训练且多假设/概率搜索开销大的问题,论文将物体旋转编码为神经群体码:在轴角空间用偏好神经元和高斯调谐表示多重等价姿态,从而保留端到端直接映射。T-LESS上仅用灰度图达到84.7% MSPD准确率,优于直接位姿回归的69.7%,并在Apple M1 CPU上实现3.2 ms推理。

Spatiotemporal Multi-Camera Calibration using Freely Moving People Figure 1
arXiv preprint2025-02-18

Spatiotemporal Multi-Camera Calibration using Freely Moving People

Sang-Eun Lee, Ko Nishino, Shohei Nobuhara

Graduate School of Informatics, Kyoto University, Kyoto 606-8501, Japan (e-mail

6D位姿估计多视角

针对多相机系统部署中需标定板、硬件同步和人工匹配的负担,本文把自由行走人群的单目3D人体姿态映射到单位球面,将跨视角人体关联、旋转估计和时间偏移统一为概率点集配准,再由共面约束求平移并做多视角全局优化。合成与真实实验表明,该方法在遮挡和多人场景下可实现较实用的无标记时空标定。

Learning Transformation-Isomorphic Latent Space for Accurate Hand Pose Estimation Figure 1
arXiv preprint2025-02-18

Learning Transformation-Isomorphic Latent Space for Accurate Hand Pose Estimation

Kaiwen Ren, Lei Hu, Zhiheng Zhang, Yongjing Ye, CAS Beijing, China @ict.ac.cn

University of Chinese Academic of Science, Institute of Computing Technology, CAS

6D位姿估计手部姿态

该文针对手部姿态回归中通用表征过于语义化、混入纹理光照等无关信息的问题,提出 TI-Net:在预训练中用辅助线性变换约束潜空间与图像/姿态空间保持“变换同构”,强调变换一致而非不变特征,微调时可替换常规视觉骨干。实验在 DexYCB 上相对专用 SOTA 的 PA-MPJPE 提升约 10%,并较表征学习方法降低 1.49mm MPJPE。

FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views Figure 1
arXiv preprint2025-02-19

FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Views

Shangzhan Zhang, Jianyuan Wang, Yinghao Xu, Nan Xue, Christian Rupprecht, Xiaowei Zhou, Yujun Shen, Gordon Wetzstein, Ant Group

Zhejiang University, Ant Group, University of Oxford, Stanford University

6D位姿估计

FLARE针对传统SfM/MVS在未标定、极稀疏视角下依赖匹配、优化慢且易失效的问题,将相机位姿作为几何与外观学习的中间代理,先估粗位姿,再用级联Transformer细化位姿、预测相机中心点图并投影到全局结构,最后生成3D Gaussian用于新视角合成。文中报告其在位姿估计、点云/几何重建和新视角合成上达到SOTA,且2–8张输入即可在0.5秒内前馈推理。

Enhancing Transparent Object Pose Estimation: A Fusion of GDR-Net and Edge Detection Figure 1
arXiv preprint2025-02-17

Enhancing Transparent Object Pose Estimation: A Fusion of GDR-Net and Edge Detection

Tessa Pulli Automation, Austria stefan.thalhammer@technikum-wien.at &Matthias Hirschmanner Automation, Austria hirschmanner@acin.ac.tuwien.at Markus Vincze Automation, Austria vincze@acin.ac.tuwien.at

Automation and Control Institute, Department of Industrial Engineering, University of Applied Sciences Technikum Wien

6D位姿估计物体位姿

透明物体受反射、折射和背景影响,RGB-D深度常失效,使机器人抓取中的6D位姿估计困难。本文的核心思路不是设计专用透明物体网络,而是在通用GDR-Net/YOLOX流程前加入Canny、彩色Canny或HED边缘预处理,利用透明物体轮廓对比度更稳定的特点。基于Trans6D-32K和BOP评测的实验显示,边缘输入能提升部分物体的检测与位姿结果,但改进并非对所有类别一致,增益来源仍需进一步分析。

SurgPose: a Dataset for Articulated Robotic Surgical Tool Pose Estimation and Tracking Figure 1
arXiv preprint2025-02-17

SurgPose: a Dataset for Articulated Robotic Surgical Tool Pose Estimation and Tracking

Zijian Wu, Adam Schmidt, Randy Moore, Haoying Zhou, Alexandre Banks, Peter Kazanzides, Septimiu E. Salcudean

Haoying Zhou is from Worcester Polytechnic Institute, Worcester, USA, Peter Kazanzides is from Johns Hopkins University

6D位姿估计机器人操作数据集/基准医学/手术

针对手术机器人中达芬奇器械运动学误差大、手眼标定繁琐且公开真实数据稀缺的问题,SurgPose用白光不可见、UV下可见的荧光标记采集同轨迹视频与关键点标注,构建含6类器械、约12万实例、每实例7个语义关键点的双目数据集,可由2D提升到3D,并提供运动学、关节状态和分割等辅助标注;文中还评测若干跟踪基线,主要贡献是数据与基准,算法增益可能主要来自data scaling。

VarGes: Improving Variation in Co-Speech 3D Gesture Generation via StyleCLIPS Figure 1
Computational Visual Media2025-02-18

VarGes: Improving Variation in Co-Speech 3D Gesture Generation via StyleCLIPS

Ming Meng, Ke Mu, Yonggui Zhu, Zhe Zhu, Haoyu Sun, Heyang Yan, Zhaoxin Fan

Communication University of China, Samsung (South Korea), Samsung (United States), Hainan University, Beijing Advanced Sciences and Innovation Center, Beihang University

6D位姿估计

现有语音驱动3D手势生成常受数据风格单一和仅依赖音频信息限制,生成动作容易模式化。VarGes的关键思路是引入风格参考视频,通过3D人体姿态估计提取StyleCLIPS,并用Transformer式编码器与交叉注意力将其同MFCC语音特征融合,作为自回归生成的风格条件。在基准数据集上,论文报告其在手势多样性和自然度上优于已有方法,但具体增益来源仍依赖消融结果支撑。

Semantics-aware Test-time Adaptation for 3D Human Pose Estimation Figure 1
arXiv preprint2025-02-15

Semantics-aware Test-time Adaptation for 3D Human Pose Estimation

Qiuxia Lin, Rongyu Chen, Kerui Gu, Angela Yao

6D位姿估计人体姿态

本文针对野外视频中3D人体姿态TTA过度时间平滑、在遮挡/截断时缺少2D监督而漂向“平均姿态”的问题,提出用视频动作语义和MotionCLIP运动-文本空间约束3D序列,并以文本对齐的运动预测补全缺失2D关键点。该语义先验能缩小2D到3D歧义并增强遮挡场景监督,在3DPW和3DHP上相对现有TTA方法将PA-MPJPE降低超过12%。

Learning semantical dynamics and spatiotemporal collaboration for human pose estimation in video Figure 1
Neurocomputing2025-02-15

Learning semantical dynamics and spatiotemporal collaboration for human pose estimation in video

Runyang Feng, Haoming Chen

Jilin International Studies University, Jilin University, East China Normal University

6D位姿估计人体姿态

针对视频人体姿态估计中过度依赖像素级光流/帧差、在遮挡和模糊下难以建模跨帧语义运动的问题,论文提出 SDTC:通过多层级掩码上下文与姿态重建学习 patch/帧级语义动态,并用空间-运动互学习模块密集融合外观与运动线索。在 PoseTrack2017/2018/21 上取得新的 SOTA,但近景人体严重不完整时仍会失效。

HIPPo: Harnessing Image-to-3D Priors for Model-free Zero-shot 6D Pose Estimation Figure 1
arXiv preprint2025-02-14

HIPPo: Harnessing Image-to-3D Priors for Model-free Zero-shot 6D Pose Estimation

Yibo Liu 1, ∗ ⁢ 0000 − 0003 − 1143 − 3242 1 2 absent 0000 0003 1143 3242 ^{1, } start_FLOATSUPERSCRIPT 1, ∗ 0000 - 0003 - 1143 - 3242 end_FLOATSUPERSCRIPT, Member, IEEE, Zhaodong Jiang, Binbin Xu, Guile Wu, Yuan Ren 1 ⁢ ⁢ 0000 − 0002 − 4901 − 3596 1 0000 0002 4901 3596 ^{1\, } start_FLOATSUPERSCRIPT 1 0000 - 0002 - 4901 - 3596 end_FLOATSUPERSCRIPT, Tongtong Cao, Bingbing Liu 1 ⁢ ⁢ 0000 − 0002 − 5272 − 3425 1 0000 0002 5272 3425 ^{1\, } start_FLOATSUPERSCRIPT 1 0000 - 0002 - 5272 - 3425 end_FLOATSUPERSCRIPT, Rui Heng Yang, Amir Rasouli, Jinjun Shan 2 ⁢ ⁢ 0000 − 0002 − 4911 − 6739 2 0000 0002 4911 6739 ^{2\, } start_FLOATSUPERSCRIPT 2 0000 - 0002 - 4911 - 6739 end_FLOATSUPERSCRIPT, Senior Member

Huawei Noah Ark’s Lab, Markham, Ontario L3R 5A4, Canada, York University, Toronto, Ontario M3J 1P3, Canada, University of Toronto, Toronto, Ontario, M5S 1A1, Canada

6D位姿估计

HIPPo面向机器人在无CAD模型、无预采参考图时仍需即时操作的6D位姿估计场景。其关键做法是用多视角扩散模型和3D重建基础模型从单张初见图快速生成带尺度的完整网格,再随在线观测联合优化几何与外观,用实测逐步替代不可靠的扩散先验。实验显示,在参考信息受限时其6D位姿估计优于现有SOTA方法。

Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models Figure 1
arXiv preprint2025-02-14

Manual2Skill: Learning to Read Manuals and Acquire Robotic Skills for Furniture Assembly Using Vision-Language Models

Chenrui Tie, Shengxiang Sun, Jinxuan Zhu, Yiwei Liu, Jingxiang Guo, Yue Hu, Haonan Chen, Junting Chen, Ruihai Wu, Lin Shao

National University of Singapore, University of Toronto Peking University Sichuan University, Zhejiang University

6D位姿估计机器人操作

Manual2Skill瞄准机器人难以把人类家具说明书中的抽象图示转成可执行长程操作的问题;其关键做法是用VLM从手册图像抽取层级装配图,再结合逐步6D相对位姿估计与运动规划生成装配动作。论文在真实IKEA家具上完成多项组装,并展示层级图生成可零样本迁移到玩具车、飞机模型和机械臂等任务,但拧紧、插入力控等低层技能仍未覆盖。

Metamorphic Testing for Pose Estimation Systems Figure 1
arXiv preprint2025-02-13

Metamorphic Testing for Pose Estimation Systems

Matías Duran, Thomas Laurent, Ellen Rushe, Anthony Ventresque

Trinity College Dublin, Dublin City University

6D位姿估计

论文关注位姿估计在医疗、手语、体育等场景中难以系统测试的问题:人工标注关键点成本高且存在测试 oracle 缺失。作者提出 MET-POSE,用输入变换与输出应保持的变形关系来黑盒检测故障,并允许按应用自定义规则和误差度量。对 Mediapipe Holistic 在 FLIC、PHOENIX 上实验显示,它无需真值标注也能发现大量异常,故障检出率与传统人工标注测试相当或更高。

BevSplat: Resolving Height Ambiguity via Feature-Based Gaussian Primitives for Weakly-Supervised Cross-View Localization Figure 1
arXiv preprint2025-02-13

BevSplat: Resolving Height Ambiguity via Feature-Based Gaussian Primitives for Weakly-Supervised Cross-View Localization

Qiwei Wang, Shaoxun Wu, Yujiao Shi

6D位姿估计高斯泼溅

BevSplat面向弱监督跨视角定位中地面图像缺深度、卫星图缺高度导致的BEV高度歧义问题,避免平面IPM失真和跨视角Transformer在噪声标注下难收敛。其将地面像素提升为带语义/空间特征的3D高斯基元,并用可见性感知各向异性splatting生成BEV特征用于位姿匹配。在KITTI与VIGOR的针孔和全景场景中,定位精度较已有方法显著提升。

Siren Song: Manipulating Pose Estimation in XR Headsets Using Acoustic Attacks Figure 1
arXiv preprint2025-02-13

Siren Song: Manipulating Pose Estimation in XR Headsets Using Acoustic Attacks

Zijian Huang, Yicheng Zhang, Sophie Chen, Nael Abu-Ghazaleh, Jiasi Chen

University of Michigan, Ann Arbor, University of California, Riverside

6D位姿估计

这篇论文关注XR头显依赖IMU与视觉SLAM进行6D位姿估计所带来的物理攻击面:攻击者无需入侵软件,只用近场声波激发MEMS惯性传感器共振,即可扰动位姿链路。作者在HoloLens 2、Quest 3及ORB-SLAM3/ILLIXR中分析声学注入如何导致误导、回弹和漂移,并在HoloLens 2上实现操纵输入、点击劫持、区域入侵和交互拒绝等端到端攻击,结果表明商用XR位姿估计对声学攻击仍缺乏鲁棒性。

LIR-LIVO: A Lightweight,Robust LiDAR/Vision/Inertial Odometry with Illumination-Resilient Deep Features Figure 1
arXiv preprint2025-02-12

LIR-LIVO: A Lightweight,Robust LiDAR/Vision/Inertial Odometry with Illumination-Resilient Deep Features

Shujie Zhou, Zihao Wang, Xinye Dai, Weiwei Song

6D位姿估计相机位姿点云

针对光照剧变、视觉退化及 LiDAR 结构退化场景下多传感器里程计易失稳且维护双子地图开销大的问题,LIR-LIVO 将 FAST-LIO2 式直接 LiDAR-惯性估计与轻量视觉模块顺序融合,用 LiDAR 关联视觉特征深度并筛选均匀深度分布,同时引入 SuperPoint/LightGlue 提升弱光匹配鲁棒性。其在 NTU-VIRAL、Hilti’22 和 R3LIVE 上优于多种 SOTA,尤其在 Hilti’22 低照度序列表现稳定。

CordViP: Correspondence-based Visuomotor Policy for Dexterous Manipulation in Real-World Figure 1
arXiv preprint2025-02-12

CordViP: Correspondence-based Visuomotor Policy for Dexterous Manipulation in Real-World

Yankai Fu, Qiuxuan Feng, Ning Chen, Zichen Zhou, Mengzhen Liu, Mingdong Wu, Tianxing Chen, Shanyu Rong, Jiaming Liu, Hao Dong

State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, The University of Hong Kong, Beijing Academy of Artificial Intelligence

6D位姿估计机器人操作

面向灵巧手真实操作中单视角点云易受遮挡、且缺少接触对应关系的问题,CordViP借助物体6D位姿估计与机器人本体状态构造交互感知点云,并用物体中心接触图和手臂协同信息预训练编码器,再条件化扩散策略生成动作。论文在六个真实灵巧操作任务上优于多种基线,并展示了对物体、视角和场景变化的泛化鲁棒性。

GaRLIO: Gravity enhanced Radar-LiDAR-Inertial Odometry Figure 1
arXiv preprint2025-02-11

GaRLIO: Gravity enhanced Radar-LiDAR-Inertial Odometry

Chiyun Noh, Wooseong Yang, Minwoo Jung, Sangwoo Jung, Ayoung Kim

6D位姿估计相机位姿点云

GaRLIO针对传统激光惯性里程计因垂直分辨率不足和IMU双积分误差导致的高度漂移,核心洞察是利用毫米波雷达多普勒提供的直接速度来做“速度感知”重力估计,并加入点级速度残差与基于雷达的动态点剔除。公开数据集含上下坡、动态交通等场景的实验显示,其平移/旋转和高程估计整体优于多种LIO基线,消融也表明速度残差、重力残差和动态剔除均有贡献。

Matrix3D: Large Photogrammetry Model All-in-One Figure 1
arXiv preprint2025-02-11

Matrix3D: Large Photogrammetry Model All-in-One

Yuanxun Lu, Jingyang Zhang, Tian Fang, Jean-Daniel Nahmias, Yanghai Tsin Long Quan, Xun Cao, Yao Yao, Shiwei Li, @nju.edu.cn, Apple @apple.com, Technology quan@cse.ust.hk

Nanjing University, The Hong Kong University of Science and Technology

6D位姿估计

Matrix3D针对传统摄影测量依赖大量重叠图像、且SfM/MVS等多阶段误差累积的问题,将图像、相机位姿和深度统一成2D表征,用多模态DiT在不同输入/输出组合间生成,并通过掩码学习利用不完整的图像-位姿或图像-深度数据扩充训练。实验显示其在位姿估计和新视角合成上达到SOTA,并可结合3DGS完成稀疏视角重建。

Vision-in-the-loop Simulation for Deep Monocular Pose Estimation of UAV in Ocean Environment Figure 1
arXiv preprint2025-02-08

Vision-in-the-loop Simulation for Deep Monocular Pose Estimation of UAV in Ocean Environment

Maneesha Wickramasuriya, Beomyeol Yu, Taeyoung Lee, Murray Snyder

Maneesha Wickramasuriya, Beomyeol Yu, Taeyoung Lee, and Murray Snyder, Mechanical and Aerospace Engineering, George Washington University, Washington, DC

6D位姿估计航天器

面向舰载无人机在海上依赖 GPS 成本高、易受干扰且实船验证昂贵的问题,论文构建了基于 Gaussian Splatting 的照片级“视觉在环”仿真环境,并接入 TNN-MO 单目 6D 位姿估计、飞控软硬件进行室内闭环测试。主要结果是可用实地图像重建真实感船海场景,支持飞行动作与视觉估计算法低成本验证;但定量性能增益和相对传统仿真的优势文中未充分说明。

Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation Figure 1
BMVC20242025-02-06

Measuring Physical Plausibility of 3D Human Poses Using Physics Simulation

Nathan Louis, Mahzad Khoshlessan, Jason J. Corso

6D位姿估计人体姿态

该文针对MPJPE等关节误差难以反映3D人体姿态物理合理性的问题,将预测姿态放入物理仿真中检验运动稳定性,提出质心轨迹偏差CoM distance和姿态稳定持续时间Pose Stability Duration两项无需真值的指标。实验在Human3.6m上比较两种SOTA方法、多视角三角化基线和真值标记,显示仿真稳定性与既有合理性指标相关,并能揭示运动中失衡等传统静态或启发式指标遗漏的问题。

GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation Figure 1
arXiv preprint2025-02-06

GCE-Pose: Global Context Enhancement for Category-level Object Pose Estimation

Munich Center for Machine Learning, XYZ Robotics

Technical University of Munich, Munich Center for Machine Learning, XYZ Robotics

6D位姿估计物体位姿类别级位姿

GCE-Pose针对类别级6D位姿在遮挡和部分可见时缺乏全局上下文、难以泛化到新实例的问题,提出“先补全再聚合”的思路:用SSR通过类别语义原型和深度线性形状模型重建完整几何与语义,再用GCE融合局部RGB-D观测和全局上下文特征。实验在HouseCat6D与NOCS-REAL275上优于现有方法,显示全局语义形状先验能提升遮挡和类内形变下的鲁棒性。

Advanced Object Detection and Pose Estimation with Hybrid Task Cascade and High-Resolution Networks Figure 1
arXiv preprint2025-02-06

Advanced Object Detection and Pose Estimation with Hybrid Task Cascade and High-Resolution Networks

Yuhui Jin, Yaqiong Zhang, Zheyuan Xu, Wenqing Zhang, Jingyu Xu

California Institute of Technology, University of Michigan, Ann Arbor, University of Washington, Washington University in St. Louis, Northern Arizona University

6D位姿估计

面向机器人等场景中遮挡、尺度变化和噪声下检测与6D位姿精度难以兼顾的问题,论文在6D-VNet管线中引入三阶段HTC细化候选框,并用HRNet保持高分辨率空间特征,配合后处理和模型集成提升鲁棒性。文中称在公开基准和私有榜单优于现有方法,但具体数据、消融与增益来源未充分说明。

Mapping and Localization Using LiDAR Fiducial Markers Figure 1
arXiv preprint2025-02-05

Mapping and Localization Using LiDAR Fiducial Markers

YIBO LIU

6D位姿估计点云

针对视觉标记已成熟而 LiDAR 标记受点云稀疏、无结构限制难以用于定位建图的问题,本文提出基于强度图的 LiDAR Fiducial Marker,并结合强度与几何信息改进远距离和地图级检测;进一步将多视角低重叠点云配准表述为 MAP 问题,用两级图优化位姿、标记和角点。多种雷达及室内外实验表明,该框架可低成本支持 6D 定位、3D 地图合并、退化场景重建,并构建 Livox-3DMatch 数据集提升学习式配准方法。

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation Figure 1
IEEE Transactions on Pattern Analysis and Machine Intelligence2025-02-04

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation

Jian Liu, Wei Sun, Hui Yang, Pengchao Deng, Chongpei Liu, Nicu Sebe, Hossein Rahmani, Ajmal Mian

Hunan University, Xi'an Jiaotong University, University of Trento, Lancaster University, The University of Western Australia

6D位姿估计物体位姿类别级位姿

Diff9D针对类别级9DoF位姿估计依赖真实标注数据和CAD形状先验的问题,将位姿与尺寸直接视为稀疏变量的扩散生成过程,仅用渲染合成数据训练,并以RGB/点云全局特征条件化Transformer去噪器;结合DDIM将反向扩散压缩到约3步以满足机器人实时性。论文在REAL275、Wild6D和真实抓取系统上显示出优于现有方法的跨域泛化表现,并报告17.2 FPS运行速度。

CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation Figure 1
ICCV20252025-02-03

CleanPose: Category-Level Object Pose Estimation via Causal Learning and Knowledge Distillation

Xiao Lin, Yun Peng, Liuyi Wang, Xianyou Zhong, Minghao Zhu, Jingwei Yang, Yi Feng, Chengju Liu, Qijun Chen

College of Electronic and Information Engineering, Tongji University, Shanghai, China, State Key Laboratory of Autonomous Intelligent Unmanned Systems

6D位姿估计物体位姿类别级位姿

CleanPose针对类别级6D/9DoF位姿估计中训练集重复样本、环境与姿态分布偏置导致模型依赖伪相关的问题,引入因果学习视角:用前门调整建模结构信息与隐藏混杂因素,并通过动态队列近似混杂分布;同时采用残差式知识蒸馏,从3D基础模型ULIP-2迁移更稳健的类别语义监督。实验在REAL275、CAMERA25和HouseCat6D上超过现有方法,REAL275严格5°2cm指标达到61.7%,较最佳基线提升4.7%。

Enhancing Feature Tracking Reliability for Visual Navigation using Real-Time Safety Filter Figure 1
arXiv preprint2025-02-03

Enhancing Feature Tracking Reliability for Visual Navigation using Real-Time Safety Filter

Dabin Kim, Inkyu Jang, Young‐Soo Han, Sunwoo Hwang, H. Jin Kim

Seoul National University, Systems Research Institute

6D位姿估计

针对视觉导航中相机轨迹可能转向低纹理区域、导致特征跟踪不足并影响位姿估计的问题,论文将“保持足够可见特征”从感知目标改写为安全约束,利用可见性约束的前向不变性构造实时 QP 安全滤波器,在尽量少偏离参考速度的同时维持信息分数阈值。仿真显示其能保持所需特征数量,结合 ORB-SLAM2 的实机实验中也比简单跟踪控制在困难场景下保持更稳定估计。

ZeroBP: Learning Position-Aware Correspondence for Zero-shot 6D Pose Estimation in Bin-Picking Figure 1
arXiv preprint2025-02-03

ZeroBP: Learning Position-Aware Correspondence for Zero-shot 6D Pose Estimation in Bin-Picking

Jianqiu Chen, Zikun Zhou, Xin Li, Ye Zheng, Tianpeng Bao, Zhenyu He

Harbin Institute of Technology, Peng Cheng Laboratory

6D位姿估计机器人操作

面向料箱拣选中无纹理、堆叠工件导致的6D位姿部署难题,ZeroBP避免为新工件重新采集数据和训练,改用CAD模型进行零样本估计。其核心是位置感知对应:在局部特征外引入全局位置,通过乘性位置编码、位置感知交叉注意力及位姿—位置交替细化,缓解相似局部区域误匹配。在ROBI真实数据集上,其正确位姿平均召回率较现有零样本方法提升9.1%。

A Direct Semi-Exhaustive Search Method for Robust, Partial-to-Full Point Cloud Registration Figure 1
arXiv preprint2025-01-31

A Direct Semi-Exhaustive Search Method for Robust, Partial-to-Full Point Cloud Registration

Richard Cheng, Chavdar Papozov, Dan Helmick, Mark Tjersland

the Toyota Research Institute

6D位姿估计点云

针对部分观测点云与完整模型配准中对应关系难找、ICP依赖初始化且学习法泛化受限的问题,论文提出 DSES:不先估计对应,而是在 GPU 上半穷举旋转,并为每个旋转高效求最大内点平移,再按任意距离度量选择位姿。作者证明其内点最大化意义下的最优性,并在 ModelNet40 与真实机器人抓取/位姿估计实验中较现有方法更稳健、召回更高,但速度受搜索范围影响。

XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and Glasses Figure 1
arXiv preprint2025-01-31

XRF V2: A Dataset for Action Summarization with Wi-Fi Signals, and IMUs in Phones, Watches, Earbuds, and Glasses

Bo Lan, Pei Li, Jiaxi Yin, Yunpeng Song, Ge Wang, Han Ding, Jinsong Han, Fei Wang

School of Software Engineering, Xi’an Jiaotong University, State Key Laboratory of Integrated Services Networks, Xidian University, MOE KLINNS Lab, Xi’an Jiaotong University, School of Computer Science and Technology, Xi’an Jiaotong University, College of Computer Science and Technology, Zhejiang University, Zhejiang

6D位姿估计数据集/基准

面向智能家居中连续日常行为难以用隐私友好传感器定位并摘要的问题,论文提出 XRF V2 数据集,融合 Wi‑Fi、手机/手表/耳机/眼镜 IMU 与同步视频,覆盖 16 人、3 场景、30 类动作,并引入基于 Mamba 的 XRFMamba 与 RMC 摘要指标。XRFMamba 在 TAL 上平均 mAP 达 78.74,较 WiFiTAD 高 5.49 点且参数少 35%,动作摘要 mRMC 为 0.802。

SimpleDepthPose: Fast and Reliable Human Pose Estimation with RGBD-Images Figure 1
arXiv preprint2025-01-30

SimpleDepthPose: Fast and Reliable Human Pose Estimation with RGBD-Images

Germany daniel.bermuth@uni-a.de

University of Augsburg, Germany, University of Augsburg

6D位姿估计人体姿态点云彩色深度

面向遮挡和多视角多人场景中无标记人体姿态估计的可靠性问题,SimpleDepthPose利用RGB图像的可见2D关键点,从对齐深度图提取关节距离,生成各视角3D候选并按时间关联、异常剔除后平均融合,无需额外训练。实验显示其在可用深度数据时运行很快、跨数据集泛化较好,并能在强遮挡下提升检测到的人和关键点数量;但定位精度仍受深度图质量限制。

Online Trajectory Replanner for Dynamically Grasping Irregular Objects Figure 1
arXiv preprint2025-01-29

Online Trajectory Replanner for Dynamically Grasping Irregular Objects

Minh Nhat Vu, Florian Grander, Anh Nguyen

6D位姿估计

面向产线中位置随机、几何不规则物体的动态抓取,论文提出两阶段轨迹优化:先在约10秒内生成机器人与灵巧手同步离线轨迹,再根据眼在手视觉的6D位姿更新,在100毫秒内在线重规划以补偿估计误差,并配合跟踪控制。仿真和实物实验显示其计算速度优于现有规划方法,且可迁移到不同夹爪和移动物体场景,极端设置下20次成功19次;局限是仍依赖耗时离线轨迹。

DebugAgent: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debugging Figure 1
arXiv preprint2025-01-28

DebugAgent: Efficient and Interpretable Error Slice Discovery for Comprehensive Model Debugging

Muxi Chen, Chenchen Zhao

Department of Computer Science and Engineering, The Chinese University of Hong Kong

6D位姿估计

该工作针对视觉模型在特定数据子集上系统性失效且难以解释、修复的问题,提出 HiBug2 自动调试框架:先结构化生成任务相关视觉属性,再高效枚举多属性错误切片,并预测验证集外潜在高风险切片。实验覆盖分类、6D/姿态估计和检测,属性质量优于既有方法,切片搜索较朴素枚举快 510 倍,并带来更好的模型修复效果。

Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach Figure 1
arXiv preprint2025-01-27

Toward Efficient Generalization in 3D Human Pose Estimation via a Canonical Domain Approach

HOOSANG LEE 1, Jeha Ryu 1

6D位姿估计人体姿态

针对3D人体姿态估计在跨数据集时因相机与姿态分布差异导致性能下降、需大量增强或目标域微调的问题,论文提出将源域和目标域共同映射到规范域:训练时构造一致的规范2D-3D姿态映射,推理时利用相机内参先规范化目标2D姿态。Human3.6M、Fit3D、MPI-INF-3DHP及多种lifting网络实验显示,该方法在相同数据量下显著提升跨数据集泛化;但在域差较小场景收益有限。

NanoHTNet: Nano Human Topology Network for Efficient 3D Human Pose Estimation Figure 1
arXiv preprint2025-01-27

NanoHTNet: Nano Human Topology Network for Efficient 3D Human Pose Estimation

Jialun Cai, Mengyuan Liu, Hong Liu, Shuheng Zhou, Wenhao Li

S. Zhou is with the Ant Group (

6D位姿估计人体姿态

面向 Jetson Nano 等边缘设备上 2D-to-3D 人体姿态提升难以实时的问题,NanoHTNet 将人体骨架的空间层级结构与时间多尺度运动作为先验,用空间/时间 Hierarchical Mixer、DCT 低通滤波和 ETST 降低冗余,并通过多视角对比预训练 PoseCLR 学习隐式拓扑表示。实验显示其在效率上优于多种 SOTA,更适合边缘部署,同时保持或提升姿态估计性能。

SpatioTemporal Learning for Human Pose Estimation in Sparsely-Labeled Videos Figure 1
the AAAI Conference on Artificial Intelligence 20252025-01-25

SpatioTemporal Learning for Human Pose Estimation in Sparsely-Labeled Videos

Yingying Jiao, Zhigang Wang, Sifan Wu, Shaojing Fan, Zhenguang Liu, Zhuoyue Xu, Zheqi Wu

Jilin University, Zhejiang Gongshang University, National University of Singapore

6D位姿估计人体姿态

针对视频人体姿态估计依赖密集标注、在遮挡和运动模糊下难以利用长程时序线索的问题,STDPose在稀疏标注视频中联合编码视觉特征与姿态热图,并通过动态感知掩码捕获远距离运动上下文,再聚合时空表示与运动动态。其在PoseTrack2017/2018/2021上刷新姿态传播和视频姿态估计结果,并借助传播伪标签仅用26.7%标注数据取得有竞争力性能。

3D/2D Registration of Angiograms using Silhouette-based Differentiable Rendering Figure 1
arXiv preprint2025-01-24

3D/2D Registration of Angiograms using Silhouette-based Differentiable Rendering

Taewoong Lee, Sarah Frisken, Nazim Haouchine

6D位姿估计

面向脑血管 DSA 中 3D 血管模型与双视角 2D 影像对齐这一临床需求,论文将配准重写为 AP/LAT 两个投影器的 6D 位姿优化问题,用血管分割轮廓与可微渲染出的 silhouette 做像素级损失并反传更新位姿。真实与合成数据上的初步定性和定量实验显示方法可实现较稳健的位姿估计与重建,但结果仍属早期验证,真实场景分割误差和投影几何偏差的影响尚未充分展开。

Light3R-SfM: Towards Feed-forward Structure-from-Motion Figure 1
arXiv preprint2025-01-24

Light3R-SfM: Towards Feed-forward Structure-from-Motion

Sven Elflein, Qunjie Zhou, Sérgio Agostinho, Laura Leal-Taixé NVIDIA

NVIDIA Vector Institute University of Toronto

6D位姿估计

Light3R-SfM针对传统/DUSt3R式SfM依赖密集匹配与全局优化、在大规模无序图像集上耗时耗显存的问题,提出前馈端到端框架:用潜空间注意力做隐式全局对齐,并以检索分数引导的最短路径树构建稀疏场景图,减少冗余点图解码。实验显示其位姿精度接近优化式SfM且优于Spann3R,200张图重建约33秒,相比MASt3R-SfM约27分钟有49倍以上加速。

Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction Figure 1
arXiv preprint2025-01-24

Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction

Bo Sun, Hao Kang, Li Guan, Haoxiang Li, Philippos Mordohai, Senior Member, IEEE, Gang Hua, Fellow

P. Mordohai is with Stevens Institute of Technology, Hoboken, New Jersey, H. Li is with Pixocial Technology, Bellevue, Washington, L. Guan is with Meta Reality Labs, Menlo Park, California

6D位姿估计类别级位姿三维重建

Glissando-Net面向单张RGB图像下类别级新实例的6D位姿与三维形状联合恢复,动机是缓解以往方法多只做实例级位姿或单独重建的问题。其核心是联合训练RGB与点云双自编码器,通过特征变换在解码阶段融合2D-3D信息,并让位姿预测利用训练期点云先验;测试时仅需RGB。实验和消融显示其在真实基准上的位姿估计与形状重建均优于CPS等方法,但顶部遮挡和异常形状仍较困难。

LiDAR-Based Vehicle Detection and Tracking for Autonomous Racing Figure 1
arXiv preprint2025-01-24

LiDAR-Based Vehicle Detection and Tracking for Autonomous Racing

Marcello Cellina, Matteo Corno, Sergio Matteo Savaresi

Manuscript received April 19, 2005; revised August

6D位姿估计点云

面向自动赛车中高速超车对低延迟、稳定对手车感知的需求,本文避开依赖标注数据的学习式方案,构建基于三路 LiDAR 的在线检测跟踪流水线:快速无结构点云分割、针对赛车非规则外形的多假设 L-shape 2D 位姿估计,以及可变步长多目标跟踪。实验显示该系统具备在线效率和鲁棒性,已支撑 PoliMOVE 赛车在超过 250–275 km/h 场景下完成全自主超车。

Optimizing Human Pose Estimation Through Focused Human and Joint Regions Figure 1
the AAAI Conference on Artificial Intelligence 20252025-01-24

Optimizing Human Pose Estimation Through Focused Human and Joint Regions

Yingying Jiao, Zhigang Wang, Zhenguang Liu : 1, Shaojing Fan, Sifan Wu : 1, Zheqi Wu, Zhuoyue Xu

Jilin University, Zhejiang Gongshang University, National University of Singapore

6D位姿估计人体姿态

针对视频人体姿态估计易被背景、他人运动和运动模糊干扰,且 Transformer 全局建模缺乏精细局部定位的问题,论文提出 VREMD 双流框架:用 Human-Keypoint Mask 逐步聚焦人体与关节区域,并以可变形交叉注意力和双向运动解耦提取目标相关时空线索。在 PoseTrack2017/2018/2021 上达到 SOTA,其中 PoseTrack2017 腕部 mAP 提升至 84.8。

Causal-Inspired Multitask Learning for Video-Based Human Pose Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20252025-01-24

Causal-Inspired Multitask Learning for Video-Based Human Pose Estimation

Haipeng Chen, Sifan Wu, Zhigang Wang : 1, Yifang Yin, Yingying Jiao : 1, Yingda Lyu : 1, Zhenguang Liu

Jilin University, Zhejiang Gongshang University, Agency for Science, Technology and Research, Institute for Infocomm Research, Jilin Province Science and Technology Department, Zhejiang Sci-Tech University

6D位姿估计人体姿态

针对视频人体姿态估计在遮挡、失焦等场景中缺乏关节因果推理、且难解释的问题,论文提出 CM-Pose:用掩码重建与去噪两类自监督辅助任务训练时空因果建模能力,并通过 Token 因果重要性选择与非因果 token 聚类突出关键点相关特征、压缩背景冗余。实验在 PoseTrack2017/2018/2021 上超过现有方法,并显示更好的复杂场景鲁棒性。

HAMMER: Heterogeneous, Multi-Robot Semantic Gaussian Splatting Figure 1
IEEE Robotics and Automation Letters2025-01-24

HAMMER: Heterogeneous, Multi-Robot Semantic Gaussian Splatting

Javier Yu, Timothy Chen, Mac Schwager

Vaughn College of Aeronautics and Technology, Stanford University

6D位姿估计机器人操作三维重建高斯泼溅

HAMMER针对异构多机器人实时构建统一语义三维地图时,坐标系不一致、数据异步且算力受限的问题,采用中心服务器结合ROS数据流,一次性完成无先验相对位姿的跨机器人帧对齐,并在线训练带CLIP语义的3D Gaussian Splatting地图。实验显示其在Replica和真实3–4设备部署中优于或接近多机器人建图基线,计算时间低于十分之一,真实场景新视角重建MSE提升超过40%,并支持语言导航等下游任务。

Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass Figure 1
arXiv preprint2025-01-23

Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass

Jianing Yang, Alexander Sax, Kevin J. Liang, Mikael Henaff, Hao Tang Ang Cao, Joyce Chai, Franziska Meier, Matt Feiszli Meta FAIR

♣ Meta FAIR University of Michigan

6D位姿估计三维重建

Fast3R针对DUSt3R等多视角重建方法依赖成对推理和全局对齐、随图像数增长易变慢甚至显存溢出的瓶颈,将点图回归扩展为可一次前向处理无序多图的Transformer框架,使各视角全局互相注意并省去迭代对齐。实验显示其在相机位姿估计和三维重建上兼顾精度与速度,CO3Dv2上15度内位姿准确率达99.7%,相对DUSt3R全局对齐错误降低约14倍,并可推广到训练时未见的更多视角。

EgoHand: Ego-centric Hand Pose Estimation and Gesture Recognition with Head-mounted Millimeter-wave Radar and IMUs Figure 1
arXiv preprint2025-01-23

EgoHand: Ego-centric Hand Pose Estimation and Gesture Recognition with Head-mounted Millimeter-wave Radar and IMUs

Yizhe Lv 0009-0005-3319-7561, Tingting Zhang 0009-0007-2157-4360, Zhijian Wang 0009-0009-8143-2860, Yunpeng Song 0000-0002-4186-0408, Han Ding 0000-0002-5274-7988, Jinsong Han 0000-0001-5064-1955, Fei Wang 0000-0002-0750-6990

6D位姿估计手部姿态

针对固定毫米波雷达限制用户活动范围、头戴自我视角又易受头部运动干扰的问题,mmEgoHand将头戴毫米波雷达与IMU同步融合,用端到端Transformer和双解码/匈牙利匹配同时支持单手与双手3D关键点估计,并以手姿态作为手势识别中间表征。10名受试者、8类手势和站坐躺姿态实验中,MPJPE为72.73mm,优于仅雷达的96.42mm,手势识别达90.8%。

VIGS SLAM: IMU-based Large-Scale 3D Gaussian Splatting SLAM Figure 1
arXiv preprint2025-01-23

VIGS SLAM: IMU-based Large-Scale 3D Gaussian Splatting SLAM

Gyuhyeon Pak, Euntai Kim

Engineering, Yonsei University, Seoul 03722, South Korea

6D位姿估计相机位姿三维重建高斯泼溅

针对现有 3DGS SLAM 在大场景中因密集光度跟踪需高频关键帧、内存与计算压力大的问题,VIGS SLAM 将 RGB-D 与 IMU 融合,把 IMU 预积分用于深度点云的 GICP 跟踪初值,而非直接图像匹配,从而拉大关键帧间距并保持前后端关联。实验显示其可从房间级扩展到大规模室内环境,位姿与建图表现接近主流 SLAM。

Deep Learning-Based Image Recovery and Pose Estimation for Resident Space Objects Figure 1
arXiv preprint2025-01-22

Deep Learning-Based Image Recovery and Pose Estimation for Resident Space Objects

Louis Aberdeen, Mark Hansen, Melvyn L. Smith, Centre for Machine Vision, Coldharbour Ln, Stoke Gifford, Bristol BS16 1QY

Louis Aberdeen, Mark Hansen, Melvyn L. Smith, Lyndon Smith

6D位姿估计

面向地面观测RSO受大气、距离和运动导致图像模糊且真实训练数据稀缺的问题,论文以ISS为例构建物理渲染合成数据,并将图像复原与ResNet50位姿回归结合;对比显示单独使用U-Net复原反而效果最佳,使图像恢复MSE平均降低97.28%,角度误差平均降低71.9%。

BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation Figure 1
arXiv preprint2025-01-21

BlanketGen2-Fit3D: Synthetic Blanket Augmentation Towards Improving Real-World In-Bed Blanket Occluded Human Pose Estimation

Tamás Karácsony, João Carmona, João Paulo Silva Cunha

6D位姿估计人体姿态仿真到现实

针对临床床上监护中被毯子遮挡导致RGB人体姿态标注稀缺、模型难泛化的问题,论文提出BlanketGen2,用SMPL人体网格进行物理布料仿真并分离仿真与渲染,构建121万帧BG2-Fit3D合成遮挡数据来微调ViTPose-B。混合训练在合成遮挡集上达到0.977 PCK、0.149 NME,较仅Fit3D训练提升4.4% PCK;在真实SLP毯子遮挡图像上也提升2.3% PCK,说明增益可能主要来自有针对性的仿真数据扩增。

Refinement Module based on Parse Graph of Feature Map for Human Pose Estimation Figure 1
arXiv preprint2025-01-19

Refinement Module based on Parse Graph of Feature Map for Human Pose Estimation

Shibang Liu, Xuemei Xie

6D位姿估计人体姿态

针对解析图式人体姿态方法参数冗余、结构固定且难以迁移到现有网络的问题,论文提出可插拔的 RMPG 模块,将特征图递归地自顶向下分解为子节点,再结合上下文自底向上组合,以同时建模身体层级与部件/关节关系。实验显示其可嵌入多种 HPE 架构并带来性能提升,同时以更少参数实现结构化特征细化。

RoMu4o: A Robotic Manipulation Unit For Orchard Operations Automating Proximal Hyperspectral Leaf Sensing Figure 1
arXiv preprint2025-01-18

RoMu4o: A Robotic Manipulation Unit For Orchard Operations Automating Proximal Hyperspectral Leaf Sensing

Mehrad Mortazavi, David J. Cappelleri, Reza Ehsani

6D位姿估计机器人操作

面向果园叶片级高光谱检测中人工采样效率低、野外光照和植株结构复杂的问题,RoMu4o将地面平台、6DOF机械臂、视觉感知、叶片3D结构提取与6D位姿估计、约束避障规划及集成光源高光谱末端执行器串联成闭环操作系统。在真实木兰与开心果场景测试中,单叶/批次采样实验室成功率95%、野外79%,开心果园自主抓取并测量总体成功率70%。

landmarker: a Toolkit for Anatomical Landmark Localization in 2D/3D Images Figure 1
arXiv preprint2025-01-17

landmarker: a Toolkit for Anatomical Landmark Localization in 2D/3D Images

Belgium jef.jonkers@ugent.be, Imaging, Orthopedics, Rehabilitation, Belgium luc.duchateau@ugent.be, Belgium glenn.vanwallendael@ugent.be, Belgium sofie.vanhoecke@ugent.be

IDLab, Department of Electronics and Information Systems, Ghent University, Belgium, Biometrics Research Group, Department of Morphology, Imaging, Orthopedics, Ghent University - imec, Belgium

6D位姿估计

面向医学2D/3D图像中的解剖标志点定位,作者指出通用姿态估计工具难以处理DICOM/NIfTI、3D输入、医学增强和可插拔训练评估流程。landmarker以PyTorch/MONAI构建模块化工具链,支持坐标/热图回归、静态与自适应热图、解码、预处理、可视化和基准数据导入。主要结果是提供可安装的开源软件以降低方法开发成本;文中未充分说明相对现有框架的定量精度增益。

A New Teacher-Reviewer-Student Framework for Semi-supervised 2D Human Pose Estimation Figure 1
arXiv preprint2025-01-16

A New Teacher-Reviewer-Student Framework for Semi-supervised 2D Human Pose Estimation

Wulian Yun, Mengshi Qi, Fei Peng, Huadong Ma

6D位姿估计人体姿态

针对2D人体姿态估计对标注依赖强、半监督教师-学生训练又容易忽略历史参数信息的问题,论文提出Teacher-Reviewer-Student框架,用Reviewer通过EMA保存师生网络的历史知识并提供额外监督,同时引入多层特征热图学习和Keypoint-Mix关键点扰动增强。公开数据集实验显示其相较现有半监督方法有明显提升,但具体增益在多模块间的拆分仍需结合消融判断。

Towards Robust and Realistic Human Pose Estimation via WiFi Signals Figure 1
arXiv preprint2025-01-21

Towards Robust and Realistic Human Pose Estimation via WiFi Signals

Yang Chen, Geo-Informatics

Department of Computing, The Hong Kong Polytechnic University, Department of Land Surveying and Geo-Informatics, The Hong Kong Polytechnic University

6D位姿估计人体姿态

面向视觉姿态估计易受遮挡、光照和隐私限制的问题,论文聚焦 WiFi 人体姿态在跨环境泛化差和骨架拓扑失真两类痛点。DT-Pose 将任务拆为域一致表征学习与拓扑约束解码:用掩码重建、时间对比学习和均匀性正则学习运动相关 WiFi 表征,再以任务提示结合 GCN 与 Transformer 建模关节局部及全局关系。在 MM-Fi、WiPose、Person-in-WiFi-3D 等数据集上,方法在 2D/3D 姿态估计中优于既有方法。

RoboReflect: Robotic Reflective Reasoning for Grasping Ambiguous-Condition Objects Figure 1
arXiv preprint2025-01-16

RoboReflect: Robotic Reflective Reasoning for Grasping Ambiguous-Condition Objects

Zhen Luo, Yixuan Yang, Yanfu Zhang, Feng Zheng

Department of Computer Science and Engineering, SUStech, China, Institute of Multiple Agents and Embodied Intelligence, Peng Cheng Laboratory, China, Shanghai Innovation Institute, China, Department of Computer Science and Engineering, University of Warwick, Coventry, UK, Department of Computer Science, College of William and Mary, USA

6D位姿估计机器人操作

面向空纸巾袋、变形瓶等“同名但物理状态不同”的模糊条件物体,RoboReflect指出一次性6D抓取估计或LLM规划难以判断正确抓取点且常需人工纠错。其核心是用LVLM在执行后判定成败,结合CoT反思、讨论校验和记忆模块迭代修正策略。作者在三类八种常见物体上测试,报告其优于AnyGrasp及GPT-4V驱动的ReKep等方法,但具体增益幅度需看实验细节。

BRIGHT-VO: Brightness-Guided Hybrid Transformer for Visual Odometry with Multi-modality Refinement Module Figure 1
arXiv preprint2025-01-16

BRIGHT-VO: Brightness-Guided Hybrid Transformer for Visual Odometry with Multi-modality Refinement Module

Dongzhihan Wang, Yang Yang, Xuyang Chen

Shanghai University

6D位姿估计相机位姿

针对视觉里程计在低照度下特征可见性差、匹配困难导致位姿漂移的问题,BRIGHT-VO用亮度估计引导的混合Transformer提取前端视觉特征,并在后端融合IMU进行位姿图优化迭代修正;同时构建CARLA合成低光KiC4R数据集。实验称其在KITTI和KiC4R上达到SOTA,普通户外与低光场景位姿精度分别平均提升20%和25%,但具体增益中数据集与模型各自贡献仍需进一步拆解。

Poseidon: A ViT-based Architecture for Multi-Frame Pose Estimation with Adaptive Frame Weighting and Multi-Scale Feature Fusion Figure 1
arXiv preprint2025-01-14

Poseidon: A ViT-based Architecture for Multi-Frame Pose Estimation with Adaptive Frame Weighting and Multi-Scale Feature Fusion

Cesare Davide Pace, Alessandro Marco De Nunzio, Claudio De Stefano, Francesco Fontanella, Mario Molinara

6D位姿估计

针对单帧 ViTPose 难以利用视频时序、在遮挡和连续动作中稳定性不足的问题,Poseidon 将其扩展为多帧架构,通过自适应帧加权筛选关键上下文帧,多尺度特征融合结合浅层细节与深层语义,并用跨注意力交换中心帧与邻帧信息。实验在 PoseTrack21/18 上分别达到 88.3/87.8 mAP,报告优于已有方法。

Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation Figure 1
arXiv preprint2025-01-14

Leveraging 2D Masked Reconstruction for Domain Adaptation of 3D Pose Estimation

Hansoo Park, Chanwoo Kim, Jihyeon Kim, Hoseong Cho, Nhat Nguyen Bao Truong, Taehwan Kim, Seungryul Baek

6D位姿估计仿真到现实三维重建

针对RGB三维姿态估计在源域到目标域分布差异下泛化变差、目标域3D标注难获取的问题,本文将无监督域适应用于位姿估计:先用源域有标注数据与目标域无标注数据进行MIM预训练,并通过前景中心重建削弱背景域偏移;再在微调阶段用目标域注意力正则缓解遗忘。作者在人和手部跨域姿态估计实验中报告均达到SOTA。

Predicting 4D Hand Trajectory from Monocular Videos Figure 1
arXiv preprint2025-01-14

Predicting 4D Hand Trajectory from Monocular Videos

Yufei Ye, Yao Feng, Omid Taheri, Haiwen Feng, Shubham Tulsiani

Carnegie Mellon University Max Planck Institute for Intelligent Systems

6D位姿估计手部姿态

本文针对单目操作视频中手部姿态虽可逐帧估计、但难以形成全局一致4D轨迹的问题,提出HaPTIC:在强单图Transformer手模估计器上加入跨帧自注意力和全局上下文交叉注意力,并混合图像与少量视频数据训练。结果显示其在自我/第三人称视频的全局轨迹精度上显著优于现有提升或优化方案,同时保持接近或优于单图方法的2D对齐表现。

A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation Figure 1
arXiv preprint2025-01-14

A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation

S. Landgraf, R. Qin, M. Ulrich

Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology (KIT), Germany, The Ohio State University, Columbus, Ohio, United States

6D位姿估计彩色深度

面向机器人/6D位姿等依赖可靠彩色深度的场景,论文关注单目度量深度基础模型虽精度高但易过度自信、难安全部署的问题。作者将 DepthAnythingV2 与五类像素级不确定性估计方法结合,并在室内、城市、物体与航拍四类数据上比较不同编码器。主要结果显示,GNLL 微调在保持深度精度和训练/推理开销接近基线的同时,给出更可信的不确定性,是较实用的方案。

AgentPose: Progressive Distribution Alignment via Feature Agent for Human Pose Distillation Figure 1
arXiv preprint2025-01-14

AgentPose: Progressive Distribution Alignment via Feature Agent for Human Pose Distillation

Feng Zhang2, Jinwei Liu2, Xiatian Zhu3, Lei Chen2

Nanjing University of Posts and Telecommunications, Nanjing, China, Surrey Institute for People-Centred, Artificial Intelligence, University of Surrey Guildford, United Kingdom

6D位姿估计人体姿态

针对人体姿态估计中蒸馏轻量模型常受师生容量差距影响、强教师反而可能损害学生的问题,AgentPose引入基于扩散模型的轻量特征代理,通过噪声扰动把师生特征推向中间分布,并在反向VP-SDE中动态校准学生特征分布,另用自编码器降维减负。COCO实验显示其优于既有姿态蒸馏方法,在容量差距较大时提升更明显。

Robust Low-Light Human Pose Estimation through Illumination-Texture Modulation Figure 1
arXiv preprint2025-01-14

Robust Low-Light Human Pose Estimation through Illumination-Texture Modulation

Feng Zhang, Ze Li, Xiatian Zhu, Lei Chen

Nanjing University of Posts and Telecommunications, Nanjing, China, Surrey Institute for People-Centred, Artificial Intelligence, University of Surrey Guildford, United Kingdom

6D位姿估计人体姿态

针对极暗场景中低可见度与高 ISO 噪声导致人体姿态估计特征退化的问题,论文不再做整图像素增强,而是用拉普拉斯金字塔频率解耦:低频分支进行动态光照校正以保留语义,高频分支利用低秩结构做多尺度去噪以恢复纹理,并与姿态网络端到端联合训练。实验显示该方法在多种低光条件下优于现有方法,但具体增益在不同模块间的归因仍需结合消融细节判断。

BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videos Figure 1
arXiv preprint2025-01-14

BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videos

Farnoosh Koleini, Muhammad Usama Saleem, Pu Wang, Hongfei Xue, Ahmed Helmy

University of North Carolina at Charlotte

6D位姿估计医学/手术

BioPose针对单目3D人体姿态虽易部署但SMPL等模型解剖结构过简、难满足康复/医疗与机器人中生物力学精度的问题,先用多查询可变形Transformer恢复细粒度人体网格,再将网格顶点作为虚拟标记,经NeurIK在解剖约束下回归3D姿态,并在推理时用2D观测细化查询。实验显示其在人网格恢复上优于现有方法,整体性能接近多相机标记式金标准。

Efficiently Closing Loops in LiDAR-Based SLAM Using Point Cloud Density Maps Figure 1
arXiv preprint2025-01-13

Efficiently Closing Loops in LiDAR-Based SLAM Using Point Cloud Density Maps

Saurabh Gupta affiliationmark, Tiziano Guadagnino affiliationmark, Benedikt Mersch affiliationmark, Niklas Trekel affiliationmark, Meher V. R. Malladi affiliationmark, Cyrill Stachniss affiliationmark

University of Bonn, Center for Robotics, Lamarr Institute for Machine Learning and Artificial Intelligence

6D位姿估计相机位姿点云

针对 LiDAR SLAM 仅靠里程计易累积漂移、回环检测又受传感器差异和重复场景干扰的问题,论文将局部点云先做地面配准,再生成保密度的 BEV 密度图,用 ORB 特征与 HBST 快速检索,并通过自相似剪枝和 RANSAC 几何验证恢复 3D 对齐。多组公开与自采数据表明,该方法可跨扫描模式、视场和平台检测回环,支持长期定位与跨平台多地图对齐。

Collaborative Learning for 3D Hand-Object Reconstruction and Compositional Action Recognition from Egocentric RGB Videos Using Superquadrics Figure 1
the AAAI Conference on Artificial Intelligence 20252025-01-13

Collaborative Learning for 3D Hand-Object Reconstruction and Compositional Action Recognition from Egocentric RGB Videos Using Superquadrics

Tze Ho Elden Tse, Runyang Feng, Linfang Zheng, Jiho Park, Yixing Gao, Jihie Kim, Ales̆ Leonardis, Hyung Jin Chang

University of Birmingham, Jilin University, Jilin Medical University, Dongguk University

6D位姿估计手部姿态三维重建

针对第一视角手物交互中3D框难以表达物体形状与运动、且测试依赖模板导致未见物体泛化差的问题,论文用超二次曲面作为紧凑3D物体中间表示,并设计Transformer式协同学习框架显式建模手与物的几何关系,同时为H2O和FPHA构造动词-名词组合不重叠的组合泛化划分;实验显示其在官方与组合动作识别设置下均优于现有方法,并支持无模板物体重建。

eKalibr: Dynamic Intrinsic Calibration for Event Cameras From First Principles of Events Figure 1
IEEE Robotics and Automation Letters2025-01-10

eKalibr: Dynamic Intrinsic Calibration for Event Cameras From First Principles of Events

Shuolong Chen, Xingxing Li, Liu Yuan, Ziao Liu

Wuhan University, Institute of Geodesy and Geophysics

6D位姿估计事件相机

事件相机仅输出异步事件时,传统基于图像或LED板的内参标定要么依赖重建图像、精度受噪声影响,要么硬件复杂且不适合动态标定。eKalibr从事件产生机理出发,利用普通圆点标定板,通过法向光流筛选圆边事件、聚类匹配同一圆并估计时变椭圆,最终同步圆心完成网格识别与内参求解。实验表明其在圆点模式提取和内参标定上有效,代码与数据开源。

Relative Pose Estimation through Affine Corrections of Monocular Depth Priors Figure 1
arXiv preprint2025-01-09

Relative Pose Estimation through Affine Corrections of Monocular Depth Priors

Yifan Yu, Shaohui Liu, Rémi Pautrat, Marc Pollefeys, Viktor Larsson ETH Zurich, PICO, Microsoft Spatial AI Lab

ETH Zurich, Microsoft Spatial AI Lab, Lund University

6D位姿估计相机位姿彩色深度

这篇论文关注单目深度先验虽能提供跨视图几何约束、却因尺度与平移歧义难以直接提升相对位姿估计的问题。作者将每幅图的深度显式建模为独立仿射校正,提出适用于已标定、共享焦距和双未知焦距场景的求解器,并与经典点匹配/极线约束组成混合鲁棒估计流程。多数据集结果显示,该方法在标定与非标定设置下均优于关键点和PnP基线,且对不同匹配器与MDE模型都有稳定增益。

From Simple to Complex Skills: The Case of In-Hand Object Reorientation Figure 1
arXiv preprint2025-01-09

From Simple to Complex Skills: The Case of In-Hand Object Reorientation

Haozhi Qi, Brent Yi, Mike Lambeta, Yi Ma, Roberto Calandra, Jitendra Malik UC Berkeley, FAIR at Meta, TU Dresden

UC Berkeley FAIR at Meta TU Dresden Centre for Tactile Internet with Human-in-the-Loop

6D位姿估计手部姿态

针对灵巧手任务每次从零做 sim-to-real 需大量奖励设计和调参的问题,本文把已学会的手内旋转技能作为低层控制器,上层策略根据环境与低层反馈选择旋转轴并输出残差修正,同时用本体感知、技能预测和控制误差做可泛化位姿估计。实验显示该层级方案比从零训练收敛更快、OOD 鲁棒性更好,并能迁移到真实环境重定向对称或无纹理物体。

Towards Balanced Continual Multi-Modal Learning in Human Pose Estimation Figure 1
arXiv preprint2025-01-11

Towards Balanced Continual Multi-Modal Learning in Human Pose Estimation

Mengshi Qi, Jiaxuan Peng, Xianlin Zhang, Switching Technology, BUPT, China School of Digital Media, Design Art

State Key Laboratory of Networking and Switching Technology, BUPT, China, School of Digital Media & Design Art, BUPT, China, Beijing Key Laboratory of Intelligent Computing and Experience Innovation for Sci-Fi Visual Spaces

6D位姿估计人体姿态

针对RGB人体姿态估计在遮挡、隐私场景下受限,以及多传感器融合中强模态压制弱模态的问题,本文面向RGB、LiDAR、毫米波和WiFi的3D HPE提出平衡训练框架:用Shapley值结合相关性评估各模态贡献,并以FIM引导的AWC正则约束早期主导模态更新、无需额外分支。MM-Fi实验显示该策略在复杂条件下提升了三维姿态估计表现。

KN-LIO: Geometric Kinematics and Neural Field Coupled LiDAR-Inertial Odometry Figure 1
arXiv preprint2025-01-08

KN-LIO: Geometric Kinematics and Neural Field Coupled LiDAR-Inertial Odometry

Zhong Wang, Lele Ren, Yue Wen, Hesheng Wang

6D位姿估计人体姿态相机位姿点云

针对传统 LIO 偏重定位、地图稀疏,而纯 LiDAR 神经场在手持/无人机等高动态场景中鲁棒性不足的问题,KN-LIO 将 IMU 几何运动学与在线 SDF 神经场通过误差状态 Kalman 滤波半耦合/紧耦合融合,并支持异步多 LiDAR。实验显示其位姿精度达到或优于现有方法,稠密建图质量优于纯 LiDAR 神经映射方案。

OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints Figure 1
arXiv preprint2025-01-07

OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints

Mingjie Pan, Jiyao Zhang, Tianshu Wu, Yinghao Zhao, Wenlong Gao, Hao Dong CFCS, School of CS, PKU-AgiBot Lab

CFCS, School of CS, Peking University PKU-AgiBot Lab AgiBot

6D位姿估计机器人操作

OmniManip针对VLM具备常识推理但缺乏精细3D空间理解、VLA又依赖昂贵机器人数据且泛化受限的问题,提出以物体规范空间中的交互点和方向作为中间表示,将功能可供性转化为空间约束;系统结合交互渲染/重采样的规划闭环与6D位姿跟踪执行闭环,无需微调VLM。实验显示其在多类操作任务上具备较强零样本泛化,并可用于自动生成仿真操作数据。

MC-VTON: Minimal Control Virtual Try-On Diffusion Transformer Figure 1
arXiv preprint2025-01-10

MC-VTON: Minimal Control Virtual Try-On Diffusion Transformer

Junsheng Luan, Guangyuan Li

Zhejiang University

6D位姿估计

针对扩散虚拟试衣依赖额外参考网络、姿态/解析等条件且推理步数多的问题,MC-VTON利用DiT/FLUX自身骨干接入服装图和遮罩人物图,通过VAE特征与可学习位置嵌入实现轻量条件融合,并用蒸馏降步数;实验显示在更少输入和参数下提升细节保真,8步生成1024×768图像约5.23秒,但具体增益中仍可能包含骨干 scaling 影响。

TexHOI: Reconstructing Textures of 3D Unknown Objects in Monocular Hand-Object Interaction Scenes Figure 1
arXiv preprint2025-01-07

TexHOI: Reconstructing Textures of 3D Unknown Objects in Monocular Hand-Object Interaction Scenes

Alakh Aggarwal, Ningna Wang, Xiaohu Guo

6D位姿估计未知物体手部姿态

TexHOI面向单目手物交互中未知刚体的三维纹理重建,针对手部遮挡、阴影和间接反射易被“烘焙”进物体纹理并干扰6D位姿的问题,采用两阶段框架:先用组合NeRF联合优化手和物体位姿,再以球面高斯和108个可参数化手部球体近似可见性,在PBR中分离反照率、粗糙度、高光和手部光照影响。实验显示其在动态手物场景中获得更干净、高细节的纹理,优于现有重建方法,但静态接触时仍可能混入手部痕迹。

Mobile Augmented Reality Framework with Fusional Localization and Pose Estimation Figure 1
arXiv preprint2025-01-06

Mobile Augmented Reality Framework with Fusional Localization and Pose Estimation

Songlin HOU : 2, Fangzhou LIN, Yunmei HUANG : 2, Zhe PENG, Bin XIAO

Department of Computer Science, Department of Computer Science Worcester Polytechnic Institute Worcester Polytechnic Institute, Department of Robotics Engineering, Department of Robotics Engineering Worcester Polytechnic Institute Worcester Polytechnic Institute, Unprecedented-scale Data Analytics Center, Unprecedented-scale Data Analytics Center Tohoku University Tohoku University, Department of Forestry and Natural Resources, Department of Forestry and Natural Resources Purdue University Purdue University, Department of Computing, Department of Computing The Hong Kong Polytechnic University The Hong Kong Polytechnic University, Hong Kong 999-077, China

6D位姿估计

面向室内移动 AR 中 GPS 失效、纯视觉需近距离持续跟踪标记且体验差的问题,论文提出在普通移动设备上融合 Wi‑Fi/图像等线索的定位框架,并配合新的姿态估计实现以提高匹配率和显示精度。实验显示其优于仅用图像或 Wi‑Fi 的方案,在 0.5m 采样网格下平均定位误差为 0.61–0.81m、匹配率 77%–82%;但具体增益来源和姿态估计细节文中未充分说明。

SurgRIPE challenge: Benchmark of Surgical Robot Instrument Pose Estimation Figure 1
arXiv preprint2025-01-06

SurgRIPE challenge: Benchmark of Surgical Robot Instrument Pose Estimation

Haozheng Xu, Alistair Weld, Chi Xu, Alfie Roddan, João Cartucho, Mert Asim Karaoglu, Alexander Ladikos, Yangke Li, Yiping Li, Daiyun Shen, Geonhee Lee, Seyeon Park, Jongho Shin, Lucy Fothergill, Dominic Jones, Pietro Valdastri, Duygu Sarikaya, Stamatia Giannarou

The Hamlyn Centre for Robotic Surgery, Imperial College London, United Kingdom, Technical University of Munich, Munich, Germany, Eindhoven University of Technology, Eindhoven, Netherlands, Department of Engineering Physics, Tsinghua University, Beijing, China, Department of Transdisciplinary Medicine, Seoul National University Hospital, South Korea, School of Computing, University of Leeds, United Kingdom, STORMLab, University of Leeds, United Kingdom

6D位姿估计机器人操作数据集/基准医学/手术

面向机器人微创手术中器械需毫米级、无标记6D位姿估计但真实带GT数据稀缺的问题,SurgRIPE构建了基于达芬奇内窥镜的LND/MBF视频基准:先用KeyDot标记生成精确GT,再以图像修复去除标记线索,并提供遮挡/非遮挡场景、3D模型与评测工具。六支参赛方法显示深度视觉方案在复杂手术场景中可行,其中候选假设类IGTUM整体最稳健,但遮挡、可解释性和跨器械泛化仍是主要瓶颈。

HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos Figure 1
arXiv preprint2025-01-06

HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos

Jinglei Zhang, Jiankang Deng, Chao Ma, Imperial College London @sjtu.edu.cn, @imperial.ac.uk

Shanghai Jiao Tong University, Imperial College London

6D位姿估计手部姿态三维重建

HaWoR针对第一视角视频中手和相机同时运动、遮挡及出视野导致传统相机坐标手部重建难以得到真实世界轨迹的问题,将任务拆为相机系手部运动重建与世界系相机轨迹估计,并结合Transformer手部模型、运动补全网络和排除手部区域的自适应DROID-SLAM/尺度归一化。实验显示其在多个第一视角基准上提升世界系手部轨迹与相机轨迹精度,且较优化式基线更快,但仍未达到实时。

Spiking monocular event based 6D pose estimation for space application Figure 1
arXiv preprint2025-01-06

Spiking monocular event based 6D pose estimation for space application

Jonathan Courtois, Benoit Miramond, Alain Pegatoquet

6D位姿估计事件相机

面向在轨服务和主动碎片清除中受限算力、功耗且光照复杂的航天器相对位姿估计,本文探索事件相机与脉冲神经网络的全事件式单目6D方案。其核心是基于SEENIC真实事件数据构建小型端到端S2E2网络,并用事件帧序列直接回归平移和旋转;在实验中约达到21cm位置误差和14°姿态误差,表明可行但精度仍初步,增益来源与真实任务泛化仍需进一步说明。

Universal Features Guided Zero-Shot Category-Level Object Pose Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20252025-01-06

Universal Features Guided Zero-Shot Category-Level Object Pose Estimation

Wentian Qu, Chenyu Meng, Heng Li, Jian Cheng, Cuixia Ma, Hongan Wang, Xiao Zhou, Xiaoming Deng, Ping Tan : 1

Institute of Software, University of Hong Kong, University of Chinese Academy of Sciences, Hong Kong University of Science and Technology, Chinese Academy of Sciences, Aerospace Information Research Institute

6D位姿估计物体位姿类别级位姿

针对类别级6D位姿方法在未见类别上通常需要重训、且仅靠2D通用特征易受大姿态差和类内形状差影响的问题,本文提出零样本RGB-D框架:先融合DINOv2/Stable Diffusion等2D特征迭代建立稀疏对应求粗位姿,再用预训练3D特征的密集对齐联合细化位姿与参考形状。在REAL275和Wild6D未见类别评测中优于既有方法,但计算开销和遮挡仍是主要限制。

Unsupervised Domain Adaptation for Occlusion Resilient Human Pose Estimation Figure 1
arXiv preprint2025-01-06

Unsupervised Domain Adaptation for Occlusion Resilient Human Pose Estimation

Arindam Dutta, Sarosij Bose, Saketh Bachu, Calvin-Khang Ta, Konstantinos Karydis, Amit K. Roy-Chowdhury

Saketh Bachu, Amit K. Roy-Chowdhury

6D位姿估计人体姿态仿真到现实

针对合成到真实或跨域人体姿态估计在目标域遮挡下易产生错误、解剖不合理关键点的问题,OR-POSE将Mean Teacher自训练用于伪标签迭代细化,并加入遮挡增强、学习到的人体姿态先验和按可见度递进的课程学习,以减少重遮挡伪标签带来的误差累积。实验显示其在遮挡人体姿态基准上较同类UDA方法约提升7%,同时在无遮挡场景保持相近性能。

WorldPose: A World Cup Dataset for Global 3D Human Pose Estimation Figure 1
Lecture notes in computer science2025-01-06

WorldPose: A World Cup Dataset for Global 3D Human Pose Estimation

Tianjian Jiang, Johsan Billingham, Sebastian Müksch, Juan Zarate, Nicolas Evans, Martin R. Oswald, Marc Pollefeys, Otmar Hilliges, Manuel Kaufmann, Jie Song

ETH Zurich, University of Amsterdam, Microsoft (United States)

6D位姿估计人体姿态数据集/基准

针对现有3D人体姿态数据多局限于单人、室内或局部坐标,难以评估大范围多人全局轨迹的问题,WorldPose利用2022世界杯多固定机位与转播运动相机,构建含SMPL标注的野外足球多人数据集,并通过静态相机精标定、2D关键点跟踪三角化和球员/场线约束的转播相机标定获得全局姿态。数据覆盖80余段序列、约250万姿态和120 km轨迹,管线相对Vicon平均关节误差约8 cm,现有全局姿态方法在该基准上表现仍明显受限。

LP-ICP: General Localizability-Aware Point Cloud Registration for Robust Localization in Extreme Unstructured Environments Figure 1
arXiv preprint2025-01-05

LP-ICP: General Localizability-Aware Point Cloud Registration for Robust Localization in Extreme Unstructured Environments

Haosong Yue, Qingyuan Xu, Fei Chen, Jia Pan, Weihai Chen

6D位姿估计点云

面向月面、隧道等几何结构稀疏场景中 ICP 沿退化方向易漂移的问题,LP-ICP 将点到线与点到面约束共同纳入可定位性分析,估计单个对应约束在特征方向上的贡献,并按完全、部分、不可定位三类加入软/硬约束限制 6D 位姿更新。仿真与真实数据上精度达到或优于现有退化处理方法,但部分可定位方向的稳定性与泛化性仍需进一步验证。

ROLO-SLAM: Rotation-Optimized LiDAR-Only SLAM in Uneven Terrain with Ground Vehicle Figure 1
Journal of Field Robotics2025-01-04

ROLO-SLAM: Rotation-Optimized LiDAR-Only SLAM in Uneven Terrain with Ground Vehicle

Yinchuan Wang, Bin Ren, Xiang Zhang, Pengyu Wang, Chaoqun Wang, Rui Song, Yibin Li, Max Q.-H. Meng

Shandong University, Hong Kong University of Science and Technology, Southern University of Science and Technology, University of Hong Kong

6D位姿估计相机位姿点云

针对地面车辆在崎岖地形中使用纯 LiDAR SLAM 易出现垂直方向漂移、导致地图倾斜变形的问题,ROLO-SLAM 将前端位姿估计软解耦为平移与旋转:先用前向位置预测粗略消除帧间位移,再通过体素内球面对齐优化旋转,并结合连续时间约束估计平移,后端接入 scan-to-submap 与全局因子图。多场景实验表明其在越野地形的位姿精度和建图稳定性优于多种现有 LiDAR SLAM。

TCPFormer: Learning Temporal Correlation with Implicit Pose Proxy for 3D Human Pose Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20252025-01-03

TCPFormer: Learning Temporal Correlation with Implicit Pose Proxy for 3D Human Pose Estimation

Jiajie Liu, Mengyuan Liu, Hong Liu, Wenhao Li

Peking University, Nanyang Technological University

6D位姿估计人体姿态

针对多帧2D到3D人体姿态提升中,长序列输入带来的收益趋缓、现有Transformer往往只学习单一时序关联的问题,TCPFormer引入可训练的隐式姿态代理作为中间表示,通过PUM更新代理、PIM回注序列特征、PAM融合代理诱导的注意力来建模多重时间对应关系。在Human3.6M和MPI-INF-3DHP上,方法超过此前SOTA,说明性能增益主要来自更充分的时序相关建模。

Laparoscopic Scene Analysis for Intraoperative Visualisation of Gamma Probe Signals in Minimally Invasive Cancer Surgery Figure 1
arXiv preprint2025-01-03

Laparoscopic Scene Analysis for Intraoperative Visualisation of Gamma Probe Signals in Minimally Invasive Cancer Surgery

Copyright

6D位姿估计医学/手术

面向微创肿瘤手术中伽马探针“有信号但不可见”的痛点,本文将探针轴线与组织表面的3D交点转化为腹腔镜图像中的可视化定位问题,结合带标记的6D位姿跟踪、手术场景深度估计/重建与工具分割,并进一步用定制激光模块把交点检测简化为激光点推断。实验显示其简单网络即可实时估计探测区域,并给出该任务的新基准。

L3D-Pose: Lifting Pose for 3D Avatars from a Single Camera in the Wild Figure 1
arXiv preprint2025-01-02

L3D-Pose: Lifting Pose for 3D Avatars from a Single Camera in the Wild

Soumyaratna Debnath, Harish Katti, Shashikant Verma, Shanmuganathan Raman

6D位姿估计

针对野外动物/灵长类缺少3D标注、单目2D姿态缺乏深度的问题,L3D-Pose用带骨骼avatar和物理引擎合成Deep Macaque/Deep Horse数据,训练图像无关的注意力MLP将2D关键点提升到3D,并用查找表把稀疏解剖关键点映射为可重定向的深层姿态。实验显示该MLP在MSE和PDJ上优于对比2D-to-3D方法,查找表也能更高效完成avatar姿态迁移。

Relative Pose Observability Analysis Using Dual Quaternions Figure 1
arXiv preprint2024-12-31

Relative Pose Observability Analysis Using Dual Quaternions

Nicholas B. Andrews, Kristi A. Morgansen

6D位姿估计相机位姿

面向机器人协作、操作和卫星近距相对导航中依赖 AprilTag 等单标志物获取相对位姿的场景,论文关注这类 6D 相对运动系统是否可由测量唯一确定状态。核心在于用对偶四元数统一建模相对位姿、速度与测量,并利用其雅可比的块三角结构简化李代数非线性可观性分析。文中证明相关观测矩阵满足满秩条件,因此该相对位姿系统局部弱可观,贡献偏理论分析而非性能实验。

VinT-6D: A Large-Scale Object-in-hand Dataset from Vision, Touch and Proprioception Figure 1
arXiv preprint2024-12-31

VinT-6D: A Large-Scale Object-in-hand Dataset from Vision, Touch and Proprioception

Zhaoliang Wan, Yonggen Ling, Senlin Yi, Lu Qi, Wangwei Lee, Minglei Lu, Sicheng Yang, Xiao Teng, Peng Lu, Xu Yang, Ming-Hsuan Yang, Hui Cheng

6D位姿估计手部姿态数据集/基准

面向灵巧手在手操作中的6D物体位姿估计,论文指出现有数据多依赖仿真或两指夹爪,难覆盖遮挡、多指接触和真实模态对齐。VinT-6D提供视觉、全手触觉与本体感受融合的大规模数据,含200万仿真样本和10万真实样本,并通过触觉taxel建模、MuJoCo/Blender合成及标定采集平台缩小sim-to-real差距。基于该数据的VinT-Net显示多模态融合优于单一或较弱基线,性能增益可能主要来自更高质量数据和模态互补。

Hierarchical Pose Estimation and Mapping with Multi-Scale Neural Feature Fields Figure 1
arXiv preprint2024-12-30

Hierarchical Pose Estimation and Mapping with Multi-Scale Neural Feature Fields

1 Evgenii Kruzhkov 2 Alena Savinykh 3 Sven Behnke

Computer Science Institute VI, University of Bonn Computer Science Institute VI, University of Bonn, Autonomous Intelligent Systems, Computer Science Institute VI – Intelligent Systems and Robotics

6D位姿估计

面向真实机器人中缺少精确传感器位姿、又需大规模连续隐式建图的问题,论文从概率视角重述神经场映射,结合稀疏八叉树多尺度特征场与由粗到细的梯度位姿优化,避免昂贵体渲染并适配车载 LiDAR 序列。在 KITTI 与 MaiCity 上,该方法在未知位姿下保持较好重建质量,定位精度接近 KISS-ICP,并优于 SHINE-Mapping 等基线。

ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning Figure 1
arXiv preprint2024-12-30

ReFlow6D: Refraction-Guided Transparent Object 6D Pose Estimation via Intermediate Representation Learning

Hrishikesh Gupta, Stefan Thalhammer, Jean-Baptiste Weibel, Alexander Haberl, Markus Vincze

Automation and Control Institute, Stefan Thalhammer is with the Industrial Engineering Department, UAS Technikum Vienna

6D位姿估计物体位姿

透明物体因外观强依赖背景且深度传感易失效,给机器人抓取中的6D位姿估计带来困难。ReFlow6D的核心洞察是用折射流、衰减、掩码与表面区域构成环境相对不变的折射中间表示,并配合透明物体合成损失,从单目RGB直接回归位姿。实验显示其在TOD和Trans32K-6D上优于现有方法,真实抓取实验也验证了估计精度可转化为操作效果。

Frequency-aware Event Cloud Network Figure 1
arXiv preprint2024-12-30

Frequency-aware Event Cloud Network

Hongwei Ren, Fei Ma, Xiaopeng Lin, Yuetong Fang, Hongxiang Huang, Yulong Huang, Yue Zhou, Haotian Fu, Ziyi Yang, Fei Richard Yu, Bojun Cheng

6D位姿估计事件相机

本文针对事件相机常用帧/体素表示转换耗时、模型偏重且损失细粒度时序信息,以及点云表示忽略极性、难建模长事件序列的问题,提出 FECNet:以含空间、时间与极性的 Event Cloud 为输入,重设计分组采样模块,并用空间/时间频域滤波替代部分卷积以降低 MACs、捕获长程时空依赖。其在事件物体分类、动作识别和人体姿态估计的九个数据集上验证了效率与精度优势,但与 6D 位姿估计的直接关系文中未充分说明。

KeyGS: A Keyframe-Centric Gaussian Splatting Method for Monocular Image Sequences Figure 1
arXiv preprint2024-12-30

KeyGS: A Keyframe-Centric Gaussian Splatting Method for Monocular Image Sequences

Keng-Wei Chang, Zi-Ming Wang, Shang-Hong Lai

6D位姿估计三维重建高斯泼溅

KeyGS针对单目序列3DGS重建对精确相机位姿依赖强、无SfM方法训练耗时长的问题,采用快速SfM先给出粗位姿,再在3DGS密集光度优化中持续联合细化位姿与场景,并提出由粗到细的频率感知增密以避免高频信号导致漂移或局部最小。实验显示其将训练从数小时降至约分钟级,同时提升新视角合成与相机位姿估计精度。

Towards nation-wide analytical healthcare infrastructures: A privacy-preserving augmented knee rehabilitation case study Figure 1
Lecture notes in electrical engineering2024-12-30

Towards nation-wide analytical healthcare infrastructures: A privacy-preserving augmented knee rehabilitation case study

Boris Bačić, Claudiu Vasile, Chengwei Feng, Marian G. Ciucă

Auckland Institute of Studies, Auckland University of Technology, Medical Research Institute of New Zealand, Ovidius University

6D位姿估计

面向康复成本上升与医疗数据不宜依赖境外第三方云的需求,论文以真实膝关节康复视频为案例,使用 MediaPipe 将手机视频转为姿态关键点、膝角度时间序列和增强回放,在保留诊断信息的同时降低隐私暴露,并设计可解释的自适应练习索引/计数流程。数据集含9段、179次动作,侧面与正面视频上的识别正确率为91.67%–100%,但实时告警和流式平台仍未实现。

Exploiting Aggregation and Segregation of Representations for Domain Adaptive Human Pose Estimation Figure 1
arXiv preprint2024-12-29

Exploiting Aggregation and Segregation of Representations for Domain Adaptive Human Pose Estimation

Qucheng Peng, Ce Zheng, Zhengming Ding, Pu Wang, Orlando, Pittsburgh, New Orleans, Charlotte, USA @ucf.edu

Center for Research in Computer Vision, University of Central Florida, Orlando, USA, Robotics Institute, Carnegie Mellon University, Pittsburgh, USA, Department of Computer Science, Tulane University, New Orleans, USA, University of North Carolina at Charlotte, Charlotte, USA

6D位姿估计人体姿态

针对真实人体姿态标注稀缺、合成到真实存在域差的问题,论文认为仅对齐源/目标特征会混入域特有信息,因而将表示解耦为域不变与域特定部分,并分别做聚合与隔离;同时按关键点/假设关系设计差异度量。实验覆盖 Human3.6M、LSP、H3D、FreiHand,报告相较已有域自适应 HPE 方法达到 SOTA。

MambaVO: Deep Visual Odometry Based on Sequential Matching Refinement and Training Smoothing Figure 1
arXiv preprint2024-12-28

MambaVO: Deep Visual Odometry Based on Sequential Matching Refinement and Training Smoothing

Shuo Wang, Wanting Li, Yongcai Wang, Zhaoxin Fan, Zhe Huang, Xudong Cai, Jian Zhao, Deying Li

School of Information, Renmin University of China, Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Institute of Artificial Intelligence, Beihang University, Hangzhou International Innovation Institute, Beihang University, The Institute of AI (TeleAI), China Telecom, School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University (NWPU), Xi’an China

6D位姿估计相机位姿

针对深度视觉里程计在弱纹理、重复纹理等场景中匹配歧义导致初始化不稳、BA误差放大的问题,MambaVO用点-帧图组织观测,结合半稠密匹配与PnP初始化,并通过几何Mamba模块利用历史序列特征细化跨帧对应;TAP损失用于缓解嵌套优化的梯度波动。实验在EuRoC、TUM-RGBD、KITTI和TartanAir上报告SOTA精度、实时运行及较低显存,MambaVO++进一步加入回环优化。

GSplatLoc: Ultra-Precise Camera Localization via 3D Gaussian Splatting Figure 1
arXiv preprint2024-12-28

GSplatLoc: Ultra-Precise Camera Localization via 3D Gaussian Splatting

China

Southeast University Chengxian College

6D位姿估计三维重建高斯泼溅

GSplatLoc针对现有NeRF定位渲染开销大、3D Gaussian SLAM多依赖ICP且未充分利用可微性的局限,将已建好的3D Gaussian场景作为地图,通过GPU可微渲染深度图并最小化其与观测深度的差异来直接优化6D相机位姿。实验在Replica与TUM RGB-D室内序列上验证,Replica中达到0.01 cm内平移误差和近零旋转误差,显示其更适合作为高精度Gaussian地图定位模块。

Optimizing Local-Global Dependencies for Accurate 3D Human Pose Estimation Figure 1
IEEE Transactions on Circuits and Systems for Video Technology2024-12-27

Optimizing Local-Global Dependencies for Accurate 3D Human Pose Estimation

Guangsheng Xu, Guoyi Zhang, Lejia Ye, Shuwei Gan, Xiaohu Zhang, Xia Yang

Sun Yat-sen University

6D位姿估计人体姿态

针对单目视频3D人体姿态估计中Transformer偏重全局依赖、难以保留关节与运动的细粒度局部关系问题,论文提出双流SSR-STF:一支建模全局时空依赖,另一支用SSRFormer与骨架选择性细化注意力结合不规则大核提取局部骨架特征,并自适应融合。Human3.6M与MPI-INF-3DHP上P1误差分别达37.4mm和13.2mm,且在人网格恢复中显示可迁移的运动表征能力。

Dust to Tower: Coarse-to-Fine Photo-Realistic Scene Reconstruction from Sparse Uncalibrated Images Figure 1
arXiv preprint2024-12-27

Dust to Tower: Coarse-to-Fine Photo-Realistic Scene Reconstruction from Sparse Uncalibrated Images

Xudong Cai, Yongcai Wang, Zhaoxin Fan : 1, Deng Haoran, Shuo Wang, Wanting Li, Deying Li, Lun Luo, Minhang Wang, Jintao Xu, School of Information, Beijing, China, Privacy Computing, HAOMO.AI

School of Information, Renmin University of China, Beijing, China, Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Institute of Artificial Intelligence, Beihang University, Beijing, China

6D位姿估计三维重建

针对实际场景中图像稀疏且无相机内外参时,传统稀疏视角方法依赖精确位姿、SfM-free方法又需要密集采集的问题,D2T采用由粗到细的3DGS与位姿联合优化:先用快速MVS初始化粗模型和相机位姿,再通过置信深度对齐、视角重投影与补全生成新视角监督。实验显示其在新视角合成和位姿估计上达到SOTA并保持较高效率。

Humans as a Calibration Pattern: Dynamic 3D Scene Reconstruction from Unsynchronized and Uncalibrated Videos Figure 1
arXiv preprint2024-12-26

Humans as a Calibration Pattern: Dynamic 3D Scene Reconstruction from Unsynchronized and Uncalibrated Videos

Changwoon Choi, Jeongjun Kim, Geonho Cha, Minkwan Kim, Dongyoon Wee, Young Min Kim

Seoul National University NAVER Cloud

6D位姿估计三维重建

针对动态 NeRF 通常依赖已同步、已标定多视角视频而难以落地的问题,本文把场景中的人体运动当作“标定板”:先用人体姿态/形状序列通过 DTW 估计视频时间偏移,再由 3D 关节对齐估计相机位姿,并在多分辨率 4D 神经场训练中渐进联合优化这些参数。实验在 Panoptic、Mobile-Stage、EgoBody 等复杂数据上显示,该初始化与细化流程能获得较准确的时空标定和较高质量动态三维重建。

Reconstructing People, Places, and Cameras Figure 1
arXiv preprint2024-12-23

Reconstructing People, Places, and Cameras

Lea Müller, Hongsuk Choi, Anthony Zhang, Brent Yi, Jitendra Malik

UC Berkeley

6D位姿估计

针对人体重建与场景 SfM 往往彼此割裂、缺少统一世界坐标和尺度的问题,HSfM 利用人体统计模型提供近似米制尺度,并把人体网格、场景点云与相机参数联合初始化和优化。在 EgoHumans 与 EgoExo4D 上,人体世界定位误差分别降至 1.04m 和 0.50m,同时人体线索也提升相机位姿估计,如 EgoHumans 的 RRA@15 增加 20.3%。

Leveraging Consistent Spatio-Temporal Correspondence for Robust Visual Odometry Figure 1
the AAAI Conference on Artificial Intelligence 20252024-12-22

Leveraging Consistent Spatio-Temporal Correspondence for Robust Visual Odometry

Zhaoxing Zhang, Junda Cheng, Gangwei Xu, Xiaoxiang Wang, Can Zhang, Xin Yang

6D位姿估计相机位姿

针对混合视觉里程计中两帧光流匹配噪声大、时空不一致导致困难场景失效和长序列漂移的问题,STVO将局部多帧窗口用于联合匹配:通过时间传播模块在相邻帧间传递运动状态,并用深度几何先验构造空间注意力以抑制误匹配。该方法在TUM-RGBD、EuRoC MAV、ETH3D和KITTI Odometry上达到SOTA,ETH3D和KITTI相对前作分别提升77.8%和38.9%。

FACTS: Fine-Grained Action Classification for Tactical Sports Figure 1
arXiv preprint2024-12-21

FACTS: Fine-Grained Action Classification for Tactical Sports

Christopher Lai, Jason Mo, Haotian Xia, Yuan-fang Wang

University of California, Santa Barbara, Georgia Institute of Technology, University of California, Irvine

6D位姿估计

面向击剑、拳击等高速近身运动中细粒度动作难以由姿态估计稳定区分的问题,FACTS改用Transformer直接处理原始视频,绕开骨架、分割和传感器依赖,并发布含8类击剑动作的标注数据集。实验报告击剑90%、拳击83.25%准确率;但相对增益中数据清洗、类别设置与模型scaling的贡献文中未充分说明。

Can Generative Video Models Help Pose Estimation? Figure 1
arXiv preprint2024-12-20

Can Generative Video Models Help Pose Estimation?

Ruojin Cai, Jason Y. Zhang, Philipp Henzler, Zhengqi Li, Noah Snavely, Ricardo Martin-Brualla Google

Google Cornell University

6D位姿估计

针对低重叠甚至无重叠图像对中传统匹配和DUSt3R难以建立对应的问题,论文提出InterPose:用预训练生成式视频模型在两图间“补”中间帧,把视频先验转化为位姿估计的额外上下文,并用基于多次采样预测聚类程度的自一致性分数筛选可靠结果。在室内、室外和物体中心等四类数据上,方法跨三种视频模型均较DUSt3R取得稳定提升,但生成视频的几何一致性、成本和选择策略仍是主要限制。

Monkey Transfer Learning Can Improve Human Pose Estimation Figure 1
arXiv preprint2024-12-20

Monkey Transfer Learning Can Improve Human Pose Estimation

Bradley Scott School of Medicine, Medical Sciences, United Kingdom dimitra.blana@abdn.ac.uk

School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, School of Health and Wellbeing, University of Glasgow, School of Natural and Computing Sciences, School of Engineering, Dimitra Blana

6D位姿估计人体姿态

针对临床人群姿态数据稀缺、常规人体姿态估计在病理运动等新场景泛化不足的问题,论文将猕猴姿态网络作为预训练源,再用少量 MPII 单人图像微调,利用跨物种骨架相似性与更丰富运动形态补足人体数据覆盖。结果显示,相比仅用人体数据训练的 DeepLabCut/DeeperCut 基准,该迁移方案在精确率和召回率上更好,且只需约 1000 张人体样本而非 19185 张,但增益是否主要来自物种运动多样性仍需临床数据进一步验证。

Scaling 4D Representations Figure 1
arXiv preprint2024-12-19

Scaling 4D Representations

João Carreira, Dilara Gokay, Michael King, Chuhan Zhang, Ignacio Rocco, Thomas Albert Keck, Joseph Heyward, Skanda Koppula, Etienne Pot, Goker Erdogan, Yana Hasson, Yi Yang, Klaus Greff, Guillaume Le Moing, Sjoerd van Steenkiste, Daniel Zoran, Drew A. Hudson, Pedro Vélez, Luisa Polanía, Luke Friedman, Chris Duvarney, Ross Goroshin, Kelsey Allen, Jacob Walker, Rishabh Kabra, Eric Aboussouan, Jennifer Sun, Thomas Kipf, Carl Doersch

Google DeepMind, Google Research, Δ University of Bristol ◇, University of Oxford

6D位姿估计

本文针对视频自监督在语义分类评测中难以体现 scaling 的问题,转向相机位姿、深度、点/物体跟踪等4D几何时序任务重新评估。核心做法是用简化的 SimpleMAE 在1.7亿视频上训练并扩展ViT至22B参数,同时统一读出头做公平比较。结果显示视频MAE随规模持续提升,优于图像模型和单纯语言监督,增益可能主要来自 scaling / data。

Level-Set Parameters: Novel Representation for 3D Shape Analysis Figure 1
arXiv preprint2024-12-18

Level-Set Parameters: Novel Representation for 3D Shape Analysis

Huan Lei AIML

AIML, The University of Adelaide, The Australian National University, University of Tübingen

6D位姿估计

针对点云/网格离散表示易受分辨率影响的问题,论文把 SDF 神经场的 level-set 参数作为连续的 3D 形状数据来分析,并用共享伪正态先验对齐不同形状参数;同时通过超网络按 SE(3) 位姿生成受变换影响的参数子集。实验在任意姿态分类、检索和基于 SDF 重建损失的 6D 位姿估计中展示可行性,尤其对大旋转、噪声和外点较稳健,但局部几何特征建模仍受限。

Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimation Figure 1
the AAAI Conference on Artificial Intelligence 20252024-12-18

Pre-training a Density-Aware Pose Transformer for Robust LiDAR-based 3D Human Pose Estimation

Xiaoqi An, Lin Zhao 1 Corresponding authors, Chen Gong, Jun Li, Jian Yang : 1

Nanjing University of Science and Technology

6D位姿估计人体姿态点云

面向自动驾驶等开放场景中 LiDAR 点云稀疏、噪声大导致的 3D 人体姿态不稳定问题,论文强调不依赖时序、多模态或 SMPL 优化,仅从单帧点云内部性质建模。核心是 DAPT:用可学习关节锚点和交换模块融合不同密度信息,并以 XYZ 轴 1D 热图定位关键点;同时通过合成 LiDAR 人体、随机位姿和激光级遮挡掩码进行预训练以学习人体先验。在 LidarHuman26M、SLOPER4D、Waymo、HumanM3 上达到 SOTA,Waymo 较 LPFormer 降低 MPJPE 10.0mm,SLOPER4D 较 PRN 降低 20.7mm。

CondiMen: Conditional Multi-Person Mesh Recovery Figure 1
arXiv preprint2024-12-17

CondiMen: Conditional Multi-Person Mesh Recovery

Brégier Romain, Baradel Fabien, Lucas Thomas, Galaaoui Salma, Armando Matthieu, Weinzaepfel Philippe, Rogez Grégory

6D位姿估计

针对单目多人网格恢复中体型、焦距与深度相互混淆、确定性预测难以表达歧义的问题,CondiMen 将检测、姿态、体型、相机内参与距离建模为贝叶斯网络的联合参数分布,可在测试时条件化已知相机/体型或融合多视角信息。实验显示其在单目和多视角基准上达到或优于现有方法,并保持约20FPS实时推理。

ShotVL: Human-Centric Highlight Frame Retrieval via Language Queries Figure 1
arXiv preprint2024-12-17

ShotVL: Human-Centric Highlight Frame Retrieval via Language Queries

Wangyu Xue, Chen Qian, Jiayi Wu, Yang Zhou, Wentao Liu, Ju Ren, Siming Fan, Yaoxue Zhang

6D位姿估计

针对人中心视频中现有方法多停留在片段级、难以按复杂语言精确定位关键帧的问题,论文提出 BestShot 任务与基准,并用人工关键帧、细粒度动作和人体姿态描述构造评测;同时以 GPT-4o 生成数据和 SMPL/PoseScript 姿态文本扩充训练,微调 InternVL 得到 ShotVL。结果显示其在 BestShot 上较 InternVL 提升 52%,在 THUMOS14 上提升 57%,但增益可能主要来自数据与任务定制。

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion Figure 1
arXiv preprint2024-12-16

Category Level 6D Object Pose Estimation from a Single RGB Image using Diffusion

Adam Bethell

Adam Bethell, University of Adelaide

6D位姿估计物体位姿类别级位姿

这篇工作针对类别级6D位姿在仅有单张RGB图像时缺少CAD模型、深度且存在对称/遮挡导致多解的问题,用score-based扩散生成位姿与尺寸假设分布,并结合RGB语义、预测相对深度/法线、类别和全局特征;最终用Mean Shift直接找分布众数,替代GenPose式额外似然网络与均值聚合。其在REAL275上刷新RGB类别级SOTA,严格10°10cm指标提升55%、IoU75提升18%,但运行仍受扩散采样和深度/法线预测质量限制。

ExeChecker: Where Did I Go Wrong? Figure 1
arXiv preprint2024-12-13

ExeChecker: Where Did I Go Wrong?

Yiwen Gu 0000-0002-2437-0343, Mahir Patel 0000-0002-3370-4595, Margrit Betke 0000-0002-4491-6868

6D位姿估计

面向居家康复中反馈过于笼统、患者不知道具体错在哪的问题,ExeChecker用骨架姿态序列和时空图注意力 Transformer,并通过正确/错误动作三元组的对比学习,让嵌入突出导致动作不规范的关节;作者还构建含帕金森常见训练动作的成对数据集 ExeCheck,并提出 JoA 评分。实验在 ExeCheck 与 UI-PRMD 上显示,该方法比成对序列对齐基线更能定位具有物理意义的错误关节。

CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty Figure 1
arXiv preprint2024-12-11

CUPS: Improving Human Pose-Shape Estimators with Conformalized Deep Uncertainty

Harry Zhang, Luca Carlone

6D位姿估计人体姿态

面向机器人、自动驾驶等安全敏感场景中单目视频人体重建“何时可信”的问题,CUPS在3D人体姿态/形状估计训练中生成并评分多假设,端到端学习深度不确定性,并将其作为符合预测的校准分数;同时针对视频数据非完全可交换给出覆盖差距界。实验显示其在多数据集多指标达到SOTA,并保留概率覆盖保证。

RP-SLAM: Real-time Photorealistic SLAM with Efficient 3D Gaussian Splatting Figure 1
IEEE Transactions on Visualization and Computer Graphics2024-12-13

RP-SLAM: Real-time Photorealistic SLAM with Efficient 3D Gaussian Splatting

Lizhi Bai, Chunqi Tian, Jun Yang, Siyu Zhang, Masanori Suganuma, Takayuki Okatani

Tongji University, Tohoku University

6D位姿估计相机位姿三维重建高斯泼溅

面向传统SLAM难以生成逼真稠密地图、现有3DGS-SLAM又存在高斯冗余、连续优化遗忘和单目初始化缺深度的问题,RP-SLAM将位姿跟踪与高斯优化解耦,引入梯度自适应采样与高斯过滤、基于共视关系的动态关键帧窗口,以及利用稀疏点云的单目关键帧初始化。实验在TUM、Replica和ScanNet++上表明其在保持实时性和模型紧凑性的同时,达到领先的地图渲染精度。

Stereo4D: Learning How Things Move in 3D from Internet Stereo Videos Figure 1
arXiv preprint2024-12-12

Stereo4D: Learning How Things Move in 3D from Internet Stereo Videos

Linyi Jin, Richard Tucker, Zhengqi Li, David Fouhey Noah Snavely

Google DeepMind University of Michigan New York University

6D位姿估计多视角

面向机器人交互等动态3D理解中真实3D运动标注稀缺的问题,Stereo4D将互联网VR180双目广角视频视为可规模化数据源,融合相机位姿、双目深度和时序跟踪并进行过滤优化,自动生成伪度量4D点云与长时轨迹;其约11万片段数据用于训练DynaDUSt3R,在真实动态场景的结构与3D运动预测上优于基线,增益可能主要来自scaling/data。

FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstruction Figure 1
arXiv preprint2024-12-12

FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstruction

Jiale Xu, Shenghua Gao, Ying Shan ARC Lab, Tencent PCG

ARC Lab, Tencent PCG The University of Hong Kong

6D位姿估计三维重建高斯泼溅

FreeSplatter针对稀疏视角三维重建对精确相机位姿依赖强、SfM在低重叠场景易失效的问题,提出无需外参/内参的前馈框架,用单流Transformer在统一参考系中直接预测像素对齐的3D高斯图,并借助现成PnP等求解器快速恢复位姿。作者分别训练物体级和场景级版本;实验显示其重建质量超过多种需位姿的LRM,位姿估计在若干基准上达到或优于MASt3R,并可简化多视图扩散到3D流程。

BLADE: Single-view Body Mesh Learning through Accurate Depth Estimation Figure 1
arXiv preprint2024-12-11

BLADE: Single-view Body Mesh Learning through Accurate Depth Estimation

Shengze Wang, Jiefeng Li, Tianye Li, Ye Yuan, Henry Fuchs, Koki Nagano, Shalini De Mello, Michael Stengel

NVIDIA

6D位姿估计彩色深度

BLADE针对单目人体网格恢复在近距离图像中因弱透视/正交假设导致3D姿态与2D对齐难以兼顾的问题,核心洞察是透视畸变主要由人体Z向平移Tz决定而非焦距;方法先估计骨盆深度,并用Tz条件化姿态估计,再求解焦距和完整平移。论文称在多种距离范围、标准基准和真实近景图像上,深度、相机参数、3D姿态与2D对齐均优于现有方法。

Drift-free Visual SLAM using Digital Twins Figure 1
arXiv preprint2024-12-12

Drift-free Visual SLAM using Digital Twins

Roxane Merat, Giovanni Cioffi, Leonard Bauersfeld, Davide Scaramuzza

Manuscript received: August, 30, 2024; Revised November, 1, 2024; Accepted November

6D位姿估计相机位姿

面向城市/室内等 GPS 不稳定且长期 VIO/VSLAM 易漂移的场景,论文将局部稀疏 SLAM 点云与数字孪生的几何网格做点到平面配准,生成无需视觉特征关联的 6DoF 全局约束并紧耦合进系统。高保真 GPS 仿真和真实无人机实验显示,该方法较先进 VIO-GPS 更能抑制漂移,并比基于图像特征的重定位更抗视角变化。

Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization Figure 1
arXiv preprint2024-12-11

Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization

Siyan Dong, Shuzhe Wang : 1, Shaohui Liu, Lulu Cai Qingnan Fan, Juho Kannala, ETH Zurich, VIVO

The University of Hong Kong Aalto University ETH Zurich VIVO University of Oulu

6D位姿估计相机位姿

针对视觉定位中传统几何方法推理慢、APR难泛化、RPR精度不足的问题,Reloc3r将DUSt3R式骨干改造成全对称相对位姿回归网络,并用极简运动平均恢复绝对位姿;约800万有位姿图像对训练后,在6个公开数据集上实现实时、高精度且跨新场景泛化的相机6D定位,增益可能主要来自大规模数据与简化架构的结合。

LoRA3D: Low-Rank Self-Calibration of 3D Geometric Foundation Models Figure 1
arXiv preprint2024-12-10

LoRA3D: Low-Rank Self-Calibration of 3D Geometric Foundation Models

Ziqi Lu, Heng Yang, Danfei Xu, Boyi Li, Boris Ivanovic, Marco Pavone, Yue Wang NVIDIA Research, Berkeley, @nvidia.com, pavone@stanford.edu, yue.w@usc.edu

NVIDIA Research, Massachusetts Institute of Technology, Harvard University, Georgia Institute of Technology, University of California, Berkeley, Stanford University, University of Southern California

6D位姿估计

针对DUSt3R等3D几何基础模型在低重叠、弱光等目标场景中泛化不稳的问题,LoRA3D用稀疏RGB图像做无标注自校准:先通过鲁棒全局几何优化对多视图预测和置信度重新校准,再筛选高置信伪标签并用LoRA进行场景级适配。实验在Replica、TUM、Waymo的161个场景上,报告在重建、多视角位姿估计和新视角渲染中最高提升88%,单GPU约5分钟完成,每个适配器约18MB。

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds Figure 1
arXiv preprint2024-12-09

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

Zhenggang Tang, Yuchen Fan, Dilin Wang, Hongyu Xu, Rakesh Ranjan, Alexander Schwing, Zhicheng Yan

META Health, University of Illinois Urbana-Champaign

6D位姿估计三维重建

针对 DUSt3R 类方法在多视图场景中依赖大量两两重建与全局优化、易累积错配且耗时的问题,论文提出单阶段前馈的 MV-DUSt3R/MV-DUSt3R+,用多视图解码器与跨参考视图模块在无相机内外参下直接融合稀疏视角,并可联合高斯溅射头做新视角合成。在 HM3D、ScanNet、MP3D 上,其 MVS 重建、位姿估计和 NVS 均优于先前方法,速度相对 DUSt3R 提升约 48–78 倍或一个数量级。

Attention-Enhanced Lightweight Hourglass Network for Human Pose Estimation Figure 1
arXiv preprint2024-12-09

Attention-Enhanced Lightweight Hourglass Network for Human Pose Estimation

Marsha Mariya Kappan, Eduardo Benítez Sandoval, Erik Meijering, Francisco Cruz

School of Computer Science and Engineering, University of New South Wales, Sydney, Australia, School of Art and Design, Creative Robotics Lab, University of New South Wales, Sydney, Australia

6D位姿估计人体姿态

面向机器人等资源受限场景中人体姿态估计模型计算量大、部署困难的问题,论文提出 LAP:在两栈 Hourglass 骨干上用深度可分离卷积替代标准卷积,并加入 CBAM 通道/空间注意力与 ELU,以压缩模型同时保留关键点定位能力。在 COCO、MPII 上相较 6 个轻量模型表现有竞争力,AP 为 72.07,仅 2.3M 参数、3.7G FLOPs。

CCS: Continuous Learning for Customized Incremental Wireless Sensing Services Figure 1
arXiv preprint2024-12-06

CCS: Continuous Learning for Customized Incremental Wireless Sensing Services

Qunhang Fu 0009-0007-9789-0300, Fei Wang 0000-0002-0750-6990, Mengdie Zhu 0009-0007-3965-6700, Han Ding 0000-0002-5274-7988, Jinsong Han 0000-0001-5064-1955, Tony Xiao Han

6D位姿估计

面向无线感知从原型走向规模化服务时用户不断提出新能力且不愿上传数据的问题,CCS将增量学习放到本地设备上,通过少量服务商样本、知识蒸馏和权重对齐缓解灾难性遗忘,使模型在增加新动作类别时保留旧能力。在XRF55的Wi‑Fi、毫米波雷达和RFID连续需求实验中,CCS的持续服务指标优于iCaRL、UCIR、BiC和OneFi。

ProPLIKS: Probablistic 3D human body pose estimation Figure 1
arXiv preprint2024-12-05

ProPLIKS: Probablistic 3D human body pose estimation

Erlangen, Germany, Siemens Healthineers AG, Forchheim, Germany karthik.shetty@fau.de

6D位姿估计人体姿态

该文针对单目/少视角人体三维重建中深度歧义、遮挡和旋转表示不连续导致单一确定性预测不可靠的问题,提出 ProPLIKS:在 SO(3) 上用带 Möbius 耦合的归一化流建模姿态分布,并结合 PLIKS/SMPL 的可微最小二乘求解与形状高斯先验,输出多种带概率的合理人体姿态。实验显示其在 RGB 人体姿态与医学 X-Ray 场景中优于现有方法,并可较自然扩展到多视角融合。

DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstruction Figure 1
arXiv preprint2024-12-05

DualPM: Dual Posed-Canonical Point Maps for 3D Shape and Pose Reconstruction

Ben Kaye, Tomas Jakab, Shangzhe Wu, Christian Ruprecht

University of Oxford Stanford University University of Cambridge

6D位姿估计三维重建

针对可变形物体单目三维重建中“形状可见但姿态变形难以直接读出”的问题,DualPM将每个像素同时映射到相机姿态空间和规范静止空间,并用两者差异表示形变;同时引入分层 amodal point map 处理自遮挡下的完整形状恢复。在四足动物实验中,仅用每类一两个合成模板训练即可泛化到真实图像,在关键点迁移、三维重建和骨架拟合上较既有方法取得明显提升。

Targeted Hard Sample Synthesis Based on Estimated Pose and Occlusion Error for Improved Object Pose Estimation Figure 1
IEEE Robotics and Automation Letters2024-12-05

Targeted Hard Sample Synthesis Based on Estimated Pose and Occlusion Error for Improved Object Pose Estimation

Alan Li, Angela P. Schoellig

University of Toronto

6D位姿估计物体位姿

面向料箱抓取中无纹理零件姿态稀有、遮挡复杂导致6D位姿估计失效的问题,论文将模型误差显式映射到视角/位姿空间与物体遮挡区域,按高误差且可能出现的区域定向合成困难样本,并在连续训练中迭代更新采样分布。该方法不依赖特定估计器,在ROBI多个物体上正确检测率最高提升20%,收敛可加快约30%,T-LESS料箱场景也有约10%增益。

Sparse-view Pose Estimation and Reconstruction via Analysis by Generative Synthesis Figure 1
arXiv preprint2024-12-04

Sparse-view Pose Estimation and Reconstruction via Analysis by Generative Synthesis

Qitao Zhao Shubham Tulsiani

Carnegie Mellon University

6D位姿估计三维重建

稀疏多视图下,3D重建依赖准确相机位姿,而位姿估计又需要可靠3D,初始位姿中的大误差会相互放大。SparseAGS将分析-合成框架扩展为引入6-DoF新视角生成先验,并结合光度优化、离群视角识别、离散搜索与连续优化来联合修正位姿和重建形状。在真实与合成数据、不同现成位姿初始化上,方法显著提升初始位姿精度,并生成优于现有稀疏多视图重建基线的3D结果。

NVComposer: Boosting Generative Novel View Synthesis with Multiple Sparse and Unposed Images Figure 1
arXiv preprint2024-12-04

NVComposer: Boosting Generative Novel View Synthesis with Multiple Sparse and Unposed Images

Lingen Li, Zhaoyang Zhang, Yaowei Li, Jiale Xu, Wenbo Hu, Xiaoyu Li, Weihao Cheng, Jinwei Gu, Tianfan Xue, Ying Shan

The Chinese University of Hong Kong, ARC Lab, Tencent PCG, Peking University

6D位姿估计

针对多视角生成式新视角合成依赖外部位姿估计或预重建、在稀疏小重叠和遮挡场景易失效的问题,NVComposer将位姿关系作为扩散生成的一部分,用图像-位姿双流模型联合生成目标视图并隐式估计条件视图位姿,同时通过几何感知特征对齐从稠密立体模型蒸馏几何先验。实验显示其在无位姿多输入下优于现有生成式NVS和可控视频扩散方法,且输入视图增多时质量提升明显。

A Bidirectional Siamese Recurrent Neural Network for Accurate Gait Recognition Using Body Landmarks Figure 1
arXiv preprint2024-12-05

A Bidirectional Siamese Recurrent Neural Network for Accurate Gait Recognition Using Body Landmarks

Proma Hossain Progga, Md. Jobayer Rahman, Swapnil Biswas, Md. Shakil Ahmed, Arif Reza Anwary, Dhaka 1212, Bangladesh School of Computing, Bangladesh

Department of Computer Science Engineering, United International University, School of Computing, Edinburgh Napier University, United Kingdom, Department of Computer Science Engineering, BRAC University

6D位姿估计人体姿态

针对远距离、低分辨率或非配合场景下人脸等生物特征不可靠的问题,论文将步态识别建模为基于人体关键点序列的匹配任务:用 MediaPipe 提取步态 landmarks,经 Procrustes 对齐减弱视角差异,再以孪生 biGRU-dualStack 和对比损失学习时序相似性。在 CASIA-B、SZU RGB-D、OU-MVLP 与 Gait3D 上分别达到 95.7%、94.44%、87.71%、86.6% 准确率,但相对各组件的独立增益来源仍需更充分消融说明。

MCVO: A Generic Visual Odometry for Arbitrarily Arranged Multi-Cameras Figure 1
arXiv preprint2024-12-04

MCVO: A Generic Visual Odometry for Arbitrarily Arranged Multi-Cameras

Huai Yu, Junhao Wang, Yao He, Wen Yang, Gui-Song Xia

6D位姿估计相机位姿多视角

针对单目/双目视场窄、任意多相机配置下尺度估计和实时处理困难的问题,MCVO将学习式特征提取与跟踪前端转移到GPU,并利用刚性多相机运动流形一致性完成公制尺度初始化,在后端融合多相机特征进行位姿与尺度优化及回环检测。KITTI-360和MultiCamData实验显示,其在任意布置相机上较现有立体和多相机VO取得更高位姿精度与泛化性。

An indoor DSO-based ceiling-vision odometry system for indoor industrial environments Figure 1
arXiv preprint2024-12-04

An indoor DSO-based ceiling-vision odometry system for indoor industrial environments

Abdelhak Bougouffa, Emmanuel Seignez, Samir Bouaziz, Florian Gardes

Laboratoire de Biologie et Pharmacologie Appliquée, Centre National de la Recherche Scientifique

6D位姿估计相机位姿

面向工厂等动态室内场景中人和机器人干扰前视视觉里程计的问题,论文将相机朝上观察相对静态的天花板,并把直接稀疏里程计改造成 Ceiling-DSO,避免依赖灯具、角点、墙顶边界或人工标记等先验。作者自建真实场景天花板视觉数据集并调参评估,结果显示可在线估计相机位姿,误差相对真值处于可接受范围,但具体泛化边界仍需更多公开数据验证。

EgoCast: Forecasting Egocentric Human Pose in the Wild Figure 1
arXiv preprint2024-12-03

EgoCast: Forecasting Egocentric Human Pose in the Wild

Jordi Pont-Tuset Google DeepMind jponttuset@google.com, Kevis-Kokitsi Maninis Google DeepMind kmaninis@google.com

Google DeepMind

6D位姿估计人体姿态

面向 AR 中实时理解和预判佩戴者动作的需求,EgoCast 将第一视角视频与头显位姿这一类本体感知信号结合,用双模态 Transformer 先估计当前伪全身姿态,再在无需测试时真实历史姿态的条件下预测未来 3D 姿态,并提出更贴近实际的 30FPS、最长 5 秒评测与 MPJPE-AUC。其在 Ego-Exo4D BodyPose 2024 挑战超过既有 SOTA,预测 AUC 在 Ego-Exo4D/ADT 上为 24.41/26.69 cm。

emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation Figure 1
arXiv preprint2024-12-02

emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation

Sasha Salter, Richard Warren, Collin Schlager, Adrian Spurr, Shangchen Han, Rohin Bhasin, Yujun Cai, Peter Walkington, Anuoluwapo Bolarinwa, Robert Wang, Nathan Danielson, Josh Merel, Eftychios Pnevmatikakis, Jesse Marshall

Work done while at Meta

6D位姿估计手部姿态数据集/基准

该工作针对视觉手部跟踪受遮挡、视场和光照限制,而腕部 sEMG 又难以跨用户、传感器佩戴和动作泛化的问题,发布 emg2pose 大规模基准:用 16 通道 2kHz 腕带同步 26 相机动捕标签,覆盖 193 名用户、370 小时、29 类动作阶段约 8000 万帧。论文给出基线并设置留出用户、佩戴位置和动作阶段等任务,主要结果显示该问题仍具挑战性,进展可能主要来自 scaling / data。

ProbPose: A Probabilistic Approach to 2D Human Pose Estimation Figure 1
arXiv preprint2024-12-03

ProbPose: A Probabilistic Approach to 2D Human Pose Estimation

Miroslav Purkrabek

Visual Recognition Group, Department of Cybernetics, Czech Technical University in Prague

6D位姿估计人体姿态

本文针对顶自上而下人体姿态估计忽略画外关键点、热图置信度未校准且难表达不确定性的问题,提出 ProbPose:用归一化概率图、存在概率、可见性与定位质量共同描述每个关键点,并以 OKS 风险最小化和期望 OKS 解码替代固定高斯热图。作者还构建 CropCOCO 与 Ex-OKS 评测画外点;在 COCO、CropCOCO、OCHuman 上,方法显著提升画外关键点定位,并改善边界区域与部分画内定位表现。

Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images Figure 1
arXiv preprint2024-12-03

Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images

Xiangyong Lu, Masanori Suganuma, Takayuki Okatani

Graduate School of Information Sciences, Tohoku University, RIKEN Center for AIP

6D位姿估计

面向监控、边缘设备等低分辨率输入下位姿/识别精度下降的问题,论文提出用于 CNN-ViT 混合架构的级联多尺度注意力 CMSA:将多头注意力分组,用不同窗口局部注意力提取不同尺度特征,并按尺度级联传递以避免下采样造成的信息损失。在低分辨率人体姿态、头部姿态和分类实验中,方法以更少参数超过多种既有模型。

CLERF: Contrastive LEaRning for Full Range Head Pose Estimation Figure 1
arXiv preprint2024-12-03

CLERF: Contrastive LEaRning for Full Range Head Pose Estimation

CA &Huei-Chung Hu DOCOMO Innovations Sunnyvale, CA &Hsin-Tai Wu DOCOMO Innovations Sunnyvale

Santa Clara University

6D位姿估计

针对全范围头部姿态估计中真实数据姿态稀疏、难以构造对比学习正样本且现有模型对轻微旋转/翻转敏感的问题,CLERF利用3D-aware GAN生成与真实图像姿态匹配的合成正样本,并结合几何变换扩展到yaw/pitch/roll全范围。实验显示其在标准测试集与SOTA相当,在轻微扰动、翻转及倒置等全范围姿态下优于现有模型。

Detection, Pose Estimation and Segmentation for Multiple Bodies: Closing the Virtuous Circle Figure 1
arXiv preprint2024-12-02

Detection, Pose Estimation and Segmentation for Multiple Bodies: Closing the Virtuous Circle

Miroslav Purkrábek, Jiřı́ Matas

Czech Technical University in Prague

6D位姿估计

针对多人近距离重叠时检测框合并、姿态塌缩和分割不一致的问题,论文提出 BBox-Mask-Pose 闭环,让检测器、MaskPose 与 SAM2 在框、实例掩码和姿态之间相互条件化并迭代修正。其洞察是显式约束多种人体表示的一致性,比单一大模型共享特征更适合拥挤场景;在 OCHuman 的检测、实例分割和姿态估计均达到新 SOTA,并在 COCO 姿态估计达到 SOTA,但主要瓶颈来自 SAM 自动提示导致的掩码错误。

6DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting Figure 1
arXiv preprint2024-12-02

6DOPE-GS: Online 6D Object Pose Estimation using Gaussian Splatting

Yufeng Jin, Vignesh Prasad, Snehal Jauhri, Mathias Franzius, Technische Universität Darmstadt, Offenbach, Germany Hessian.AI, Darmstadt, Germany @tu-darmstadt.de, georgia.chalvatzaki@tu-darmstadt.de

Computer Science Department, Technische Universität Darmstadt, Germany, Honda Research Institute Europe GmbH, Offenbach, Germany

6D位姿估计物体位姿三维重建高斯泼溅

面向无CAD模型的在线6D物体位姿跟踪,6DOPE-GS用增量式2D Gaussian Splatting同时优化物体位姿图与三维重建,以快速可微渲染替代较慢的神经场训练;动态关键帧选择提升覆盖并过滤错误位姿,基于不透明度统计的剪枝控制高斯密度。在HO3D和YCBInEOAT上达到与现有无模型跟踪重建方法相近精度,同时约5倍加速,并展示单RGB-D相机约3.5Hz的实时动态跟踪。

HandOS: 3D Hand Reconstruction in One Stage Figure 1
arXiv preprint2024-12-02

HandOS: 3D Hand Reconstruction in One Stage

Robotics, College of Engineering

Department of Advanced Manufacturing and Robotics, College of Engineering, Peking University, International Digital Economy Academy (IDEA Research), University of Chinese Academy of Sciences

6D位姿估计手部姿态三维重建

HandOS针对传统手部三维重建需检测、左右手分类、姿态估计多阶段串联导致计算冗余和误差累积的问题,将姿态与网格重建能力接入冻结检测器,提出交互式2D-3D解码器、实例到关节查询扩展、2D到3D查询提升和层级注意力,直接联合建模2D关节、3D顶点与相机平移。其在FreiHand达到5.0 PA-MPJPE,在HInt-Ego4D达到64.6% PCK@0.05,并在HO3Dv3、DexYCB等基准取得领先结果。

SF-Loc: A Visual Mapping and Geo-Localization System based on Sparse Visual Structure Frames Figure 1
arXiv preprint2024-12-02

SF-Loc: A Visual Mapping and Geo-Localization System based on Sparse Visual Structure Frames

Yuxuan Zhou, Xingxing Li, Shengyu Li, Chunxi Xia, Xuanbin Wang, Shaoquan Feng

at the Supercomputing Center of Wuhan University. (, School of Geodesy and Geomatics, Wuhan University, China (e-mail

6D位姿估计

针对复杂城市环境中 GNSS 不稳定、传统地图难以兼顾构建效率、存储和重定位精度的问题,SF-Loc 将带全视野深度的地理标定图像作为稀疏视觉结构帧地图,通过多传感器稠密 BA、共视稀疏化和利用时空关联相似度的粗到细匹配提升跨时段定位可用性;实测城市道路中地图压缩到约 3 MB/km,并实现稳定分米级重定位。

MamKPD: A Simple Mamba Baseline for Real-Time 2D Keypoint Detection Figure 1
arXiv preprint2024-12-02

MamKPD: A Simple Mamba Baseline for Real-Time 2D Keypoint Detection

Yonghao Dang, Liyuan Liu, Hui Kang, Ping Ye, Jianqin Yin, Telecommunications Inspur Genersoft Co, Ltd. @bupt.edu.cn

Beijing University of Posts and Telecommunications, Inspur Genersoft Co., Ltd

6D位姿估计

针对实时关键点检测中 CNN/Transformer 难兼顾精度与速度的问题,MamKPD 将 Mamba 引入热图式 2D 姿态估计,并用轻量 CMM 通过深度卷积建模 patch 间依赖、线性层提取 patch 内姿态线索,再由 SS2D 做全局聚合。实验显示 MamKPD-L 在 COCO 达 77.3% AP、4090 上 1492 FPS,MPII 达到 SOTA,AP-10K 具竞争力且较 ViTPose 省约 85% 参数。

Cross-Modal Visual Relocalization in Prior LiDAR Maps Utilizing Intensity Textures Figure 1
arXiv preprint2024-12-02

Cross-Modal Visual Relocalization in Prior LiDAR Maps Utilizing Intensity Textures

Qiyuan Shen, Hengwang Zhao, Weihao Yan, Chunxiang Wang, Tong Qin, Ming Yang

Department of Automation, Shanghai Jiao Tong University, Shanghai, 200240, China, Global Institute of Future Technology, Shanghai Jiao Tong University, Shanghai, China

6D位姿估计相机位姿点云

针对相机在先验 LiDAR 地图中重定位时,传统2D纹理与3D几何特征难以稳定对应的问题,论文利用 LiDAR 强度值与图像灰度的纹理一致性,将点云投影为强度全景图,结合粗检索、共视聚类、两阶段2D-3D关联与共视内点筛选来估计6DoF位姿。自采数据集实验显示,该框架在地点识别和位姿估计召回率上均有效,但泛化到公开数据和不同传感器配置的表现文中未充分说明。

CRISP: Object Pose and Shape Estimation with Test-Time Adaptation Figure 1
arXiv preprint2024-12-02

CRISP: Object Pose and Shape Estimation with Test-Time Adaptation

Jingnan Shi, Rajat Talak, Harry Zhang, David Jin

Laboratory for Information & Decision Systems (LIDS), Massachusetts Institute of Technology

6D位姿估计物体位姿

CRISP面向真实机器人中缺少类先验/CAD且存在域偏移的RGB-D物体6D位姿与形状估计问题。其核心是类别无关的ViT-DPT位姿归一化点预测与FiLM隐式形状解码,并用主动形状模型近似解码器,将测试时形状/位姿修正化为可高效求解的约束最小二乘,再通过correct-and-certify生成伪标签自训练。实验在YCBV、SPE3R、NOCS上显示其位姿有竞争力、形状重建优于基线,并能缓解较大域差和泛化到未见物体。

Diorama: Unleashing Zero-shot Single-view 3D Scene Modeling Figure 1
arXiv preprint2024-11-29

Diorama: Unleashing Zero-shot Single-view 3D Scene Modeling

Qirui Wu, Denys Iliash, Daniel Ritchie, Manolis Savva

Simon Fraser University, Brown University, Alberta Machine Intelligence Institute (Amii)

6D位姿估计

Diorama针对单目RGB到可编辑3D场景依赖昂贵标注、合成数据泛化差的问题,提出无需端到端训练的零样本开放世界流水线:用基础模型完成物体/深度/法线/场景图感知,再进行平面结构重建、CAD检索、9DoF位姿估计与语义布局优化。在SSDB及真实图像实验中,其整体场景质量、结构重建和用户偏好均优于ACDC等基线,并展示了互联网图像与文本到场景的泛化能力。

Multiview Equivariance Improves 3D Correspondence Understanding with Minimal Feature Finetuning Figure 1
ICLR 20252024-11-29

Multiview Equivariance Improves 3D Correspondence Understanding with Minimal Feature Finetuning

Yang You, Yixin Li, Congyue Deng, Yue Wang, Leonidas Guibas

6D位姿估计多视角

针对2D视觉基础模型是否真正理解3D空间关系的问题,本文以多视角同一3D点的特征一致性来评估ViT的3D等变性,发现其与6D位姿估计、跟踪和语义对应表现强相关,DINOv2最突出。作者进一步用Objaverse多视角像素对应和SmoothAP,仅通过LoRA及少量附加层微调即可显著提升3D对应能力;DINOv2在位姿、跟踪、语义对应上分别提升9.58、5.0和5.06,甚至单物体一次微调也有可观增益。

HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos Figure 1
arXiv preprint2024-11-28

HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videos

Prithviraj Banerjee, Sindi Shkodrani, Pierre Moulon, Shreyas Hampali, Shangchen Han, Fan Zhang, Linguang Zhang, Jade Fountain, Edward Miller, Selen Basol, Richard Newcombe, Robert Wang, Jakob Julian Engel

META Health

6D位姿估计手部姿态多视角

面向AR/VR与机器人学习中手物交互三维理解仍缺少真实、多视角、精确标注数据的问题,HOT3D发布由Aria与Quest 3采集的大规模自我中心数据集,包含同步多视角图像、眼动、点云、手/物体6D位姿与高质量物体模型。论文核心洞察是利用头戴设备天然多摄像头可显著改善无深度传感器场景下的手部跟踪、物体位姿估计和未知手持物体3D提升,实验中多视角基线均明显优于单视角版本。

Distributed Dual Quaternion Extended Kalman Filtering for Spacecraft Pose Estimation Figure 1
arXiv preprint2024-11-28

Distributed Dual Quaternion Extended Kalman Filtering for Spacecraft Pose Estimation

Mathias Hudoba de Badyn 1 Associate Professor, Gunnar Randers vei 19, Kjeller, Norway. mathias.hudoba@its.uio.no, AIAA Member, Jonas Binz 2 Master’s Student, Physikstrasse 3, Zürich, Switzerland, Andrea Iannelli 3 Assistant Professor, Automatic Control, Pfaffenwaldring 9, 70569 Stuttgart, Germany andrea.iannelli@ist.uni-stuttgart.de, and Roy S. Smith 4 Professor, Switzerland. rsmith@control.ee.ethz.ch, AIAA Associate Fellow

Department of Technology Systems, University of Oslo, 2027, Kjeller, Norway, Associate Professor, Department of Technology Systems, University of Oslo, Gunnar Randers vei 19, 2027, Kjeller, Norway, Master’s Student, Automatic Control Laboratory, Physikstrasse 3, 8092, Zürich, Switzerland, Assistant Professor, Institute for Systems Theory and Automatic Control, University of Stuttgart, Pfaffenwaldring 9, Stuttgart, Germany, Roy S. Smith, Professor, Automatic Control Laboratory, Physikstrasse 3, 8092, Zürich, Switzerland

6D位姿估计航天器

面向深空多航天器编队/协同观测中同时保持相对位置与姿态的需求,论文将双四元数MEKF扩展为分布式滤波框架,结合绝对与邻居相对位姿测量,并提出软/硬共识的传感器、协方差和状态估计融合;数值仿真及小行星蜂群案例显示,相比非协作估计可显著降低位姿和速度RMS误差,且领导者-跟随者设置下可减少多数绝对位姿传感器而性能基本不降。

Waterfall Transformer for Multi-person Pose Estimation Figure 1
arXiv preprint2024-11-28

Waterfall Transformer for Multi-person Pose Estimation

New York 14623

Rochester Institute of Technology

6D位姿估计

针对多人姿态估计中层级 Transformer 容易丢失高分辨率细节、局部与全局上下文融合不足的问题,WTPose在改造的 Swin 骨干上引入瀑布式 Transformer 模块,将多阶段特征上采样融合,并用扩张/非扩张邻域注意力级联扩大感受野。COCO 实验显示其相较其他 Swin/Transformer 姿态方法有性能提升,但论文任务实为多人2D关键点估计,与“6D位姿”分类并不完全一致。

AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers Figure 1
arXiv preprint2024-12-02

AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers

Sherwin Bahmani ∗1, Ivan Skorokhodov ∗3, Guocheng Qian 3, Aliaksandr Siarohin 3

University of Toronto, Vector Institute

6D位姿估计

针对现有文本到视频模型加入3D相机控制后轨迹不准、画质和动态下降的问题,AC3D从频谱和模型表征分析入手,指出相机运动主要是低频信号,且VDiT中相机信息集中在部分中前层,因此只在特定去噪阶段和前30%层注入位姿条件,并加入2万段静态相机动态场景视频以解耦相机/物体运动。实验显示其相比近邻方法视频保真度提升18%、相机控制精度提升25%,用户偏好率达90%。

XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration Figure 1
WACV 20252024-11-27

XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration

Denys Rozumnyi, Nadine Bertsch, Othman Sbai, Filippo Arcadu, Yuhua Chen, Artsiom Sanakoyeu, Manoj Kumar, Catherine Herold, Robin Kips

Meta Reality Labs Zurich

6D位姿估计点云彩色深度

XR 头显通常只有头和双手 3 点信号,传统方法只能合成“合理”下肢而难以感知真实腿部动作。XR-MBT 利用设备已有的自我中心深度点云,通过语义点云编码/注册与残差多模态姿态网络,并用未配准真实点云和动捕仿真数据进行自监督训练。实验显示其在多类动作中优于仅 3 点合成方法,尤其改善下肢跟踪,并可在 XR 设备上实时运行。

Manual-PA: Learning 3D Part Assembly from Instruction Diagrams Figure 1
arXiv preprint2024-11-27

Manual-PA: Learning 3D Part Assembly from Instruction Diagrams

Jiahao Zhang, Anoop Cherian, Cristian Rodriguez, Weijian Deng

The Australian National University, Mitsubishi Electric Research Labs, The Australian Institute for Machine Learning

6D位姿估计

家具等3D部件装配同时需要选择装配顺序和估计精确6D连接位姿,搜索空间巨大且可行解稀疏。Manual-PA的核心是利用说明书示意图把问题拆成离散顺序推断与连续位姿估计:通过对比学习对齐2D步骤图与3D零件,并将得到的顺序作为Transformer跨模态预测的软引导。在PartNet上相较既有方法显著提升装配指标,并在IKEA-Manual真实家具上表现出较强泛化。

Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors Figure 1
arXiv preprint2024-11-26

Self-supervised Monocular Depth and Pose Estimation for Endoscopy with Generative Latent Priors

Ziang Xu, Bin Li, Yang Hu, Chenyu Zhang, James East, Sharib Ali

University of Oxford, University of Leeds

6D位姿估计彩色深度

针对单目内镜缺少可靠深度/位姿真值、肠道纹理与光照变化导致自监督重投影约束不稳的问题,本文在 Monodepth2 式框架中引入生成式深度潜变量库作为 DepthNet 先验,并将 PoseNet 改写为 VAE 以正则化位姿尺度和轴向敏感性。在 SimCol 与 EndoSLAM 上优于已有自监督方法,但真实临床定量验证仍受真值缺失限制。

Geometric Point Attention Transformer for 3D Shape Reassembly Figure 1
arXiv preprint2024-11-26

Geometric Point Attention Transformer for 3D Shape Reassembly

Jiahan Li ∗

Tsinghua University, University of Illinois Urbana-Champaign

6D位姿估计

该文针对3D形状重组中仅回归各部件绝对6D位姿、难以建模局部几何关系和装配依赖的问题,提出GPAT:在Transformer注意力中显式融入全局形状、部件间距离/方向以及旋转平移表示,并通过geometric recycling将上一轮预测反馈迭代修正。实验在PartNet语义装配和Breaking Bad碎片装配上优于既有方法,绝对位姿估计与对齐精度提升,但细粒度贴合仍可能需后处理。

RoboPEPP: Vision-Based Robot Pose and Joint Angle Estimation through Embedding Predictive Pre-Training Figure 1
arXiv preprint2024-11-26

RoboPEPP: Vision-Based Robot Pose and Joint Angle Estimation through Embedding Predictive Pre-Training

Raktim Gautam Goswami, Prashanth Krishnamurthy, Yann LeCun, Meta-FAIR

New York University Tandon School of Engineering, New York University Courant Institute of Mathematical Sciences Meta-FAIR

6D位姿估计机器人操作

RoboPEPP面向协作/人机交互中关节角未知、遮挡或截断导致的机器人6D位姿估计失效问题,核心是把机器人运动学结构通过关节区域掩码的自监督嵌入预测预训练注入视觉编码器,再联合关节角与2D关键点估计,并用随机掩码和置信关键点过滤提升鲁棒性。多数据集结果显示其位姿和关节角精度最佳,对遮挡最不敏感且推理时间最低。

Communication-Efficient Cooperative SLAMMOT via Determining the Number of Collaboration Vehicles Figure 1
arXiv preprint2024-11-26

Communication-Efficient Cooperative SLAMMOT via Determining the Number of Collaboration Vehicles

Susu Fang, Hao Li

École d’Ingénieurs SJTU-ParisTech (SPEIT), Shanghai, 200240, China, Department of Automation, Shanghai Jiao Tong University (SJTU), Shanghai, 200240, China

6D位姿估计相机位姿

面向动态交通中单车 SLAMMOT 易受遮挡、而多车协作又受通信带宽限制的问题,论文提出 LiDAR 版 CE C-SLAMMOT:用全局/局部描述子选择最有益车辆来增强自车位姿估计,并用空间置信图筛选具有互补目标信息的协作车辆与交互内容。实验显示其在显著降低原始观测全量共享开销的同时保持较好定位与感知效果,协作目标感知性能超过此前 SOTA。

Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibration Figure 1
arXiv preprint2024-11-26

Boost 3D Reconstruction using Diffusion-based Monocular Camera Calibration

Junyuan Deng, Wei Yin, Xiaoyang Guo, Qian Zhang, Xiaotao Hu, Weiqiang Ren, Xiao-Xiao Long, Ping Tan, Technology, Horizon Robotics

The Hong Kong University of Science and Technology Horizon Robotics Nanjing University

6D位姿估计三维重建

针对单目相机内参标定依赖手工几何假设或小规模数据、在真实场景泛化不足的问题,DM-Calib 利用稳定扩散模型中隐含的焦距—图像内容先验,提出可无损编码内参并适配扩散生成的 Camera Image,将标定转化为条件生成再用 RANSAC 解参。多数据集实验显示其优于基线,并能提升尺度深度、计量、位姿估计和稀疏视角三维重建等任务。

SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splatting Figure 1
arXiv preprint2024-11-28

SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splatting

Gyeongjin Kang, Jisang Yoo : 0, Jihyeon Park, Seungtae Nam, Hyeonsoo Im Sangheon Shin, Sangpil Kim, Hanhwa Systems

Sungkyunkwan University, Yonsei University, Korea University

6D位姿估计三维重建高斯泼溅

SelfSplat针对无相机位姿、无预训练3D先验时通用三维重建难以稳定的问题,将自监督深度/位姿估计与显式3D Gaussian Splatting联合训练,并加入匹配感知位姿网络和深度细化模块来提升跨视角几何一致性。实验在RealEstate10K、ACID、DL3DV上显示,其外观与几何质量优于已有方法,并具备较好的跨数据集泛化。

GMFlow: Global Motion-Guided Recurrent Flow for 6D Object Pose Estimation Figure 1
arXiv preprint2024-11-26

GMFlow: Global Motion-Guided Recurrent Flow for 6D Object Pose Estimation

Xin Liu, Shibei Xue, Dezong Zhao, Shan Ma, Min Jiang

6D位姿估计物体位姿

针对RGB位姿细化中目标被遮挡或裁剪导致渲染图与真实图可见区域不一致、局部光流难以可靠估计的问题,GMFlow将刚体整体运动作为约束,用线性注意力聚合全局上下文,把可见部分的运动传播到不可见区域,并在GRU迭代光流中引入3D形状投影闭环。其在LM-O和YCB-V上精度优于既有方法,同时保持有竞争力的计算效率。

Diffusion Features for Zero-Shot 6DoF Object Pose Estimation Figure 1
arXiv preprint2024-11-25

Diffusion Features for Zero-Shot 6DoF Object Pose Estimation

Bernd Von Gimborn, Philipp Ausserlechner, Markus Vincze, Stefan Thalhammer

Department of Industrial Engineering, University of Applied Sciences Technikum Wien, Automation and Control Institute, TU Wien

6D位姿估计物体位姿

这篇论文针对零样本6DoF位姿估计中过度依赖自监督ViT特征的问题,考察潜在扩散模型特征是否更适合模板匹配与对应点估计。作者在ZS6D式模板管线中用Stable Diffusion替换DINO,并通过hyperfeatures、共投影特征空间和亚像素对应点改造匹配阶段。在LMO、YCBV、TLESS上,平均召回相对ViT基线最高提升27%。

Edge Weight Prediction For Category-Agnostic Pose Estimation Figure 1
arXiv preprint2024-11-25

Edge Weight Prediction For Category-Agnostic Pose Estimation

Or Hirschorn

Tel Aviv University

6D位姿估计类别级位姿

这篇工作针对类别无关位姿估计中人工给定、等权重 pose-graph 难以适配不同物体结构的问题,提出 EdgeCape:不从零预测整图,而是在用户提供的无权图上学习实例相关边权并可增删连接,同时用 Markov Attention Bias 按图上跳数调制关键点自注意力。方法在 MP-100 的 1-shot 与 5-shot 设置取得 SOTA,提升关键点定位精度,尤其面向遮挡和对称结构更有价值。

SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis Figure 1
arXiv preprint2024-11-25

SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis

Hyojun Go, Byeongjun Park : 1, Jiho Jang, Jin-Young Kim Soonwoo Kwon, Changick Kim EverEx, KAIST

EverEx KAIST

6D位姿估计多视角三维重建高斯泼溅

针对现有 3DGS 生成与编辑方法多依赖逐场景优化、且难以统一处理真实场景尺度和相机轨迹的问题,SplatFlow 将多视角图像、深度与相机位姿作为联合潜变量,用文本条件的 Rectified Flow 生成,再由 GSDecoder 前馈解码为 3DGS,并借助免训练反演/补全实现编辑、新视角合成和位姿估计。在 MVImgNet 与 DL3DV-7K 上展示了生成、编辑及补全任务的有效性。

One Diffusion to Generate Them All Figure 1
arXiv preprint2024-11-25

One Diffusion to Generate Them All

Duong H. Le, Tuan Pham, Sangho Lee, Stephan Mandt, Ranjay Krishna, Irvine, Equal contribution

Allen Institute for AI University of California, Irvine University of Washington

6D位姿估计

针对扩散模型通常为文生图、深度、分割或相机位姿等任务分别设计架构与训练流程的问题,OneDiffusion将条件与目标统一表示为带不同噪声尺度的帧序列,使任意帧在推理时都可作为条件或生成目标,无需额外适配器。实验显示其在文生图、多视角生成、身份保持、深度估计和相机位姿估计上达到接近专用模型的竞争性表现,但部分收益可能来自2.8B参数规模与多任务数据。

UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image Figure 1
arXiv preprint2024-11-25

UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image

Xingyu Liu, Gu Wang, Ruida Zhang, Chenyangguang Zhang, Federico Tombari, Google tsinghua.edu.cn, tombari@in.tum.de

Tsinghua University, Technical University of Munich, Google

6D位姿估计物体位姿未知物体点云彩色深度

UNOPose针对未知物体位姿估计依赖CAD模型或多视角参考、上手成本高的问题,改为仅用一张未标定位姿的RGB-D参考图估计相对6D位姿。其核心是粗到细匹配中构建SE(3)不变的全局/局部参考框架,并用重叠区域预测重加权对应关系,以应对大姿态差、遮挡和低视角重叠。在基于BOP的单参考基准上,它显著优于传统和学习式基线,AR_BOP达到70.9%,接近部分依赖CAD模型的方法。

Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching Figure 1
arXiv preprint2024-11-24

Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching

Yujing Sun 1 1 1

The University of Hong Kong, Beijing Institute of Technology, Shanghai Technology University

6D位姿估计物体位姿

针对未知物体6D位姿估计常依赖大量训练、CAD模型或多视图,且扩散生成在大视角差下质量下降的问题,本文用单张参考RGB图生成中间视角,并从参考与查询两侧向这些视角生成后匹配,将大视角变化分解为小步变化。实验显示该方法在GSO和NAVI等合成、真实数据上优于现有方法,尤其提升大视角差场景的鲁棒性。

PEnG: Pose-Enhanced Geo-Localisation Figure 1
arXiv preprint2024-11-24

PEnG: Pose-Enhanced Geo-Localisation

Tavis Shore, Oscar Mendez, Simon Hadfield

Centre for Vision Speech and Signal Processing, University of Surrey

6D位姿估计

PEnG针对跨视角地理定位因卫星瓦片稀疏采样而精度受限的问题,将城市级道路图上的粗检索与道路边内相对位姿估计结合,并引入类似指南针的航向过滤来减少歧义。其两阶段方法利用街景与卫星两种视角,在StreetLearn曼哈顿区域90°视场测试中将中位定位误差由734m降至22.77m,Top-5m相对提升213%,部分样例达亚米级甚至厘米级精度。

Personalization of Wearable Sensor-Based Joint Kinematic Estimation Using Computer Vision for Hip Exoskeleton Applications Figure 1
arXiv preprint2024-11-22

Personalization of Wearable Sensor-Based Joint Kinematic Estimation Using Computer Vision for Hip Exoskeleton Applications

Changseob Song, Bogdan Ivanyuk-Skulskyi, Adrian Krieger, Kaitao Luo, Inseung Kang

6D位姿估计人体姿态

面向髋外骨骼和康复中的实时下肢关节角估计,论文针对IMU深度模型个体化依赖昂贵动捕和大量新数据的问题,提出用单目视觉姿态估计为少量步态周期生成伪标签,再迁移调整TCN的框架。实验在僵膝步态上显示,仅用1–2个步态周期即可个体化模型,RMSE相对仅用健常或僵膝数据训练的TCN进一步降低9.7%和19.9%,但视觉标签质量与真实临床泛化仍需更多验证。

Enhancing Exploration with Diffusion Policies in Hybrid Off-Policy RL: Application to Non-Prehensile Manipulation Figure 1
arXiv preprint2024-11-22

Enhancing Exploration with Diffusion Policies in Hybrid Off-Policy RL: Application to Non-Prehensile Manipulation

Huy Le, Tai Hoang, Miroslav Gabriel, Gerhard Neumann, Ngo Anh Vien

Technology, Karlsruhe, Germany

6D位姿估计机器人操作

本文针对非抓取操作中混合动作空间探索不足、策略多样性弱导致泛化和迁移受限的问题,提出 HyDo:用扩散模型表示连续运动基元参数,并在最大熵离策略 RL 中与离散接触点选择统一优化,同时给出变分下界解释。仿真与零样本 sim2real 实验显示其能产生更多样行为,真实 6D 位姿对齐成功率由 53% 提升到 72%。

mmWave Radar for Sit-to-Stand Analysis: A Comparative Study with Wearables and Kinect Figure 1
IEEE Transactions on Biomedical Engineering2024-11-22

mmWave Radar for Sit-to-Stand Analysis: A Comparative Study with Wearables and Kinect

Shuting Hu, Peggy Ackun, Xiang Zhang, Jennifer Barton, Melvin G. Hector, Mindy J. Fain, Nima Toosizadeh

University of Arizona, Rutgers, The State University of New Jersey

6D位姿估计

面向跌倒风险评估等居家健康监测,论文尝试用非接触、隐私友好的60GHz毫米波雷达替代需佩戴或受光照/视线限制的传感器。其核心做法是将雷达点云经深度姿态模型重建17关节骨架,再用逆运动学提取坐站转换的关节角与阶段特征,并与Kinect和可穿戴传感器对照。45名受试者实验表明,雷达能较好捕捉整体运动模式和躯干等大幅关节运动,但细微动作精度仍受限,文中更倾向支持多传感器融合而非单一替代。

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding Figure 1
arXiv preprint2024-11-21

DINO-X: A Unified Vision Model for Open-World Object Detection and Understanding

Tianhe Ren

IDEA Research Team, International Digital Economy Academy (IDEA), IDEA Research

6D位姿估计

面向机器人等开放环境中长尾物体难以仅靠固定类别或文本提示识别的问题,DINO-X在Grounding DINO 1.5框架上扩展文本、视觉和可调自定义提示,并以Grounding-100M预训练获得对象级表征,统一支持检测、分割、关键点/位姿和描述等头。DINO-X Pro在COCO与LVIS零样本检测达56.0、59.8、52.4 AP,稀有类较前SOTA提升约5.8/5.0 AP;增益可能主要来自大规模数据与提示设计共同作用。

SEMPose: A Single End-to-end Network for Multi-object Pose Estimation Figure 1
Neurocomputing2024-11-21

SEMPose: A Single End-to-end Network for Multi-object Pose Estimation

Untitled Document

Shanghai Jiao Tong University, University of Glasgow

6D位姿估计物体位姿

针对多物体6D位姿中尺度差异、遮挡以及PnP/RANSAC难以端到端训练的问题,SEMPose仅用RGB输入构建单一端到端网络:以纹理-形状引导FPN融合高低频特征,旋转与平移分离并迭代回归,同时用可见区域选择正样本缓解遮挡。实验在LM-O和YCB-V上优于其他RGB单模型方法,推理达32 FPS且耗时基本不随目标数增加。

Dehazing-aided Multi-Rate Multi-Modal Pose Estimation Framework for Mitigating Visual Disturbances in Extreme Underwater Domain Figure 1
arXiv preprint2024-11-21

Dehazing-aided Multi-Rate Multi-Modal Pose Estimation Framework for Mitigating Visual Disturbances in Extreme Underwater Domain

Vidya Sudevan, Fakhreddine Zayer, Taimur Hassan, Sajid Javed, Hamad Karki, Giulia De Masi, Jorge Dias

Center for Autonomous Robotic Systems, Khalifa University, Abu Dhabi, UAE, College of Engineering, Abu Dhabi University, Al Ain, UAE, Autonomous Robotics Research Center, Technology Innovation Institute, Abu Dhabi, UAE

6D位姿估计

面向浑浊、低纹理和颜色衰减导致视觉特征失效的水下机器人定位问题,论文提出 DU-VIO:先用 GAN 去雾/可见性增强预处理图像,再与原始 IMU 通过 CNN-LSTM 做多速率多模态 6D 位姿估计。在修改版 AQUALOC 的三类视觉扰动场景中,作者以平移和旋转 RMSE 对比无去雾基线,并报告推理速度、功耗和 GPU 资源,结果显示去雾模块可降低位姿误差。

Hybrid-Neuromorphic Approach for Underwater Robotics Applications: A Conceptual Framework Figure 1
arXiv preprint2024-11-21

Hybrid-Neuromorphic Approach for Underwater Robotics Applications: A Conceptual Framework

Vidya Sudevan, Fakhreddine Zayer, Sajid Javed, Hamad Karki, Giulia De Masi, Jorge Dias

Center for Autonomous Robotic Systems, Khalifa University, Abu Dhabi, UAE, Khalifa University, Electrical Engineering And Computer Science, Abu Dhabi, UAE, Khalifa University, Mechanical and Nuclear Engineering, Abu Dhabi, United Arab Emirates

6D位姿估计机器人操作

面向水下机器人在浑浊环境中算力与能耗受限、感知控制耦合困难的问题,论文提出混合神经形态概念框架,将脉冲去雾、Spiking-YOLO、脉冲位姿/定位网络与触觉引导的PBVS控制串联,用于保持目标结构在操作者视野内。主要结果是给出模块化系统设计和控制逻辑,预期提升能效、鲁棒性与自主性;但文中未充分说明真实水下实验验证和相对传统方法的定量增益。

Developing Normative Gait Cycle Parameters for Clinical Analysis Using Human Pose Estimation Figure 1
arXiv preprint2024-11-20

Developing Normative Gait Cycle Parameters for Clinical Analysis Using Human Pose Estimation

Rahm Ranjan, David Ahmedt-Aristizabal, Mohammad Ali Armin, Juno Kim

University of New South Wales, Australia

6D位姿估计人体姿态

针对RGB视频步态分析缺少临床可用时空异常定位和规范参考的问题,论文用单目视频的2D人体姿态估计提取关节角,并按步态周期建立常模化运动学参数,使多关节可同步与正常人群对照。方法强调可解释的异常可视化与临床筛查能力,但具体数据集规模、误差和相对传统设备的量化增益文中未充分说明。

Robust SG-NeRF: Robust Scene Graph Aided Neural Surface Reconstruction Figure 1
arXiv preprint2024-11-20

Robust SG-NeRF: Robust Scene Graph Aided Neural Surface Reconstruction

Yi Gu, Dongjun Ye, Zhaorui Wang, Jiaxu Wang, Jiahang Cao, Renjing Xu

HKUST(GZ)

6D位姿估计三维重建

该文针对神经表面重建高度依赖相机位姿、且现有联合优化难以处理镜像等离群位姿的问题,提出利用场景图进行鲁棒置信度估计:用去除视角方向并与主优化解耦的颜色网络区分内点/外点,对内点加强重投影与 IoU 约束,对外点进行 Monte Carlo 重定位,并动态更新匹配图。在 SG-NeRF 与 DTU 上,方法提升了重建质量和位姿精度,但仍依赖足够多的内点视角。

VioPose: Violin Performance 4D Pose Estimation by Hierarchical Audiovisual Inference Figure 1
arXiv preprint2024-11-19

VioPose: Violin Performance 4D Pose Estimation by Hierarchical Audiovisual Inference

Seong Jong Yoo, Snehesh Shrestha, Irina Muresanu, College Park College Park, USA @umd.edu

University of Maryland, College Park, College Park, MD, 20742, USA

6D位姿估计

该工作针对单目视频在小提琴演奏中易受遮挡、视角和采样率限制,难以捕捉揉弦等细微快速动作的问题,利用声音与发声动作的因果关联,引入VioPose层级视听融合网络,将2D姿态与原始音频经动态层级和贝叶斯式更新估计3D时序姿态。作者同时构建含视频、音频和动捕真值的VioDat数据集,实验显示其在重训的多种SoTA基线上取得更准确的姿态序列,并可支持接近动捕结果的演奏分析。

DATAP-SfM: Dynamic-Aware Tracking Any Point for Robust Structure from Motion in the Wild Figure 1
arXiv preprint2024-11-20

DATAP-SfM: Dynamic-Aware Tracking Any Point for Robust Structure from Motion in the Wild

Weicai Ye, Xinyu Chen, Ruohao Zhan, Di Huang, Xiaoshui Huang, Haoyi Zhu, Hujun Bao, Wanli Ouyang, Tong He, Guofeng Zhang

6D位姿估计

面向野外单目视频中大量动态物体导致 SfM/SLAM 位姿漂移的问题,DATAP-SfM 用滑窗 Transformer 同时估计任意点的长程轨迹、可见性与动态标签,并引入一致视频深度缓解2D运动分割和单目深度尺度歧义;随后仅对静态可见轨迹做全局 BA。其在 Sintel、TUM RGBD 动态序列和 DAVIS 视频上提升相机位姿估计鲁棒性,并报告达到 SOTA。

X as Supervision: Contending with Depth Ambiguity in Unsupervised Monocular 3D Pose Estimation Figure 1
arXiv preprint2024-11-20

X as Supervision: Contending with Depth Ambiguity in Unsupervised Monocular 3D Pose Estimation

Yuchen Yang, Xuanyi Liu, Xing Gao, Zhihang Zhong, Xiao Sun

Fudan University Peking University Shanghai Artificial Intelligence Laboratory

6D位姿估计彩色深度

针对无监督单目 3D 姿态估计长期依赖 2D 重建预文本、难以约束深度歧义的问题,论文将其显式建模为多解任务,提出从单个热图局部窗口解码多假设并用 Winner-Takes-All 保留候选解,同时引入 SMPL 先验、GCN 判别器与渲染合成图像约束人体结构分布。方法在 Human3.6M、MPI-INF-3DHP 上超过已有无监督方法,并在数据扩展和动物数据上显示一定泛化性。

IoT-Based 3D Pose Estimation and Motion Optimization for Athletes: Application of C3D and OpenPose Figure 1
arXiv preprint2024-11-19

IoT-Based 3D Pose Estimation and Motion Optimization for Athletes: Application of C3D and OpenPose

Fei Ren, Chao Ren, Tianyi Lyu

Yong In University,Yong In,17902,Korea, Jiao Zuo University, Jiao Zuo,Henan,454150,China

6D位姿估计

面向田径训练中离线姿态分析难以及时反馈的问题,论文提出 IE-PONet,将 IoT 传感采集与 C3D 时空特征、OpenPose 关键点检测及贝叶斯超参优化结合,用于运动员 3D 姿态估计和动作优化。在 NTURGB+D 与 FineGYM 上报告 AP50 为 90.5/91.0、mAP 为 74.3/74.0,消融显示各模块有贡献,但实际实时性与增益来源仍未充分说明。

SPARS3R: Semantic Prior Alignment and Regularization for Sparse 3D Reconstruction Figure 1
arXiv preprint2024-11-15

SPARS3R: Semantic Prior Alignment and Regularization for Sparse 3D Reconstruction

Yutao Tang, Yuxiang Guo, Deming Li

Johns Hopkins University

6D位姿估计三维重建

SPARS3R面向稀疏视角下3DGS/新视角合成易受稀疏初始化、漂浮物和深度先验位姿不准影响的问题,核心思路是把DUSt3R/MASt3R生成的稠密点云与COLMAP SfM的准确稀疏点云对齐:先用带RANSAC的全局Procrustes融合,再借助SAM等语义掩码对全局外点区域做局部对齐。实验显示其在多个基准上较现有稀疏NVS方法获得更清晰、几何更可靠的渲染结果。

GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping Figure 1
arXiv preprint2024-11-19

GLOVER: Generalizable Open-Vocabulary Affordance Reasoning for Task-Oriented Grasping

Teli Ma, Zifan Wang, Jiaming Zhou, Mengmeng Wang, Junwei Liang AI, HKUST(GZ, ZJUT, CSE, HKUST, tma184@connect.hkust-gz.edu.cn, junweiliang@hkust-gz.edu.cn † † † Equal Contribution

AI, HKUST(GZ) ZJUT CSE, HKUST

6D位姿估计未知物体

面向自然语言指定任务的开放词汇抓取,现有方法常依赖耗时的3D辐射场或离线物体记忆,难以实时判断应抓哪个部位。GLOVER将LLM/VLM微调用于从RGB直接预测连续可供性掩码,并用非参数AGE把可供性几何拟合为超二次曲面以估计6D抓取位姿。30个真实桌面场景中,部位识别成功率86.0%、抓取76.3%,推理和位姿估计分别约快29倍、40倍,并展示了跨机器人形态泛化。

IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos Figure 1
arXiv preprint2024-11-18

IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos

Yunong Liu 1, Cristobal Eyzaguirre 1, Manling Li 1, Shubh Khanna 1

Vineeth Ravi, Saumitra Mishra, Stanford University

6D位姿估计

面向机器人家具装配,现有数据要么缺少真实视频轨迹,要么缺少与说明书和3D零件的对应,难以支撑随时间变化的6D位姿理解。本文提出 IKEA Video Manuals,将互联网装配视频、IKEA说明书和3D部件模型做稠密时空对齐,标注2D-3D对应、步骤时间段、分割与位姿,并在计划生成、零件条件分割/位姿估计、视频分割和装配任务上给出基准;实验显示遮挡、视角变化和长序列仍是主要瓶颈。

USP-Gaussian: Unifying Spike-based Image Reconstruction, Pose Correction and Gaussian Splatting Figure 1
arXiv preprint2024-11-15

USP-Gaussian: Unifying Spike-based Image Reconstruction, Pose Correction and Gaussian Splatting

@pku.edu.cn

School of Computer Science, Peking University, State Key Laboratory for Multimedia Information Processing, Peking University, Institute for Artificial Intelligence, Peking University

6D位姿估计三维重建高斯泼溅

针对脉冲相机三维重建中“先重建图像、再估计位姿、再做3DGS”的级联误差问题,USP-Gaussian将脉冲成像、位姿校正与高斯泼溅放入统一优化框架,通过3DGS多视角一致性反哺Recon-Net并联合优化位姿。合成与真实实验显示其可提升图像恢复和重建质量,但代价是训练时间与显存开销更高。

ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweening Figure 1
arXiv preprint2024-11-13

ReMP: Reusable Motion Prior for Multi-domain 3D Human Pose Estimation and Motion Inbetweening

Hojun Jang, Young Min Kim Dept. of Electrical, Computer Engineering, INMC

Dept. of Electrical and Computer Engineering, Seoul National University, Interdisciplinary Program in Artificial Intelligence and INMC, Seoul National University

6D位姿估计人体姿态

针对多传感器人体3D姿态估计在遮挡、噪声和稀疏标注下难以保持时序合理性的问题,ReMP从AMASS等完整SMPL运动序列中学习可复用运动先验,用Transformer-VAE、随机mask与6D旋转/速度等编码建模连续潜空间,并通过蒸馏适配深度点云、LiDAR、IMU和补帧任务。实验显示其在多域数据上优于基线,且小数据训练更高效。

Generalized Pose Space Embeddings for Training In-the-Wild using Anaylis-by-Synthesis Figure 1
arXiv preprint2024-11-13

Generalized Pose Space Embeddings for Training In-the-Wild using Anaylis-by-Synthesis

Dominik Borer

ETH Zurich, Disney Research | Studios

6D位姿估计

针对野外人/动物姿态估计依赖昂贵标注、纯合成又有现实域差距的问题,论文把 analysis-by-synthesis 与合成预训练结合,并用多通道骨架嵌入显式区分左右等语义,缓解单通道表示导致的翻转歧义。Human3.6M 上 MSE 从基线 14.46 降至 10.39,目标视频无标注微调后达 6.62,并展示可扩展到端到端 3D 姿态和动物骨架。

DG-SLAM: Robust Dynamic Gaussian Splatting SLAM with Hybrid Pose Optimization Figure 1
arXiv preprint2024-11-13

DG-SLAM: Robust Dynamic Gaussian Splatting SLAM with Hybrid Pose Optimization

Yueming Xu, Haochen Jiang, Zhongyang Xiao, Jianfeng Feng, Autonomous Driving Division

Fudan University Autonomous Driving Division, NIO

6D位姿估计相机位姿三维重建高斯泼溅

DG-SLAM针对动态物体破坏传统/高斯SLAM静态假设、导致相机跟踪失稳的问题,将3D Gaussian地图用于动态RGB-D SLAM,并结合时空一致深度warp与语义先验生成运动掩码,配合DROID-VO初始化的粗到细混合位姿优化及自适应高斯增删。实验显示其在动态场景的位姿估计、重建和新视角合成上优于已有方法且保持实时渲染,但大规模场景与语义分割误差仍是限制。

RINO: Accurate, Robust Radar-Inertial Odometry with Non-Iterative Estimation Figure 1
arXiv preprint2024-11-16

RINO: Accurate, Robust Radar-Inertial Odometry with Non-Iterative Estimation

Shuocheng Yang, Yueming Cao, Shengbo Eben Li, Jianqiang Wang, Shaobing Xu

6D位姿估计相机位姿

针对雾雨雪中相机和激光里程计易退化的问题,RINO将扫描毫米波雷达与IMU做自适应松耦合融合;核心是改进ORORA的关键点提取与运动畸变补偿,并用非迭代自适应投票估计位姿及其不确定性,再注入Kalman/MAP融合。公开数据上相对基线平移误差降1.06%、旋转误差降0.09°/100m,性能接近SOTA。

Human Arm Pose Estimation with a Shoulder-worn Force-Myography Device for Human-Robot Interaction Figure 1
IEEE Robotics and Automation Letters2024-11-12

Human Arm Pose Estimation with a Shoulder-worn Force-Myography Device for Human-Robot Interaction

Rotem Atari, Eran Bamani, Avishai Sintov

Tel Aviv University

6D位姿估计机器人操作

面向共享工作空间中的人机协作,论文针对视觉受遮挡、光照影响以及 IMU 需频繁校准的问题,提出将 FMG 传感器佩戴在肩部/上背部,用 Transformer 将肌肉形变时序信号映射为肘部和腕部三维位置。实验显示该方法可在跨用户场景下保持可用精度,并在真实机械臂避碰任务中无需视觉感知完成验证。

Towards Seamless Integration of Magnetic Tracking into Fluoroscopy-guided Interventions Figure 1
IEEE Transactions on Biomedical Engineering2024-11-12

Towards Seamless Integration of Magnetic Tracking into Fluoroscopy-guided Interventions

Shuwei Xing, Mateen Mirzaei, Wenyao Xia, Inaara Ahmed-Fazal, Utsav Pardasani, Uditha Jarayathne, Scott Illsley, Leandro Cardarelli Leite, Aaron Fenster, Terry M. Peters, Elvis C. S. Chen

Western University

6D位姿估计

针对透视介入中二维投影导致深度缺失、反复曝光的问题,论文尝试把磁跟踪无缝接入C臂流程:使用可透X线磁场发生器、双层安装架,并以外置铝标记支持C臂位姿估计、透视-CT配准和3D导航。实验显示标记与C臂对磁跟踪精度无临床显著影响,配准平均投影距离约0.7 mm,体模穿刺误差约2–3 mm。

Acoustic-based 3D Human Pose Estimation Robust to Human Position Figure 1
arXiv preprint2024-11-08

Acoustic-based 3D Human Pose Estimation Robust to Human Position

Yusuke Oumi, Yuto Shibata, Go Irie, Akisato Kimura, Yoshimitsu Aoki, Mariko Isogawa

6D位姿估计人体姿态

本文针对主动声学人体3D姿态估计对“人站在扬声器—麦克风连线”假设过强、偏离后反射/衍射信号微弱导致精度下降的问题,提出位置判别器的对抗训练以学习位置不变特征,并用目标时刻前的声学窗口与相位平移增强抵抗到达时间变化;作者构建多站位数据集,实验显示相较既有声学方法在不同人体位置下更稳健。

CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models Figure 1
arXiv preprint2024-11-11

CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models

Junho Kim, Hyungjin Chung, Byung-Hoon Kim EverEx

EverEx Yonsei University

6D位姿估计类别级位姿

针对类别无关位姿估计依赖带标注支持图或骨架信息、在新类别上维护成本高且结果受支持质量影响的问题,CapeLLM将多模态大语言模型引入CAPE,仅用查询图像和关键点详细文本描述定位关键点,并通过定制指令、dynamic round training与非固定高斯的灵活解码增强空间推理和不确定性建模。在MP-100上取得新的SOTA,1-shot表现领先,甚至超过此前5-shot方法。

GenZ-ICP: Generalizable and Degeneracy-Robust LiDAR Odometry Using an Adaptive Weighting Figure 1
2024 IEEE Robotics and Automation Letters (RA-L)2024-11-11

GenZ-ICP: Generalizable and Degeneracy-Robust LiDAR Odometry Using an Adaptive Weighting

Daehan Lee, Hyungtae Lim, Soohee Han

Manuscript received: July 15, 2024; Revised October 8, 2024; Accepted October

6D位姿估计相机位姿点云

针对激光里程计在长走廊等退化场景中因依赖单一 ICP 误差度量而约束不足、优化病态的问题,GenZ-ICP按局部几何平面性自适应融合点到面与点到点残差,使两类度量互补而非固定假设局部平面。实验显示其在常规环境中接近主流 LiDAR odometry,在走廊类退化场景下更稳健,并能减少优化退化。

GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction Figure 1
arXiv preprint2024-11-11

GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction

Shizhe Yuan, Li Zhou

School of Physical Education, Xinyang Normal University, Xinyang , 464000, China, McGill University Montréal, 27708, Canada

6D位姿估计人体姿态

面向青少年体育中复杂动作、遮挡和IoT设备算力受限导致的姿态纠正实时性不足,GTA-Net将关节/骨骼GCN、注意力增强TCN与层级注意力结合,并接入物联网实现在线反馈。在Human3.6M、HumanEva-I和MPI-INF-3DHP上MPJPE分别为32.2mm、15.0mm、48.0mm,文中称在快速运动和遮挡场景下仍保持较高鲁棒性。

Magnetic Field Aided Vehicle Localization with Acceleration Correction Figure 1
arXiv preprint2024-11-10

Magnetic Field Aided Vehicle Localization with Acceleration Correction

Mrunmayee Deshpande, Manoranjan Majji, J. Humberto Ramos

Texas A&M University, University of Florida

6D位姿估计

面向GPS受限、低纹理或低成本车辆导航场景,本文探索用环境磁场辅助定位。核心做法是将沿行驶距离采样的磁场与位置拟合为全局函数地图,用批量磁场序列做欧氏距离匹配,并把匹配位姿反馈给EKF及最小二乘流程估计加速度计偏置和尺度因子。作者在郊区道路车载IMU/磁力计数据上验证了连续位姿更新与加速度校正的可行性,但文中定量增益和相对基线优势未充分说明。

Visuotactile-Based Learning for Insertion with Compliant Hands Figure 1
arXiv preprint2024-11-10

Visuotactile-Based Learning for Insertion with Compliant Hands

Osher Azulay, Dhruv Metha Ramesh, Nimrod Curtis, Avishai Sintov

Osher Azulay, Dhruv Metha Ramesh, Nimrod Curtis and Avishai Sintov

6D位姿估计手部姿态

针对欠驱动柔顺手缺少精确本体感知、在插入等接触密集任务中手物状态不确定的问题,论文将外部深度视觉与环绕式触觉结合,构建带柔顺手和触觉仿真的训练框架,并用教师—学生蒸馏训练 Transformer 策略。结果显示,触觉与视觉互补能改善物体—插孔相对位姿估计,使策略无需实机再训练即可迁移到真实系统并完成更稳健的插入。

Poze: Sports Technique Feedback under Data Constraints Figure 1
arXiv preprint2024-11-08

Poze: Sports Technique Feedback under Data Constraints

Agamdeep Singh, Sujit PB, Mayank Vatsa

6D位姿估计

Poze面向缺少专业教练和大规模训练数据的运动技术反馈场景,以板球手机视频为例,将MotionBERT提取的3D人体姿态序列经归一化和DTW对齐,构建少量理想示例的关节误差均值/方差表示,再用z-score判定动作属性好坏。在287段标注视频上,其属性分类准确率较GPT-4V和LLaVA-v1.6-7b分别提升约70%和196%。

DeepArUco++: Improved detection of square fiducial markers in challenging lighting conditions Figure 1
Image and Vision Computing2024-11-08

DeepArUco++: Improved detection of square fiducial markers in challenging lighting conditions

Untitled Document

University of Córdoba

6D位姿估计

面向机器人定位、SLAM和物体位姿估计中常用的 ArUco 方形标记,论文针对强阴影、低照度、模糊等条件下传统阈值/轮廓方法易失效的问题,提出 DeepArUco++:用检测器、角点精修器和解码器三个 CNN 模块串联,并用合成数据模拟光照扰动训练。实验显示其在自建真实恶劣光照数据集上优于经典 ArUco 和 DeepTag,角点热图模型精度更高但推理更慢。

Tightly-Coupled, Speed-aided Monocular Visual-Inertial Localization in Topological Map Figure 1
arXiv preprint2024-11-08

Tightly-Coupled, Speed-aided Monocular Visual-Inertial Localization in Topological Map

Chanuk Yang, O Hayeon, Kunsoo Huh

6D位姿估计

面向自动驾驶在隧道等 GPS 受限场景中降低对昂贵 RTK/LiDAR 在线定位依赖的问题,本文将离线 LiDAR 点云转成含深度、强度图和相机位姿的拓扑地图,并在定位时用当前单目图像与地图图像做跨模态对应,结合车速与 IMU 在 IESKF 中紧耦合优化 6D 位姿,避免传统 ICP/NDT 或松耦合带来的延迟。开放数据集和自采隧道数据表明其拓扑建图与定位精度优于对比方法,但具体增益中速度约束、匹配网络与滤波设计的分摊贡献文中未充分说明。

Relative Pose Estimation for Nonholonomic Robot Formation with UWB-IO Measurements Figure 1
arXiv preprint2024-11-08

Relative Pose Estimation for Nonholonomic Robot Formation with UWB-IO Measurements

Kunrui Ze, Wei Wang, IEEE Senior Member, Shuoyu Yue, Guibin Sun, Kexin Liu, Jinhu Lü, IEEE Fellow

6D位姿估计相机位姿机器人操作

针对室内、地下等无 GPS 场景中非完整约束机器人编队难以把各自 IO 坐标系统一到公共参考系的问题,论文用单 UWB 测距与本地 IO 直接在局部坐标中估计邻居相对位置和朝向。核心是并发学习估计器利用历史数据将持续激励要求放宽为充分激励,并结合有向拓扑下的协同定位与分布式跟踪控制。地面机器人和无人机的 2D/3D 实验验证了相对位姿估计和编队控制的可行性。

Social EgoMesh Estimation Figure 1
arXiv preprint2024-11-07

Social EgoMesh Estimation

Luca Scofano, Indro Spinelli, Fabio Galasso @diag.uniroma1.it, Italy

Sapienza University of Rome, Italy

6D位姿估计

面向头戴前向相机中穿戴者身体几乎不可见、传统方法依赖SLAM且忽视他人互动的问题,SEE-ME将自我网格估计建模为社会化条件生成任务,用VAE潜空间扩散同时结合3D场景点云与交互对象网格,并分析距离和视线何时最有用。在EgoBody上相较最佳基线将MPJPE降低53%,并在GIMO上验证场景条件的有效性。

Pose2Trajectory: Using Transformers on Body Pose to Predict Tennis Player's Trajectory Figure 1
arXiv preprint2024-11-07

Pose2Trajectory: Using Transformers on Body Pose to Predict Tennis Player's Trajectory

Ali K. AlShami, Terrance Boult, Colorado Springs aalshami@uccs.edu, tboult@uccs.edu

Computer Science Department, University of Colorado, Colorado Springs

6D位姿估计人体姿态

论文面向网球转播中近景相机自动跟拍的需求,关注如何提前半秒到一秒预测球员未来位置。Pose2Trajectory 的核心洞察是仅用边界框中心会受击球、跨步等姿态变化干扰,因此将人体关节、历史轨迹与球位置共同输入编码器—解码器 Transformer,输出未来中心点序列。作者还构建了含球员框、关节和网球位置的数据集,并在 15/30/60 帧预测上显示加入姿态与球信息优于仅轨迹基线,但具体泛化范围和增益来源仍需更多说明。

SuperQ-GRASP: Superquadrics-based Grasp Pose Estimation on Larger Objects for Mobile-Manipulation Figure 1
arXiv preprint2024-11-08

SuperQ-GRASP: Superquadrics-based Grasp Pose Estimation on Larger Objects for Mobile-Manipulation

Xun Tu, Karthik Desingh

6D位姿估计机器人操作

面向椅子、桌子等大物体的移动操作,单视角 RGB-D 和桌面数据训练的抓取网络常因观测不完整与分布偏移失效。SuperQ-GRASP 先用多视角 RGB/NeRF 重建网格,再分解为超二次曲面并组合预计算抓取,同时做位姿估计与碰撞验证。论文在合成、真实物体及 Spot 实机实验中显示其抓取有效性、近邻性和视角不变性优于学习式基线。

GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splatting Figure 1
arXiv preprint2024-11-08

GS2Pose: Two-stage 6D Object Pose Estimation Guided by Gaussian Splatting

Jilan Mei, Junbo Li

Beihang University

6D位姿估计物体位姿三维重建高斯泼溅

针对新物体6D位姿估计依赖高质量CAD模型、对光照遮挡等干扰不稳的问题,GS2Pose用3D Gaussian Splatting重建替代CAD,仅需分割RGBD输入;先以轻量Pose-Net预测NOCS得到粗位姿,再通过基于李代数的可微3DGS重投影优化GS-Refiner细化,并自适应更新部分高斯参数。LineMod实验显示其相较同类方法具有竞争性精度、速度与资源效率。

Estimation of Psychosocial Work Environment Exposures Through Video Object Detection. Proof of Concept Using CCTV Footage Figure 1
arXiv preprint2024-11-06

Estimation of Psychosocial Work Environment Exposures Through Video Object Detection. Proof of Concept Using CCTV Footage

Claus D. Hansen, Thuy Hai Le, David Campos

Department of Sociology and Social Work, Aalborg University, Department of Computer Science, Aalborg University

6D位姿估计

论文动机是将已存在但常被闲置的零售 CCTV,用作比员工自报更客观的心理社会工作环境观测。其核心做法不是新的 6D 位姿算法,而是把 YOLOv8、DeepSORT 与 BlazePose 串成管线,并按距离、持续时间和姿态规则判别顾客—员工互动。小规模低质视频上检测与跟踪召回较高、准确性尚可,但员工跟踪困难使姿态与互动类型识别仍受限。

Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Data Figure 1
arXiv preprint2024-11-05

Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Data

Seunggeun Chi

Purdue University, Honda Research Institute USA

6D位姿估计人体姿态

面向HMD/AR中缺少手柄、身体可见性低导致的自我身体位姿估计问题,DSPoser的关键洞察是:视频中仅约20%帧可见的手部仍能约束全身运动。方法先用带不确定性的MAE补全稀疏手轨迹,再以不确定性引导条件扩散生成全身姿态。在AMASS与Ego-Exo4D上优于现有基线,Ego-Exo4D MPJPE达16.84 cm,AMASS稀疏设置MPJPE由12.08降至5.51 cm。

HFGaussian: Learning Generalizable Gaussian Human with Integrated Human Features Figure 1
arXiv preprint2024-11-05

HFGaussian: Learning Generalizable Gaussian Human with Integrated Human Features

Arnab Dey, Cheng-You Lu, Andrew I. Comport, Srinath Sridhar, Chin-Teng Lin, Jean Martinet

I3S-CNRS/Université Côte d’Azur University of Technology Sydney Brown University

6D位姿估计高斯泼溅

针对现有人体 3D Gaussian 方法依赖 SMPL 等参数模型、或只重建外观而缺少骨架/关键点/密集姿态等结构信息的问题,HFGaussian 在可泛化 Gaussian splatting 骨干上引入 feature splatting 与基于高斯子集点云的姿态回归网络,从稀疏多视图图像同时预测新视角、人体现实外观和生物力学特征。论文报告其可在未见人体上免微调运行,达到约 25 FPS,并在 3 个数据集上相对人体高斯重建和姿态估计方法取得 SOTA 级表现。

Semantic Masking and Visual Feature Matching for Robust Localization Figure 1
arXiv preprint2024-11-04

Semantic Masking and Visual Feature Matching for Robust Localization

Luisa Mao, Ryan Soussan, Brian Coltin, Trey Smith, Joydeep Biswas

Trey Smith, the NASA Ames Research Center

6D位姿估计

面向国际空间站等长期运行、场景频繁重配置且算力受限的机器人定位问题,论文在传统视觉特征匹配中加入轻量语义遮罩:仅保留位于长期静态物体上且语义类别一致的匹配,以减少环境变化带来的误配。作者在 Astrobee ISS 数据集上验证了地图重定位和相对位姿估计,结果显示 ATE 与正确匹配比例均有改善。

Activating Self-Attention for Multi-Scene Absolute Pose Regression Figure 1
arXiv preprint2024-11-03

Activating Self-Attention for Multi-Scene Absolute Pose Regression

Miso Lee

Sungkyunkwan University

6D位姿估计

该文针对多场景绝对位姿回归中 Transformer 编码器自注意力塌缩、全局关系未被利用的问题,指出根因是 query-key 嵌入空间畸变及可学习位置编码训练不足。方法通过 query-key 对齐辅助损失和固定二维正弦位置编码激活自注意力,在不增加推理内存的情况下提升室内外多场景 6D 相机位姿估计表现。

3D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction Figure 1
arXiv preprint2024-11-04

3D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction

Technology (POSTECH

Pohang University of Science and Technology (POSTECH), South Korea

6D位姿估计

针对单图3D姿态回归中欧拉角、四元数等空间参数化存在不连续、奇异性且与球面CNN频域计算不匹配的问题,本文将旋转直接表示为Wigner-D谐波系数,并用SO(3)等变网络和频域MSE损失进行连续回归,可兼容对称物体的分布式损失。在ModelNet10-SO(3)和PASCAL3D+上达到SOTA,表现出更好的精度、鲁棒性、采样效率和未见旋转泛化能力。

Whole-Herd Elephant Pose Estimation from Drone Data for Collective Behavior Analysis Figure 1
arXiv preprint2024-10-31

Whole-Herd Elephant Pose Estimation from Drone Data for Collective Behavior Analysis

Brody McNutt, Libby Zhang, Angus Carey-Douglas, Fritz Vollrath : 3, Frank Pope : 3, Leandra Brickson : 2

Form Bio, Austin, TX, USAColossal Biosciences, Dallas, TX, USASave the Elephants, Nairobi, KenyaUniversity of Oxford, Oxford, United

6D位姿估计

为弥补人工观察难以同时覆盖野外象群个体与群体行为的问题,论文将无人机俯拍低分辨率视频用于整群大象关键点估计,并比较“检测后裁剪+DLC”的模块化流程与端到端 YOLO-NAS-Pose。结果显示两者在测试集上可支持基础行为分析,但 YOLO-NAS-Pose 在 RMSE、PCK、OKS 及检测 mAP 上均优于 DeepLabCut;文中也指出精度尚不足以完全自动化,后续需利用时序信息改进耳朵等细粒度关键点。

No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images Figure 1
arXiv preprint2024-10-31

No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images

Botao Ye, Sifei Liu, Haofei Xu, Xueting Li Marc Pollefeys, Ming-Hsuan Yang, Songyou Peng ETH Zurich, NVIDIA, Microsoft

ETH Zurich NVIDIA Microsoft UC Merced

6D位姿估计高斯泼溅

针对稀疏多视图重建依赖精确相机位姿、在低重叠或无纹理场景易失败的问题,NoPoSplat将首帧局部坐标作为规范空间,直接预测对齐的3D Gaussian,并用相机内参token缓解尺度歧义;仅以光度损失训练即可实时推理。实验显示其在无位姿输入下的新视角合成可超过需位姿方法,位姿估计也显著优于现有方法。

SceneComplete: Open-World 3D Scene Completion in Complex Real World Environments for Robot Manipulation Figure 1
arXiv preprint2024-11-06

SceneComplete: Open-World 3D Scene Completion in Complex Real World Environments for Robot Manipulation

Aditya Agarwal, Gaurav Singh, Bipasha Sen, Tomás Lozano-Pérez, Leslie Pack Kaelbling

Manuscript received: June 14, 2025; Revised

6D位姿估计机器人操作

面向家庭、医院等杂乱开放场景中的机器人抓取与放置,SceneComplete关注单视角RGB-D下遮挡物体的完整三维理解。其核心不是训练闭集模型,而是串联VLM、文本分割、图像补全、image-to-3D、视觉描述子与位姿配准模块,生成逐物体注册网格。文中在GraspNet-1B和YCB-Video等真实桌面场景上显示其重建质量优于OctMAE、ZeroGrasp,并能支持平行夹爪和灵巧手的更稳健抓取提案。

SCRREAM : SCan, Register, REnder And Map:A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark Figure 1
arXiv preprint2024-10-30

SCRREAM : SCan, Register, REnder And Map:A Framework for Annotating Accurate and Dense 3D Indoor Scenes with a Benchmark

HyunJun Jung

Technical University of Munich, Technical University of Munich &Shun-Cheng Wu, Technical University of Munich &William Bittner, Technical University of Munich &Nikolas Brasch, Technical University of Munich &Jifei Song, Huawei Noah’s Ark Lab

6D位姿估计数据集/基准

针对现有室内3D数据集为追求规模而常含不完整网格、难以作为密集几何与6D位姿等任务可靠真值的问题,SCRREAM提出“逐物体高质量扫描—场景重注册—合成渲染—真实视频位姿映射”的标注流程,在无需机械臂/外部跟踪的手持相机轨迹下生成完整场景网格和精确深度真值;论文发布11个示例场景与工具,并用其建立室内重建、NVS和SLAM基准,但6D位姿等仅给少量样例且硬件成本与可扩展性受限。

LiVisSfM: Accurate and Robust Structure-from-Motion with LiDAR and Visual Cues Figure 1
arXiv preprint2024-10-29

LiVisSfM: Accurate and Robust Structure-from-Motion with LiDAR and Visual Cues

Hanqing Jiang, Liyang Zhou, Zhuang Zhang, Yihao Yu

6D位姿估计点云

针对大规模重建中纯视觉受弱纹理/反光影响、纯 LiDAR/LIO 又易受几何歧义和漂移限制的问题,LiVisSfM 将 LiDAR 与鱼眼视觉纳入离线 SfM:用点到高斯残差将 LiDAR 帧配准到体素地图,并结合 LiDAR-visual BA、显式回环与增量体素更新,在不依赖 IMU 的情况下优化位姿。KITTI 和自采数据上相较多种 LIO/LIVO 获得更稳的位姿恢复和更准确完整的稠密点云。

PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting Figure 1
arXiv preprint2024-10-29

PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting

Sunghwan Hong, Jaewoo Jung, Heeseong Shin, Jisang Han, Jiaolong Yang, Chong Luo, Seungryong Kim

6D位姿估计三维重建高斯泼溅

PF3plat面向稀疏、无相机位姿图像的新视角合成,试图摆脱3DGS对精确位姿、密集视角和大重叠的依赖。其关键做法是用预训练单目深度与视觉匹配先粗对齐高斯中心,再用轻量模块细化深度和位姿,并以几何置信度调节高斯参数预测。实验在多个真实室内外数据集上取得SOTA渲染质量和位姿精度,消融支持两阶段对齐设计的有效性。

HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation Figure 1
Neurocomputing2024-10-29

HRPVT: High-Resolution Pyramid Vision Transformer for medium and small-scale human pose estimation

Zhoujie Xu, Meng Dai, Qing Zhang, Xiaodi Jiang

Shanghai Institute of Technology

6D位姿估计人体姿态

本文针对中小尺度人体在低分辨率、遮挡等场景下关键点定位易受热图量化误差和高分辨率恢复开销影响的问题,提出HRPVT:以PVT v2建模长程关系,引入HRPM把CNN的局部性与尺度不变性注入高分辨率特征,并用SimCC替代热图上采样。其在COCO val/test-dev达76.3/75.5 AP,相比HRNet-W48参数和GFLOPs约降60%以上,中尺度AP表现突出。

EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Data Figure 1
WACV 20252024-10-29

EI-Nexus: Towards Unmediated and Flexible Inter-Modality Local Feature Extraction and Matching for Event-Image Data

Zhonghua Yi, Hao Shi, Qi Jiang, Kailun Yang, Ze Wang, Diyang Gu, Yufan Zhang, Kaiwei Wang

State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University, Jiaxing Research Institute, Zhejiang University, School of Robotics, Hunan University

6D位姿估计事件相机

事件相机与RGB图像在标定、SLAM和定位中需要跨模态特征匹配,但以往先把事件显式转成图像会丢失信息。EI-Nexus改为分别学习事件/图像关键点提取器,并用局部特征蒸馏把成熟图像特征的视角一致性迁移到事件分支,再结合上下文聚合匹配。作者还构建MVSEC-RPE与EC-RPE基准,实验显示其关键点相似性和相对位姿估计均优于事件转视频管线。

Synthetica: Large Scale Synthetic Data for Robot Perception Figure 1
arXiv preprint2024-10-28

Synthetica: Large Scale Synthetic Data for Robot Perception

Ritvik Singh, Jingzhou Liu, Karl Van Wyk, Yu-Wei Chao, Jean-Francois Lafleche, Florian Shkurti, Nathan Ratliff, Ankur Handa

6D位姿估计机器人操作仿真到现实

面向机器人操作中检测/位姿前端对低成本标注、强鲁棒性和实时性的需求,Synthetica用光真实射线追踪与大规模随机化生成270万合成图像,并结合训练增强和TensorRT/核融合训练实时检测Transformer。结果在YCBV/BOP检测上达到SOTA,推理约50–100Hz、显著快于既有方法;但适用性依赖CAD模型,增益可能主要来自scaling/data。

BLAPose: Enhancing 3D Human Pose Estimation with Bone Length Adjustment Figure 1
arXiv preprint2024-10-29

BLAPose: Enhancing 3D Human Pose Estimation with Bone Length Adjustment

Chih-Hsiang Hsu 0009-0000-4401-1324, Jyh-Shing Roger Jang 0000-0002-7319-9095

6D位姿估计人体姿态

BLAPose针对2D-to-3D人体姿态提升中常忽视骨长一致性、身体对称性导致姿态不自然的问题,提出用整段视频信息的GRU/Bi-GRU预测骨长,并用SMPL生成的合成骨长做训练增强;随后保持骨骼方向、替换为预测骨长来校正任意lifting模型,并可用骨长信息微调。Human3.6M上骨长预测优于既有方法,多个模型经调整后MPJPE/P-MPJPE均有稳定下降,较大增益主要出现在原始骨长误差更高的模型。

RopeTP: Global Human Motion Recovery via Integrating Robust Pose Estimation with Diffusion Trajectory Prior Figure 1
arXiv preprint2024-11-01

RopeTP: Global Human Motion Recovery via Integrating Robust Pose Estimation with Diffusion Trajectory Prior

Mingjiang Liang, Yongkang Cheng, Hualin Liang

University of Technology Sydney, Tencent (China), South China University of Technology

6D位姿估计

针对单目视频中人体遮挡导致局部姿态不稳、动态相机下全局轨迹歧义大的问题,RopeTP将分层注意力引导的鲁棒姿态估计与由局部关节序列条件化的扩散轨迹先验结合,用可见身体结构推断被遮挡部位,并生成更自然的全局运动。实验在3DPW、Human3.6M及遮挡场景上优于现有方法,在EMDB上也超过依赖SLAM初值和繁重优化的动态相机方案。

Harmony4D: A Video Dataset for In-The-Wild Close Human Interactions Figure 1
arXiv preprint2024-10-27

Harmony4D: A Video Dataset for In-The-Wild Close Human Interactions

Rawal Khirodkar, Jyun-Ting Song, Jinkun Cao, Zhengyi Luo

Carnegie Mellon University

6D位姿估计数据集/基准

针对现有多人接触数据多在受控室内、动作编排且难以泛化的问题,Harmony4D采集野外摔跤、舞蹈、MMA等近距离互动多视角视频,并用实例分割条件2D姿态、3D姿态预测与SMPL拟合构建少人工干预的无标记4D标注。数据含166万图像、332万人体实例;评测显示现有网格恢复在遮挡接触下明显失效,HMR2.0经该数据微调后PVE提升54.8%。

Neural Fields in Robotics: A Survey Figure 1
arXiv preprint2024-10-26

Neural Fields in Robotics: A Survey

Mauro Comi 2 ⁢ 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Yen-Chen Lin 3 ⁢ 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Nick Heppert 4 ⁢ 4 ^ start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT, Zsolt Kira 5 ⁢ 5 ^ start_FLOATSUPERSCRIPT 5 end_FLOATSUPERSCRIPT, Nvidia

Toyota Research Institute, University of Bristol, Nvidia, University of Freiburg, Georgia Institute of Technology

6D位姿估计机器人操作综述

机器人需要比点云、体素更精细且可微的3D场景表示来支撑位姿估计、操作与导航。本文的核心洞察是将神经场作为机器人感知到决策的统一表示,系统梳理 Occupancy、SDF、NeRF 与 3D Gaussian Splatting 四类框架,并按位姿估计、操作、导航、物理和自动驾驶归纳200余篇工作。主要结果是给出优势、适用场景与开放挑战的综述性结论;具体性能增益并非本文重点,增益来源不清。

DECADE: Towards Designing Efficient-yet-Accurate Distance Estimation Modules for Collision Avoidance in Mobile Advanced Driver Assistance Systems Figure 1
arXiv preprint2024-10-25

DECADE: Towards Designing Efficient-yet-Accurate Distance Estimation Modules for Collision Avoidance in Mobile Advanced Driver Assistance Systems

Muhammad Zaeem Shahzad, Muhammad Abdullah Hanif, Muhammad Shafique

New York University

6D位姿估计

面向手机等受限设备上的移动 ADAS 碰撞预警,DECADE 避免昂贵的逐像素深度估计,改为对检测框逐目标回归距离;其关键是在框尺寸、位置、类别特征外,引入姿态网络估计目标 allocentric 朝向,以缓解同距物体因朝向导致的框宽变化。接入并微调 YOLO 后,在 KITTI 0–150m 距离估计上达到 1.38m MAE、7.3% 相对误差,并补充了按类别和 0–70m 安全关键范围的评估。

Where Am I and What Will I See: An Auto-Regressive Model for Spatial Localization and View Prediction Figure 1
arXiv preprint2024-10-24

Where Am I and What Will I See: An Auto-Regressive Model for Spatial Localization and View Prediction

Junyi Chen, Di Huang, Weicai Ye, Wanli Ouyang, Tong He

Shanghai AI Lab Shanghai Jiao Tong University

6D位姿估计

面向机器人/智能体常见的“我在哪里、会看到什么”空间推理难题,论文提出 GST,将相机用 Plücker 坐标转成可自回归建模的 token,把相对位姿估计与新视角合成统一为图像—相机联合分布学习,而非两个独立任务。实验称联合优化带来更稳定训练,并在单步新视角生成和相对相机位姿估计上优于分离建模,同时可采样合理相机位姿;具体增益中数据与 scaling 的贡献仍需更多消融说明。

VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimation Figure 1
arXiv preprint2024-10-24

VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimation

Germany daniel.bermuth@uni-a.de

University of Augsburg, Germany, University of Augsburg

6D位姿估计多视角

多视角多人姿态估计在跨场景部署时常因训练数据和相机设置变化而失效,论文围绕“未见数据集上的泛化”重新评测多种方法。作者提出无需训练的 VoxelKeypointFusion,将各视角 2D 关键点热图融合到体素空间,并可结合深度掩码、扩展到全身关键点。实验显示学习式方法直接迁移往往较差,而该方法在多数据集间取得最佳泛化表现且速度尚可,深度信息主要减少无效人体检测。

Robust Two-View Geometry Estimation with Implicit Differentiation Figure 1
arXiv preprint2024-10-23

Robust Two-View Geometry Estimation with Implicit Differentiation

Vladislav Pyatov, Iaroslav Koshelev, Stamatis Lefkimmiatis

6D位姿估计

论文针对相机位姿估计中两视图几何易受误匹配影响、RANSAC难以端到端训练的问题,将鲁棒基础矩阵估计建模为隐式层,提出 IHLS 求解器,并用匹配置信度驱动的可学习权重反复抑制外点,接入 LoFTR 形成可微流水线。实验覆盖室内外多个数据集,报告相对传统与学习式方法有较大幅度提升。

YOLOv11: An Overview of the Key Architectural Enhancements Figure 1
arXiv preprint2024-10-23

YOLOv11: An Overview of the Key Architectural Enhancements

Rahima Khanam, Queensgate, Huddersfield HD1 3DH, Correspondence: rahima.khanam@hud.ac.uk

Department of Computer Science, Huddersfield University, Queensgate, Huddersfield HD1 DH, UK

6D位姿估计

该文面向实时视觉在检测、姿态估计等任务中对精度、速度和部署成本的权衡需求,梳理YOLOv11相对前代的结构变化:以C3k2替代部分C2f、保留SPPF并加入C2PSA空间注意力,强化多尺度特征与关键区域建模。文中认为YOLOv11在多尺寸模型上提升mAP、推理速度和参数效率,尤其小模型更适合边缘实时应用;但作为综述性分析,具体增益来源和实验控制未充分说明。

Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers Figure 1
arXiv preprint2024-10-21

Assisted Physical Interaction: Autonomous Aerial Robots with Neural Network Detection, Navigation, and Safety Layers

Andrea Berra, Viswa Narayanan Sankaranarayanan, Achilleas Santi Seisa, Julien Mellet, Udayanga G.W.K.N. Gamage, Sumeet Gajanan Satpute, Fabio Ruggiero, Vincenzo Lippiello, Silvia Tolu, Matteo Fumagalli, George Nikolakopoulos, Miguel Ángel Trujillo Soto, Guillermo Heredia

CATEC, Advanced Center for Aerospace Technologies, Seville, Spain, PRISMA Lab, Department of Electrical Engineering and Information Technology, University of Naples Federico II Naples, Italy, Robotics, Vision, and Control Group School of Engineering, University of Seville, Seville, Spain

6D位姿估计机器人操作航天器

面向工业巡检/维护中无人机需在狭窄、危险环境内与目标安全接触的问题,论文将目标检测与安全控制解耦:用边缘计算承载神经网络检测与RGB-D位姿估计,减轻机载负载;再以控制障碍函数约束导航,使无人机无需外部规划器即可接近并建立接触。结果主要来自仿真控制验证、跨光照检测评估和真实场景检测分析,实机闭环接触效果文中未充分说明。

ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videos Figure 1
arXiv preprint2024-10-21

ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videos

Tao Tang, Hong Liu, Yingxuan You, Ti Wang, Wenhao Li

State Key Laboratory of General Artificial Intelligence, Peking University, Shenzhen Graduate School

6D位姿估计

针对视频人体网格恢复依赖低分辨率图像特征、易受背景/光照/服装噪声影响而导致姿态不准和运动抖动的问题,ARTS将估计到的3D骨架解耦为关节位置、骨长和运动表征,并用TIK、BSF、MCR组成的半解析回归器分别约束SMPL姿态、形状与时序细化。在3DPW、MPI-INF-3DHP和Human3.6M上,方法在逐帧精度和时序一致性上整体优于现有视频HMR方法。

Neural Active Structure-from-Motion in Dark and Textureless Environment Figure 1
Lecture notes in computer science2024-10-20

Neural Active Structure-from-Motion in Dark and Textureless Environment

Kazuto Ichimaru, Diego Thomas, Takafumi Iwaguchi, Hiroshi Kawasaki

Kyushu University, National Defense Academy of Japan

6D位姿估计

针对暗光、无纹理场景中传统 SfM 难以从图像特征恢复传感器位姿的问题,论文提出 Active SfM:仅利用结构光稀疏投影图案,将 Neural-SDF、面向结构光的体渲染流程与混合编码联合优化场景几何和相机位姿。合成与真实实验表明,即使初始位姿不可靠,也能从投影图案中恢复较准确的形状与运动位姿。

POSE: Pose estimation Of virtual Sync Exhibit system Figure 1
arXiv preprint2024-10-20

POSE: Pose estimation Of virtual Sync Exhibit system

Hao-Tang Tsui, Yu-Rou Tuan, Jia-You Chen

College of ECE, National Yang Ming Chiao Tung University

6D位姿估计

该工作面向健身环、手柄等体感交互成本高且动作受限的问题,尝试用普通摄像头的人体3D姿态估计驱动虚拟角色。其核心在于将 TransPose/MediaPipe、双目与 AprilTag 校准、Panda3D 逆运动学约束和多进程控制串成低延迟原型,并处理姿态坐标到游戏骨骼的映射。论文展示了可同步动作并与虚拟环境交互的平台设想,但缺少定量延迟、精度和用户实验,主要结果与增益来源文中未充分说明。

Graph Optimality-Aware Stochastic LiDAR Bundle Adjustment with Progressive Spatial Smoothing Figure 1
IEEE Transactions on Intelligent Transportation Systems2024-10-18

Graph Optimality-Aware Stochastic LiDAR Bundle Adjustment with Progressive Spatial Smoothing

Jianping Li, Member, IEEE, Thien-Minh Nguyen, Muqing Cao, Shenghai Yuan, Tzu-Yi Hung, Lihua Xie, Fellow

Nanyang Technological University, Carnegie Mellon University

6D位姿估计点云

面向低成本平台在 GNSS 受限大场景中进行高精度 LiDAR 建图,论文指出传统 LBA 受平面关联脆弱、观测冗余和法方程稠密限制。PSS-GOSO 用渐进空间平滑增强特征关联,并按图最优性稀疏化约束,再结合随机聚类与图边缘化提升可扩展性。多平台、多场景实验显示其精度和效率优于现有方法,生成地图还用于末端配送应用。

Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior Figure 1
arXiv preprint2024-10-18

Multi-modal Pose Diffuser: A Multimodal Generative Conditional Pose Prior

Calvin-Khang Ta, Arindam Dutta, Rohit Kundu, Rohit Lal, Hannah Dela Cruz, Dripta S. Raychaudhuri, Amit Roy-Chowdhury

Calvin-Khang Ta 1 , Arindam Dutta 1 , Rohit Kundu 1 , Rohit Lal 1 , Hannah Dela Cruz 1 , Dripta S. Raychaudhuri 1 , Amit Roy-Chowdhury

6D位姿估计

针对单目3D人体姿态估计中深度歧义、遮挡和域外场景易产生不合理SMPL姿态的问题,论文提出MOPED,将扩散模型作为SMPL位姿先验,并可选择性融合图像与文本条件来收缩到语义相关的姿态空间。实验覆盖姿态估计、去噪和补全,结果显示其较既有先验更能生成多样且可信的人体姿态。

Sim2real Cattle Joint Estimation in 3D point clouds Figure 1
arXiv preprint2024-10-18

Sim2real Cattle Joint Estimation in 3D point clouds

Mohammad Okour, Raphael Falque, NSW, Australia @student.uts.edu.au, @uts.edu.au

Robotics Institute, University of Technology Sydney, NSW, Australia

6D位姿估计点云仿真到现实

面向畜牧监测中真实牛只3D关节标注稀缺的问题,论文用单个动画牛模型生成多姿态合成点云,并通过形状增强缩小 sim2real 差距;核心是将表面测地距离与多边定位结合到 PointNet++ 关键点框架,从外表面曲率推断体内关节。真实牛行走数据上关节平均误差约0.026,髋高预测R²为0.64、RMSE为2.97,显示可用于骨长与体尺估计但仍有改进空间。

Unlabeled Action Quality Assessment Based on Multi-dimensional Adaptive Constrained Dynamic Time Warping Figure 1
arXiv preprint2024-10-18

Unlabeled Action Quality Assessment Based on Multi-dimensional Adaptive Constrained Dynamic Time Warping

Renguang Chen : 1, Guolong Zheng : 2, Xu Yang : 3, Zhide Chen : 4, Jiwu Shu : 5 : 6, Wencheng Yang : 7, Kexin Zhu : 8, Chen Feng : 9

College of Computer and Cyber Security, Fujian Normal University, Fuzhou, China, College of Computer and Data Science, Minjiang University, Fuzhou, China, Department of Computer Science and Technology, Tsinghua University, Beijing, China, School of Mathematics, Physics and Computing, University of Southern Queensland,Toowoomba, Australia, Department of Computer Science and Engineering, National Sun Yat-sen University, Taiwan, China, Department of information engineering,Fuzhou Polytechnic, Fuzhou, China

6D位姿估计

针对在线体育作业评分依赖专家标注、难以快速扩展到新动作的问题,论文提出无标签的 MED-ACDTW:以标准视频为模板,用结合2D/3D骨架的关节角、方向与肢体协同特征进行DTW匹配,并用MED距离和自适应约束提升帧对齐判别性。实验显示,多维特征较单用2D或3D提升约2–3%,自适应约束使判别性提升约30%,同时发布BGym数据集。

DualQuat-LOAM: LiDAR Odometry and Mapping parametrized on Dual Quaternions Figure 1
Robotics and Autonomous Systems. 191 (2025) 1050092024-10-17

DualQuat-LOAM: LiDAR Odometry and Mapping parametrized on Dual Quaternions

Edison P. Velasco-Sánchez, Luis F. Recalde, Guanrui Li, Francisco A. Candelas-Herias, Santiago T. Puente-Mendez, Fernando Torres-Medina

6D位姿估计相机位姿点云

面向移动机器人在快速运动、急转弯和长轨迹中易累积漂移的问题,DualQuat-LOAM将边缘、平面与STD点云描述子及优化目标统一表示为对偶四元数,使平移和姿态误差可在同一代数框架中直接耦合,避免SE(3)矩阵冗余。实验显示其相较其他纯LiDAR里程计降低漂移,在KITTI上达到0.79%平移误差、0.0039°/m旋转误差,平均运行53 ms。

Object Pose Estimation Using Implicit Representation For Transparent Objects Figure 1
arXiv preprint2024-10-17

Object Pose Estimation Using Implicit Representation For Transparent Objects

Varun Burde 0000-0001-8317-6164, Artem Moroz 0009-0007-5831-7106, Vít Zeman 0009-0007-9304-9354, Pavel Burget 0000-0002-4787-8182

6D位姿估计物体位姿

针对透明/反光物体中深度失效、CAD 合成纹理难以表达视角相关外观的问题,论文将 NeRF 作为物体隐式表示嵌入 render-and-compare 6D 位姿估计,用少量带位姿多视图图像为单张 RGB 查询生成更真实的候选视图。在四个透明和高反光日用品数据集上,方法超过或接近现有强基线,并显示对透明物体微调能显著优于 CAD 表示,但 NeRF 渲染开销较大。

Optimizing Multi-Task Learning for Accurate Spacecraft Pose Estimation Figure 1
arXiv preprint2024-10-16

Optimizing Multi-Task Learning for Accurate Spacecraft Pose Estimation

Francesco Evangelisti, Francesco Rossi, Tobia Giani, Ilaria Bloise, Mattia Varile

6D位姿估计航天器

面向在轨服务中单目相机替代多传感器的航天器6D位姿估计需求,本文构建Unity合成Tango数据集,并以EfficientNet/BiFPN为骨干设计可开关任务头的模块化多任务网络,系统比较直接位姿、关键点热图、检测框和分割及多种损失权重。结果显示直接位姿与热图PnP估计通常互相促进,而检测框和分割贡献有限,甚至会降低整体精度。

Contrastive Touch-to-Touch Pretraining Figure 1
arXiv preprint2024-10-15

Contrastive Touch-to-Touch Pretraining

Samanta Rodriguez, Yiming Dou, William van den Bogert, Miquel Oller, Kevin So, Andrew Owens, Nima Fazeli

University of Michigan

6D位姿估计

针对触觉传感器形态差异导致模型难以跨设备复用的问题,CTTP用同一物体同一抓取配置下的GelSlim与Soft Bubble成对触觉信号做对比预训练,将两类传感器对齐到共享嵌入空间,而非依赖重建或任务标签。实验表明,该表示可作为分类和手内6D位姿估计的有效预训练,并能让在一种传感器上训练的下游模型零训练迁移到另一种传感器;优势主要体现在跨传感器泛化,批大小过大时对齐会变差。

X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing Figure 1
arXiv preprint2024-10-18

X-Fi: A Modality-Invariant Foundation Model for Multimodal Human Sensing

Xinyan Chen

Nanyang Technological University, Codes are available at

6D位姿估计

针对人类感知中相机、LiDAR、毫米波、WiFi等传感器各有局限且现有多模态模型绑定固定组合、增删模态需重训的问题,X-Fi提出一次训练即可支持任意已见模态单独或组合输入的模态不变框架;其用Transformer适配可变输入,并通过X-fusion以跨模态表示查询各模态键值来保留模态特征。在MM-Fi与XRF55六种模态上,姿态估计MPJPE/PA-MPJPE分别提升24.8%/21.4%,活动识别提升2.8%。

Occluded Human Pose Estimation based on Limb Joint Augmentation Figure 1
Neural Computing and Applications2024-10-13

Occluded Human Pose Estimation based on Limb Joint Augmentation

Gangtao Han, Chunxiao Song, Hao Wang, Enqing Chen, Guanghui Wang

Zhengzhou University, Toronto Metropolitan University

6D位姿估计人体姿态

针对人体姿态估计在遮挡场景中泛化差、依赖复杂网络会增加推理负担的问题,本文把重点放在更易被遮挡且自由度更高的肢体关节:训练时用遮挡块随机覆盖肢体关节,并引入基于肢体图的动态结构损失约束相邻关节关系。该方法在 OCHuman 与 CrowdPose 上带来显著性能提升,且推理阶段不增加计算成本。

Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors Figure 1
arXiv preprint2024-10-12

Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors

Hritam Basak, Hadi Tabatabaee, Shreekant Gayaka, Ming-Feng Li, Xin Yang, Cheng-Hao Kuo, Arnie Sen, Min Sun, Zhaozheng Yin

Amazon Lab126, Carnegie Mellon University, Stony Brook University

6D位姿估计三维重建高斯泼溅

本文针对单图像生成3D物体时“2D扩散纹理清晰但多视角不一致、3D扩散几何一致但纹理过平滑”的矛盾,将3D Gaussian Splatting与频域两阶段蒸馏结合:用3D先验的低频约束几何,用2D先验的高频补充边缘和纹理,并形成混合频率SDS损失。实验称在三个公开数据集上同时提升纹理与几何指标,可在一分钟内生成资产,并展示其可用于受限视角下的6D位姿估计与跟踪。

Towards Multi-Modal Animal Pose Estimation: An In-Depth Analysis Figure 1
arXiv preprint2024-10-12

Towards Multi-Modal Animal Pose Estimation: An In-Depth Analysis

Amir Patel, Christian Rupprecht, Philip Torr, Niki Trigoni, Andrew Markham

6D位姿估计彩色深度

面向动物在夜间、遮挡和野外等复杂环境中的姿态测量需求,本文系统梳理2011年以来176篇动物姿态估计研究,按传感器/模态、输出形式、学习范式、实验设置和应用场景建立分类,并对RGB、红外、LiDAR、IMU、声学等单模态与多模态方法进行比较。核心洞察是,单一RGB方案在光照和栖息地变化下受限,多传感器融合有望提升鲁棒性;主要结果是汇总了2D/3D数据集、评价指标及从人体姿态估计迁移到动物姿态估计的趋势与挑战。

CVAM-Pose: Conditional Variational Autoencoder for Multi-Object Monocular Pose Estimation Figure 1
arXiv preprint2024-10-11

CVAM-Pose: Conditional Variational Autoencoder for Multi-Object Monocular Pose Estimation

Jianyu Zhao, Wei Quan, Bogdan J. Matuszewski

6D位姿估计物体位姿

CVAM-Pose针对多物体6D位姿估计中常见的单物体单网络、依赖3D模型/深度与迭代精修成本高的问题,提出将类别标签逐层嵌入CVAE,在单一低维潜空间中学习多物体表示,并用标签条件MLP回归连续位姿以避免查表离散化。其在Linemod-Occluded上较AAE和Multi-Path的AR_VSD分别提升约25%和20%,并在遮挡、杂乱等场景下接近部分依赖3D模型的方法。

Look Gauss, No Pose: Novel View Synthesis using Gaussian Splatting without Accurate Pose Initialization Figure 1
arXiv preprint2024-10-11

Look Gauss, No Pose: Novel View Synthesis using Gaussian Splatting without Accurate Pose Initialization

Christian Schmidt, Jens Piekenbrinck, Bastian Leibe

RWTH Aachen University

6D位姿估计三维重建高斯泼溅

该文针对 3D Gaussian Splatting 对精确相机位姿高度敏感、限制真实场景重建与新视角合成的问题,将外参作为可优化变量,通过光度残差推导解析梯度并并入 CUDA splatting 渲染,同时加入各向异性约束和改进增密/剪枝以缓解过拟合与几何歧义。实验显示其可在位姿噪声或弱初始化下联合重建与 6DoF 位姿优化,在 LLFF 等数据集达到领先的新视角合成和位姿精度,并较高效竞品缩短约 2–4 倍运行时间。

Generalizing Stochastic Smoothing for Differentiation and Gradient Estimation Figure 1
arXiv preprint2024-10-10

Generalizing Stochastic Smoothing for Differentiation and Gradient Estimation

Felix Petersen, Christian Borgelt, Aashwin Mishra

Stanford University, University of Salzburg

6D位姿估计

针对排序、路径搜索、渲染等黑盒非可微模块难以并入端到端训练且梯度估计方差大的问题,本文从随机平滑重新推导梯度估计,放宽对平滑分布“可微密度、全支撑”的限制,并支持非对角协方差与多类方差降低策略。实验比较6种分布和最多24种降方差组合,覆盖可微排序、最短路、用于6D位姿的可微渲染等任务,显示该框架可扩大适用分布并改善估计稳定性。

Robotic framework for autonomous manipulation of laboratory equipment with different degrees of transparency via 6D pose estimation Figure 1
arXiv preprint2024-10-10

Robotic framework for autonomous manipulation of laboratory equipment with different degrees of transparency via 6D pose estimation

Maria Makarova, Daria Trinitatova, Qian Liu, Dzmitry Tsetserukou

and Dzmitry Tsetserukou, Science and Technology, Dalian University of Technology, China

6D位姿估计机器人操作

面向实验室中透明/半透明器皿和液体带来的感知困难,论文提出 LucidGrasp 自主操作框架:用 RGB-D 视觉估计器皿 6D 位姿、液位与瓶口几何,并结合 MoveIt!/Unity 数字孪生验证轨迹后驱动 UR3 执行抓取、移液等任务。实验显示在工作区复杂物体组合下位置误差约 0.18 cm、姿态误差约 0.7°,支持高精度重复操作。

Optimal-State Dynamics Estimation for Physics-based Human Motion Capture from Videos Figure 1
arXiv preprint2024-10-10

Optimal-State Dynamics Estimation for Physics-based Human Motion Capture from Videos

Cuong Le, Viktor Johansson, Manon Kok, Bastian Wandt

Department of Electrical Engineering, Linköping University, Sweden, Delft Center for Systems and Control, Delft University of Technology, The Netherlands

6D位姿估计人体姿态

针对单目人体动捕易抖动、深度不准且纯物理仿真受简化人体模型影响的问题,OSDCap将meta-PD力矩/外力估计与可微刚体仿真结合,并用可学习神经Kalman滤波在运动学观测和仿真状态间自适应取舍,同时预测惯量偏置。实验在Human3.6M、Fit3D和SportsPose上优于TRACE及现有物理方法,尤其改善全局轨迹与物理合理性。

Autonomous Driving in Unstructured Environments: How Far Have We Come? Figure 1
arXiv preprint2024-10-12

Autonomous Driving in Unstructured Environments: How Far Have We Come?

Chen Min, Shubin Si, Xu Wang, Hanzhang Xue, Weizhong Jiang, Zitong Chen, Mengmeng Li, Jilin Mei, Erke Shang, Zhipeng Xiao, Bin Dai, Qi Zhu, Hao Fu, Dawei Zhao, Liang Xiao, Yiming Nie, Yu Hu

Shubin Si is with Harbin Engineering University, Harbin, China, Zitong Chen is with Beihang University, Beijing, China, Hao Fu is with National University of Defense Technology, Changsha, China

6D位姿估计

面向乡村、矿区、山地等缺少车道线与交通标志的非结构化场景,论文指出自动驾驶落后于城市道路的根因在于环境类型多样、语义边界模糊、路况复杂和卫星信号脆弱。其核心贡献是从完整系统视角梳理250余篇工作,覆盖离线建图、位姿估计、感知、规划、端到端方法与数据集,并总结现有综述忽视的定位建图环节。主要结果是形成任务分类、挑战清单和未来趋势,同时维护持续更新的开源文献仓库。

Invisibility Cloak: Disappearance under Human Pose Estimation via Backdoor Attacks Figure 1
arXiv preprint2024-10-10

Invisibility Cloak: Disappearance under Human Pose Estimation via Backdoor Attacks

Minxing Zhang, Wenshu Fan, Wenbo Jiang, Shui Yu, Michael Backes, Xiao Zhang

6D位姿估计人体姿态

本文关注人体姿态估计在自动驾驶、机器人等人本场景中的后门风险:攻击者不只是让姿态估错,而是让带触发器的人“消失”。核心洞察是利用 HPE 标签空间的灵活性,设计非人体目标标签,提出 IntC-S、IntC-E、IntC-L 分别适配回归、热图并提升隐蔽性。实验覆盖多种模型与 COCO、MPII、CrowdPose,显示可在基本保持干净精度的同时获得高攻击成功率,现有防御只能部分缓解。

OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB Figure 1
arXiv preprint2024-10-09

OmniPose6D: Towards Short-Term Object Pose Tracking in Dynamic Scenes from Monocular RGB

Yunzhi Lin, Yipu Zhao, Fu-Jen Chu, Xingyu Chen, Weiyao Wang, Hao Tang, Patricio A. Vela, Matt Feiszli, Kevin Liang Meta: @fb.com

Meta: {yipuzhao, xingyuchen, Georgia Institute of Technology: {yunzhi.lin

6D位姿估计物体位姿

针对动态场景中单目 RGB、无 CAD/深度条件下短时 6D 物体位姿跟踪数据和方法不足的问题,论文提出 OmniPose6D 大规模合成数据集,并用不确定性感知关键点细化与 SfM 选择可靠轨迹估计位姿。在合成与 HO3D 真实数据上,相比特征匹配、SLAM 和点跟踪基线取得更好跟踪精度,增益可能主要来自数据规模与关键点置信建模的结合。

SpecTrack: Learned Multi-Rotation Tracking via Speckle Imaging Figure 1
arXiv preprint2024-10-08

SpecTrack: Learned Multi-Rotation Tracking via Speckle Imaging

Ziyang Chen, Mustafa Doğa Doğan, Josef Spjut, Kaan Akşit

University College London, Adobe Research, NVIDIA

6D位姿估计

针对传统视觉在复杂环境或高速运动中难以实现高精度姿态跟踪的问题,SpecTrack引入激光散斑成像:用无镜头相机、多波长激光和带编码孔径的回归反射标记产生与旋转相关的重叠散斑,并以浅层网络从FFT后的时序帧估计多轴绝对旋转和深度。在自建平台上,y轴MAE为0.31°、z轴为0.52°,深度误差0.15 cm,较单轴解析基线约提升2倍。

AIVIO: Closed-loop, Object-relative Navigation of UAVs with AI-aided Visual Inertial Odometry Figure 1
IEEE Robotics and Automation Letters2024-10-08

AIVIO: Closed-loop, Object-relative Navigation of UAVs with AI-aided Visual Inertial Odometry

Thomas Jantos, Martin Scheiber, Christian Brommer, Eren Allak, Stephan Weiss, Jan Steinbrener

University of Klagenfurt

6D位姿估计相机位姿航天器

面向电力杆等基础设施巡检中 GNSS 不可靠、无人机算力与载荷受限的问题,AIVIO用单目RGB相机和IMU实现目标相对闭环导航:将仅由仿真数据训练并经TensorRT优化的PoET 6D位姿估计作为量测,与IMU融合进行定位。实验显示其可在真实无人机上实时运行并完成电力杆绝缘子相对巡检飞行,仿真验证位姿误差约3.1厘米、1.52度。

Are Minimal Radial Distortion Solvers Necessary for Relative Pose Estimation? Figure 1
Lecture notes in computer science2024-10-08

Are Minimal Radial Distortion Solvers Necessary for Relative Pose Estimation?

Charalambos Tzamos, Viktor Kocur, Yaqing Ding, Torsten Sattler, Zuzana Kukelova

Czech Technical University in Prague, Comenius University Bratislava

6D位姿估计相机位姿

本文关注两视图相对位姿估计中径向畸变建模的实际代价:传统最小畸变求解器精确但复杂、慢且难实现。作者的核心洞察是,在 RANSAC 中用高效针孔 7 点求解器配合采样的畸变参数即可覆盖主要误差来源。多数据集和多种 RANSAC/LO 设置表明,该简单策略在相近或更高精度下快于最佳最小畸变求解器,并明显优于更快的非最小畸变方法。

FürElise: Capturing and Physically Synthesizing Hand Motions of Piano Performance Figure 1
arXiv preprint2024-10-08

FürElise: Capturing and Physically Synthesizing Hand Motions of Piano Performance

Ruocheng Wang, Pei Xu, Haochen Shi, Elizabeth Schumann, C. Karen Liu

Stanford University, Elizabeth Schumann

6D位姿估计手部姿态

钢琴演奏对双手时空精度和灵巧控制要求极高,现有方法缺少覆盖复杂曲目的真实手部数据且常依赖人工指法。FürElise通过多视角无标记捕捉、MIDI约束IK构建大规模3D手部动作/音频数据集,并结合扩散参考动作、音乐相似检索与强化学习训练物理双手控制策略。实验显示,该方法可在未见乐谱上生成较自然的按键动作,能处理和弦与快速腕部运动,但与真人水平仍有差距。

Comparison of marker-less 2D image-based methods for infant pose estimation Figure 1
arXiv preprint2024-10-07

Comparison of marker-less 2D image-based methods for infant pose estimation

Lennart Jahn, Sarah Flügge, Dajie Zhang, Luise Poustka, Sven Bölte, Florentin Wörgötter, Peter B Marschik, Tomas Kulvicius

Department of Child and Adolescent Psychiatry, University Hospital Heidelberg, Ruprecht-Karls University of Heidelberg, Heidelberg, Germany, iDN – interdisciplinary Developmental Neuroscience, Division of Phoniatrics, Medical University of Graz, Graz, Austria, Curtin Autism Research Group, Curtin School of Allied Health, Curtin University, Perth, Australia

6D位姿估计

面向自动化婴儿全身运动评估(GMA)中无标记视频姿态提取的可靠性问题,论文在75段、4500帧婴儿数据上横向比较通用与婴儿专用2D姿态估计器及对角/俯视视角。核心洞察是婴儿专用模型跨数据集泛化有限:成人数据训练的ViTPose反而最强,而在本数据上重训通用模型可显著提升精度;同时俯视视角明显优于传统GMA对角视角,建议纳入采集设置。

Enhancing 3D Human Pose Estimation Amidst Severe Occlusion with Dual Transformer Fusion Figure 1
arXiv preprint2024-10-06

Enhancing 3D Human Pose Estimation Amidst Severe Occlusion with Dual Transformer Fusion

Mehwish Ghafoor, Arif Mahmood

Department of Electrical and Computer Engineering, Faculty of Engineering, King Abdulaziz University, Jeddah 21589, Saudi Arabia, Manuscript received December

6D位姿估计人体姿态

该文针对单目视频中严重遮挡导致2D关节缺失、进而影响3D人体姿态提升的问题,提出DTF双Transformer融合框架:先用基于时间插值与置信度的遮挡引导补全输入,再生成两路中间视图,经自 refinement 后融合输出完整3D姿态。实验在Human3.6M与MPI-INF-3DHP上优于既有SOTA,尤其强调遮挡场景下的精度提升。

LiteVLoc: Map-Lite Visual Localization for Image Goal Navigation Figure 1
arXiv preprint2024-10-06

LiteVLoc: Map-Lite Visual Localization for Image Goal Navigation

Jianhao Jiao, Jinhao He, Changkun Liu, Sebastian Aegidius, Xiangcheng Hu, Tristan Braud, Dimitrios Kanoulas

Dimitrios Kanoulas 1,5, the Department of Computer Science and Engineering, HKUST, Hong Kong, China

6D位姿估计相机位姿

针对传统视觉定位依赖 SfM/3D 地图导致存储大、维护难且不适合长期机器人导航的问题,LiteVLoc 用稀疏拓扑-度量图替代重地图,并通过全局检索、单参考图局部几何重定位与 Pose SLAM 逐级细化 6D 相机位姿。实验显示其在仿真和真实场景中可用约 17MB 地图覆盖 200m 路线、平均平移误差低于 0.25m,并支撑四足机器人完成图像目标导航。

Test-Time Adaptation for Keypoint-Based Spacecraft Pose Estimation Based on Predicted-View Synthesis Figure 1
arXiv preprint2024-10-05

Test-Time Adaptation for Keypoint-Based Spacecraft Pose Estimation Based on Predicted-View Synthesis

Juan Ignacio Bravo Pérez-Villar, Álvaro García-Martín, Jesús Bescós, Juan C. SanMiguel

Deimos Space, Madrid, Spain. Video Processing and Understanding Lab, Universidad Autónoma de Madrid, Spain, Video Processing and Understanding Lab, Universidad Autónoma de Madrid, Spain

6D位姿估计航天器

针对航天器6D位姿估计中合成训练到真实/硬件在环测试的域差问题,本文利用近距离操作图像序列的时间冗余,在测试时通过预测视角合成构造光度自监督目标来适配关键点-PnP管线,并加入热图结构正则抑制不符合航天器几何的退化关键点解。实验显示该方法可提升基线关键点位姿估计,并达到与同数据集上现有先进方法相近的性能。

A Framework for Reproducible Benchmarking and Performance Diagnosis of SLAM Systems Figure 1
arXiv preprint2024-10-05

A Framework for Reproducible Benchmarking and Performance Diagnosis of SLAM Systems

Nikola Radulov, Yuhao Zhang, Mihai Bujanca, Ruiqi Ye, Mikel Luján

Department of Computer Science, University of Manchester, UK, Qualcomm Technologies XR Labs, Austria

6D位姿估计相机位姿数据集/基准

针对SLAM算法依赖冲突、传感器类型分散和跨数据集评测难复现的问题,本文提出SLAMFuse,将相机、IMU与LiDAR算法封装到基于Docker容器和卷的基准框架中,并加入数据扰动fuzzing、失败检测与输入质量—误差关联分析,用于定位算法工作边界。实验展示了可复现实验环境和即用算法/数据集集成,但具体精度增益或诊断带来的量化改进文中未充分说明。

MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion Figure 1
arXiv preprint2024-10-04

MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motion

Junyi Zhang, Charles Herrmann, Junhwa Hur, Varun Jampani, Trevor Darrell Forrester Cole, Deqing Sun, Ming-Hsuan Yang UC Berkeley, Google DeepMind, Stability AI, UC Merced

UC Berkeley Google DeepMind Stability AI UC Merced

6D位姿估计

MonST3R针对动态视频中物体运动、形变导致传统SfM/SLAM和多阶段深度-光流优化易失效的问题,将DUSt3R的点图表示扩展为逐时刻几何估计,并用少量带位姿和深度的动态数据微调,使模型无需显式运动表示也能处理动态场景。实验显示其在视频深度、相机位姿估计上更鲁棒且更高效,并展现前馈式4D重建潜力。

Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images Figure 1
Lecture notes in computer science2024-10-04

Dessie: Disentanglement for Articulated 3D Horse Shape and Pose Estimation from Images

Ci Li 0000-0002-7627-0125, Yi Yang 0000-0002-6679-4021, Zehang Weng 0000-0002-9486-9238, Elin Hernlund 0000-0002-5769-3958, Silvia Zuffi 0000-0003-1358-0828, Hedvig Kjellström 0000-0002-5750-9655

KTH Royal Institute of Technology, Swedish Species Information Centre

6D位姿估计

针对动物尤其马匹缺少3D标注、单目重建中形状/姿态/外观易纠缠的问题,论文提出DessiePIPE合成数据流水线,并基于DINO设计将局部形状姿态与全局位姿相机信息分离的多流回归框架Dessie。实验显示仅用合成数据即可较好迁移到真实图像,少量真实数据微调后超过既有马匹3D重建方法,并能泛化到斑马、牛、鹿等相近动物。

CLIP-Clique: Graph-based Correspondence Matching Augmented by Vision Language Models for Object-based Global Localization Figure 1
arXiv preprint2024-10-04

CLIP-Clique: Graph-based Correspondence Matching Augmented by Vision Language Models for Object-based Global Localization

Shigemichi Matsuzaki, Kazuhito Tanaka, Kazuhiro Shintani

6D位姿估计

面向基于语义物体地图的全局定位,论文针对语义图描述子易受误检、遮挡和局部观测影响,以及 RANSAC 在高外点率下不稳定的问题,提出 CLIP-Clique:用 CLIP/VLM 嵌入增强物体可区分性,并通过兼容图最大团确定性提取内点,再结合相似度与观测完整性的加权最小二乘估计位姿。在 ScanNet 和 TUM 上,方法提升了匹配与位姿估计精度。

Key-Grid: Unsupervised 3D Keypoints Detection using Grid Heatmap Features Figure 1
arXiv preprint2024-10-03

Key-Grid: Unsupervised 3D Keypoints Detection using Grid Heatmap Features

Chengkai Hou, Zhengrong Xue, Bingyang Zhou, Jinghan Ke, Lin Shao, Huazhe Xu

Shanghai Qizhi Institute Tsinghua University Peking University, The University of Hong Kong, University of Science and Technology of China, Shanghai AI Lab

6D位姿估计

针对无监督3D关键点方法多偏向刚体、在衣物等可变形物体上语义一致性下降的问题,Key-Grid仍采用自编码器框架,但将预测关键点两两连成的“骨架”扩展为稠密3D grid heatmap,并把编码器多层特征注入解码重建,以提供更连续稳定的几何约束。实验在ShapeNetCoreV2和ClothesNet等数据集上取得关键点语义一致性与定位精度的SOTA,并显示出对噪声、降采样及SE(3)扩展的鲁棒性。

SGBA: Semantic Gaussian Mixture Model-Based LiDAR Bundle Adjustment Figure 1
arXiv preprint2024-10-02

SGBA: Semantic Gaussian Mixture Model-Based LiDAR Bundle Adjustment

Xingyu Ji, Shenghai Yuan, Jianping Li, Pengyu Yin, Haozhi Cao, Lihua Xie

Technological University, Singapore

6D位姿估计点云高斯泼溅

针对现有 LiDAR BA 依赖平面、边缘等预定义几何特征、在特征稀缺或初值较差时易退化的问题,SGBA 将环境表示为融合语义与几何的高斯混合模型,并用条件数自适应选择有信息量的语义簇,配合软关联建模匹配不确定性。实验显示其在低质量初始位姿和有限几何结构场景下仍能稳定细化 6D 位姿。

SurgeoNet: Realtime 3D Pose Estimation of Articulated Surgical Instruments from Stereo Images using a Synthetically-trained Network Figure 1
arXiv preprint2024-10-02

SurgeoNet: Realtime 3D Pose Estimation of Articulated Surgical Instruments from Stereo Images using a Synthetically-trained Network

PAGE 1, Ahmed Tawfik Aboukhadra1, Nadia Robertini1, Jameel Malik3, Ahmed

German Research Center for Artificial Intelligence (DFKI), Trippstadter Straße, University of Kaiserslautern-Landau (RPTU), Erwin-Schr¨odinger-Straße, University of Prince Mugrin (UPM), Madinah, Saudi Arabia

6D位姿估计仿真到现实多视角医学/手术

针对混合现实手术训练/监控中器械标注稀缺、细长铰接工具易被手遮挡且外观相近的问题,SurgeoNet用纯合成数据训练的多阶段流程从双目VR图像估计7D位姿:YOLOv8检测与2D关键点、ByteTrack和1€滤波做时序稳定,再由Transformer融合双目关键点回归位姿和开合角。实验显示其可实时运行,在真实序列中对遮挡和相似器械分类较稳,并具备合成到现实泛化能力。

Pose Estimation of Buried Deep-Sea Objects using 3D Vision Deep Learning Models Figure 1
arXiv preprint2024-10-01

Pose Estimation of Buried Deep-Sea Objects using 3D Vision Deep Learning Models

Jerry Yan, Chinmay Talegaonkar, Nicholas Antipa, Eric Terrill, Sophia Merrifield

Marine Physical Laboratory, Scripps Institution of Oceanography, UCSD, Department of Electrical and Computer Engineering, UCSD

6D位姿估计

面向圣佩德罗海盆海底疑似污染桶,ROV视频存在浑浊、运动不稳和目标半埋等问题,传统摄影测量与圆柱拟合难以可靠估计姿态。论文将DUSt3R重建、Grounding DINO/SAM分割与基于PointNet改造的BarrelNet结合,用模拟遮挡和埋藏的合成圆柱点云训练,同时预测桶轴、半径并推算埋藏比例。结果显示在合成测试上较最小二乘圆柱拟合明显更好,但真实海底数据仅做定性展示,泛化强度仍未充分说明。

GERA: Geometric Embedding for Efficient Point Registration Analysis Figure 1
arXiv preprint2024-10-01

GERA: Geometric Embedding for Efficient Point Registration Analysis

Geng Li, Haozhi Cao, Mingyang Liu, Shenghai Yuan, Jianfei Yang

Nanyang Technological University, Singapore. Shandong University, China

6D位姿估计

针对移动机器人、手术导航等资源受限场景中点云配准模型依赖 KPConv/Transformer、推理开销高的问题,GERA 将局部几何关系预先编码为点描述子,用纯 MLP 替代在线复杂特征提取,并用 MMD 分析说明编码更稳定。实验显示其相对现有 SOTA 精度提升约 12.5%(文中亦称预测精度提升 115%),推理加速约 22 倍、仅需约 3% 计算时间。

Classroom-Inspired Multi-Mentor Distillation with Adaptive Learning Strategies Figure 1
arXiv preprint2024-09-30

Classroom-Inspired Multi-Mentor Distillation with Adaptive Learning Strategies

Shalini Sarode, Muhammad Saif Ullah Khan, Tahira Shehzadi, Didier Stricker, Muhammad Zeshan Afzal

6D位姿估计

针对多教师蒸馏中容量差距、低质教师误差累积和固定教学策略难以适应学生训练进度的问题,ClassroomKD 将课堂学习类比引入蒸馏:按样本动态筛选预测更可靠的导师,并依据师生性能差调节蒸馏温度与影响权重。实验覆盖 CIFAR-100、ImageNet 及 COCO/MPII 2D 姿态估计,整体优于多种 KD 基线;但其并非直接面向 6D 位姿估计。

PuzzleBoard: A New Camera Calibration Pattern with Position Encoding Figure 1
arXiv preprint2024-09-30

PuzzleBoard: A New Camera Calibration Pattern with Position Encoding

Peer Stelldinger, Nils Schönherr, Justus Biermann

6D位姿估计

针对传统棋盘格需完整可见、ChArUco 在低分辨率下编码难读的问题,PuzzleBoard在棋盘格边缘加入轻量位置编码,并配套带纠错的快速解码,兼容现有棋盘格流程,可用于标定、相机位姿与标记定位。实验显示其在每边约5像素时可无误解码,3.33像素时仍能正确恢复位置,速度随图像和角点数近线性扩展,FullHD大板约14fps,显著快于OpenCV基线。

Robust Gaussian Splatting SLAM by Leveraging Loop Closure Figure 1
arXiv preprint2024-09-30

Robust Gaussian Splatting SLAM by Leveraging Loop Closure

Zunjie Zhu, Youxu Fang, Xin Li, Chengang Yan, Feng Xu, Chau Yuen, Yanyan Li

6D位姿估计相机位姿三维重建高斯泼溅

针对现有 Gaussian Splatting SLAM 在旋转式多 RGB-D 相机上易累积位姿漂移、影响重建与新视角渲染的问题,论文引入基于高斯时间锚帧的回环模块:将高斯分为历史/新生集合,用共视与渲染差异检测回环,并通过轻量位姿图、锚帧高斯更新和光度/几何 BA 消除漂移。合成与真实数据实验显示,其在相机位姿估计和新视角渲染上优于已有方法。

PPLNs: Parametric Piecewise Linear Networks for Event-Based Temporal Modeling and Beyond Figure 1
arXiv preprint2024-09-29

PPLNs: Parametric Piecewise Linear Networks for Event-Based Temporal Modeling and Beyond

PAGE 1, Chen Song

Department of Computer Science, The University of Texas at Austin

6D位姿估计事件相机

本文针对事件相机数据具有高时间分辨率、神经形态生成机制而通用时序网络未必匹配的问题,提出 PPLN:用输入相关的可学习分段线性函数近似神经元膜电位,并可替换 MLP/卷积算子进行时序推理。实验覆盖事件与普通图像任务,在转向预测、3D人体姿态估计和运动去模糊上相对基线分别提升约30.8%、11.1%和5.6%,但与6D位姿估计的直接关系文中未充分说明。

GelSlim 4.0: Focusing on Touch and Reproducibility Figure 1
arXiv preprint2024-09-29

GelSlim 4.0: Focusing on Touch and Reproducibility

PAGE 1, Andrea Sipos, William van den Bogert, Nima Fazeli

6D位姿估计

针对视觉触觉传感器性能虽强但难复现、难维护、难集成的问题,GelSlim 4.0 在 GelSlim 3.0 基础上重做可修改手指结构与低成本易制造透镜,并开源深度/剪切场估计算法、数据和制造文档,用于手内位姿、滑移等任务。论文通过17名新手用户制造测试验证关键部件可复现,但量化感知性能增益文中未充分说明。

Robust Proximity Operations using Probabilistic Markov Models Figure 1
arXiv preprint2024-09-27

Robust Proximity Operations using Probabilistic Markov Models

Deep Parikh, Ali Hasnain Khowaja, Manoranjan Majji

Department of Aerospace Engineering, Texas A&M University, College Station, TX. {deep

6D位姿估计

面向卫星对接、无人机精准着陆等近距离操作中长距传感器不准、短距视觉触发过晚且保守切换降低效率的问题,论文将EKF多传感器位姿融合与基于概率Markov/MDP的多引导模式切换结合,并用马氏距离处理异常量测。实验在TPODS对接和四旋翼降落中验证可自适应选择切换距离/模式,在保证最终对接或落点精度的同时减少不必要的保守机动。

Exploiting Motion Prior for Accurate Pose Estimation of Dashboard Cameras Figure 1
arXiv preprint2024-09-27

Exploiting Motion Prior for Accurate Pose Estimation of Dashboard Cameras

PAGE 1, Yipeng Lu

6D位姿估计

该文针对行车记录仪图像低清、运动模糊和动态物体导致传统匹配难以可靠估计相机位姿的问题,利用车辆前进、转弯等强运动先验:先从特征相关中回归粗相对位姿,再以软极线约束增强 SuperGlue 式匹配,并在 RANSAC 假设评分中引入该先验。仅用 KITTI 训练后,在 NuScenes 和真实行车记录仪数据上优于基线,真实数据 AUC5° 提升约 22%,SfM 可成功估计位姿的图像增加约 19%。

DynaWeightPnP: Toward global real-time 3D-2D solver in PnP without correspondences Figure 1
arXiv preprint2024-09-27

DynaWeightPnP: Toward global real-time 3D-2D solver in PnP without correspondences

Jingwei Song, Maani Ghaffari

6D位姿估计

本文面向无对应关系的3D-2D PnP配准,动机是医疗/机器人导航中跨模态中心线难以依赖纹理匹配且需实时。作者指出该问题存在“big-to-small”错配及旋转-平移数值可观性耦合,提出DynaWeightPnP:以RKHS损失和IRLS增强鲁棒性,并加入动态权重子问题与交替搜索以减少局部极小。在血管中心线配准实验中,单核CPU达到约60Hz,带后处理约31Hz,精度与已有方法相当。

Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation Figure 1
arXiv preprint2024-09-30

Omni6D: Large-Vocabulary 3D Object Dataset for Category-Level 6D Object Pose Estimation

Mengchen Zhang, Tong Wu, Tai Wang, Tengfei Wang, Ziwei Liu, Dahua Lin

6D位姿估计物体位姿类别级位姿数据集/基准

现有类别级 6D 位姿数据集类别少、场景简单,限制模型在真实复杂遮挡和长尾物体上的泛化。Omni6D 通过 166 类、4688 个规范化实例和 80 万级 RGBD 捕获扩展评测规模,并加入旋转对称标注与对称感知指标。基准显示现有方法在大词表设置下明显受挑战,作者还给出从小类别数据迁移的微调策略;提升可能主要来自 scaling / data。

AI-Powered Augmented Reality for Satellite Assembly, Integration and Test Figure 1
arXiv preprint2024-09-26

AI-Powered Augmented Reality for Satellite Assembly, Integration and Test

1 Álvaro Patrício, 2 João Valente, 3 Atabak Dehban, 5 Inês Cadilha, 5 Daniel Reis, 6 Rodrigo Ventura

Institute For Systems and Robotics, University of Lisbon

6D位姿估计航天器

面向卫星AIT洁净室中部件频繁变化、人工标注困难且装配误差代价高的问题,论文构建了HoloLens 2+桌面端的离线AI-AR辅助系统,集成YOLOv7检测、GDRNPP 6D位姿、OCR与低延迟通信,并强调用合成数据训练及SAMAL自动标注真实视频。实验显示各AI模块准确率超过70%,检测超过95%,SAMAL标注速度可达人工约20倍,但端到端装配效率增益文中未充分说明。

Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes Figure 1
arXiv preprint2024-09-27

Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes

Katja Ludwig, Julian Lorenz, Daniel Kienzle, Tuan Bui, Rainer Lienhart Chair for Machine Learning, Computer Vision, Germany @uni-a.de

Chair for Machine Learning & Computer Vision, University of Augsburg, Germany

6D位姿估计

本文针对视频人体网格估计中同一人的基础体型逐帧漂移问题,指出部分数据集标注本身也存在形状不一致。核心做法是用一次性人体测量训练 A2B,将36项围度/长度映射到 SMPL-X 形状参数,再结合3D HPE关键点与逆运动学生成姿态精确且体型固定的网格。在 ASPset、fit3D 等运动场景中,相比现有 HME 的 MPJPE 可降低超过30 mm,且替换既有模型形状参数也能稳定提升表现。

Safe Leaf Manipulation for Accurate Shape and Pose Estimation of Occluded Fruits Figure 1
ICRA 20242024-09-25

Safe Leaf Manipulation for Accurate Shape and Pose Estimation of Occluded Fruits

Shaoxiong Yao, Sicong Pan, Maren Bennewitz, Kris Hauser

6D位姿估计机器人操作

针对果实监测中叶片重遮挡导致6D位姿与形状估计不准的问题,论文把主动感知推进到“安全拨叶”操作:用场景一致形状补全结合语义与自由空间先验,并以感知驱动的形变图预测候选抓拉动作的可见性和损伤风险。在仿真/人工甜椒植株及真实叶果实验中,该系统能更稳定地移开遮挡、降低伤叶风险,并优于基线提升果实形状与位姿估计精度。

Hierarchical Tri-manual Planning for Vision-assisted Fruit Harvesting with Quadrupedal Robots Figure 1
arXiv preprint2024-09-25

Hierarchical Tri-manual Planning for Vision-assisted Fruit Harvesting with Quadrupedal Robots

Zhichao Liu, Jingzong Zhou, Konstantinos Karydis

Institute for Integrative & Innovative Research (I 3 R), University of Arkansas, USA, Department of Electrical and Computer Engineering, University of California, Riverside, USA

6D位姿估计机器人操作

面向果园复杂地形中双臂采摘工作空间受限、轮式/飞行平台适应性不足的问题,论文构建了基于 Spot 的三臂四足 LocoHarv-3,并提出分层三臂规划:Spot 臂负责下一最佳视角与可达性扩展,定制双臂完成果梗固定和采摘,同时结合 LiDAR SLAM 与视觉位姿估计。室内单次尝试成功率达 90%,野外测试显示系统可在自然环境中稳定执行,但自动化程度仍包含遥操作导航。

Self-Sensing for Proprioception and Contact Detection in Soft Robots Using Shape Memory Alloy Artificial Muscles Figure 1
arXiv preprint2024-09-25

Self-Sensing for Proprioception and Contact Detection in Soft Robots Using Shape Memory Alloy Artificial Muscles

Ran Jing, Meredith L. Anderson, Juan C. Pacheco Garcia, Andrew P. Sabelhaus

6D位姿估计机器人操作

软体机器人需要在不牺牲柔顺性的前提下感知姿态与接触,传统外置或专用力传感器会增加刚度和失效点。本文利用SMA人工肌肉的电阻与温度自感知内部应力,用简单多项式回归在无接触时估计弯曲姿态,并以预测姿态与实测姿态差异检测接触。硬件实验显示姿态误差约15.3%,低于相变温度时接触力误差约0.02 N,可实时检测人手接触;但电阻相对温度在外力估计中的增益来源不清。

FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation Figure 1
arXiv preprint2024-09-25

FAFA: Frequency-Aware Flow-Aided Self-Supervision for Underwater Object Pose Estimation

Jingyi Tang, Gu Wang, Zeyu Chen, Shengquan Li, Xiu Li, Xiangyang Ji

6D位姿估计物体位姿

水下UUV的6D位姿估计受光照退化、模糊、深度传感失效和真实标注昂贵影响,合成到真实域差距更突出。FAFA用两阶段RGB自监督框架:预训练中以FFT幅度混合/丢弃引入真实水下风格并促成域不变特征,随后用形状约束光流建立图像级与特征级一致性进行真实域适配。论文在ROV6D和DeepURL上报告相较现有方法的明显提升,且不依赖真实位姿标注或深度。

Robo-Platform: A Robotic System for Recording Sensors and Controlling Robots Figure 1
arXiv preprint2024-09-25

Robo-Platform: A Robotic System for Recording Sensors and Controlling Robots

Masoud Dayani Najafabadi 0000-0000-0000-0000, Khoshanm Shojaei 0000-0000-0000-0000

the Department of Electrical Engineering, Islamic Azad University, Najafabad Branch, Isfahan, Iran

6D位姿估计机器人操作

针对机器人原型开发中传感器、通信与控制硬件分散且成本较高的问题,Robo-Platform 将 Android 手机、USB 微控制器和远程控制端组合成统一平台,既可记录相机、IMU、GNSS 与外部 ADC 原始数据用于位姿估计/SLAM,也可通过 Wi‑Fi/蓝牙控制机器人。实验验证了采集数据可被 SLAM/AR 管线使用,并评估通信延迟与吞吐,在玩具车和四旋翼示例中展示了可行性,但对噪声数据的算法增益仍需更强方法支撑。

LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation Figure 1
ECCV 20242024-09-24

LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation

Ruida Zhang, Ziqin Huang, Gu Wang, Chenyangguang Zhang, Yan Di, Xingxing Zuo, Jiwen Tang, Xiangyang Ji

6D位姿估计物体位姿类别级位姿

LaPose 面向仅用 RGB 的类别级 9DoF 位姿估计,针对缺失深度带来的类内形状不确定性和尺度歧义问题,将每个像素的 NOCS 形状预测建模为拉普拉斯混合分布,并用 DINOv2 的通用 3D 信息流与类别专用特征流共同估计不确定性,再结合 PnP 求解位姿;同时引入尺度无关的尺寸与平移表示以稳定训练。论文在 NOCS 数据集上取得 RGB 类别级位姿估计的 SOTA 表现。

Framework for Robust Localization of UUVs and Mapping of Net Pens Figure 1
arXiv preprint2024-09-23

Framework for Robust Localization of UUVs and Mapping of Net Pens

David Botta, Luca Ebner, Andrej Studer, Victor Reijgwart, Roland Siegwart, Eleni Kelasidi

Luca Ebner and Andrej Studer are with Tethys Robotics

6D位姿估计

面向鱼场网箱中声学反射弱、鱼群干扰强导致UUV难以自主定位与建图的问题,论文将改进FFT从单目网格图像提取多点距离先验,用于TRU-Depth生成度量稠密深度,并融合声学数据估计全局位姿、用Wavemap建图。工业规模养殖场实测显示,该流程可实时估计网相对与全局位置,并生成可用于巡检导航的三维网箱地图。

FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Camera Figure 1
arXiv preprint2024-09-23

FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Camera

Guoyang Zhao, Yuxuan Liu, Weiqing Qi, Fulong Ma, Ming Liu, Jun Ma, Senior Member, IEEE

6D位姿估计彩色深度

针对鱼眼相机视场大但畸变强、真实深度标注稀缺且传统自监督方法存在尺度不确定的问题,FisheyeDepth在Monodepth2框架中显式引入鱼眼投影/重投影模型,并用传感器融合得到的真实尺度位姿替代位姿网络,同时通过多通道输出融合多尺度特征以抑制位姿噪声。实验显示其在KITTI-360和真实场景中较单目自监督基线更稳定、深度精度更高,更适合机器人导航与交互。

BranchPoseNet: Characterizing tree branching with a deep learning-based pose estimation approach Figure 1
arXiv preprint2024-09-23

BranchPoseNet: Characterizing tree branching with a deep learning-based pose estimation approach

PAGE 1, Stefano Puliti, Carolin Fischer, Rasmus Astrup

Norwegian Institute of Bioeconomy Research (NIBIO), Høgskoleveien 8, 1430 Ås, Norway

6D位姿估计

针对树冠分枝和轮枝结构难以由地面手工量测、传统 LiDAR 方法自动化不足的问题,论文将单木点云切片投影成图像,用 YOLOv8 姿态估计以固定三关键点结构检测轮枝与枝条,并回映射到树空间提取枝插角和枝长。模型用多平台、多树种数据训练,在伐倒木实测测试上 F1=0.68,接近局部框检测基线且显示一定迁移性,但漏检和误检仍约三成。

ERPoT: Effective and Reliable Pose Tracking for Mobile Robots Based on Lightweight and Compact Polygon Maps Figure 1
arXiv preprint2024-09-23

ERPoT: Effective and Reliable Pose Tracking for Mobile Robots Based on Lightweight and Compact Polygon Maps

Haiming Gao, Qibo Qiu, Hongyan Liu, Dingkun Liang, Chaoqun Wang, Xuebo Zhang

6D位姿估计机器人操作

ERPoT针对大规模户外和复杂室内场景中点云/栅格先验地图体积大、影响长期位姿跟踪效率的问题,将环境占据压缩为多边形先验地图,并把纯 LiDAR 点云经地面去除和障碍筛选转为稀疏 2D 扫描,通过点到顶点、点到边的点-多边形匹配估计3DoF位姿。公开与自采数据表明,其在地图大小、误差、运行时间和可靠性上优于六种对比方法。

Tactile Functasets: Neural Implicit Representations of Tactile Datasets Figure 1
arXiv preprint2024-09-22

Tactile Functasets: Neural Implicit Representations of Tactile Datasets

Sikai Li, Samanta Rodriguez, Yiming Dou, Andrew Owens, Nima Fazeli

6D位姿估计数据集/基准

针对视觉触觉传感器输出高维图像导致存储、实时处理和跨传感器泛化困难的问题,论文将触觉数据集表示为可重建传感反馈的神经隐式函数集合,用紧凑参数替代原始图像,并支持概率式推断。在手内物体6D位姿估计实验中,该表示优于图像输入基线,同时简化下游模型;但具体增益在多大程度来自表示本身而非数据规模仍需进一步验证。

AR Overlay: Training Image Pose Estimation on Curved Surface in a Synthetic Way Figure 1
arXiv preprint2024-09-22

AR Overlay: Training Image Pose Estimation on Curved Surface in a Synthetic Way

Sining Huang, Yukun Song, Yixiao Kang, Chang Yu

6D位姿估计仿真到现实

面向AR零售、机器人抓取等需要在瓶罐等曲面上稳定叠加内容的场景,论文针对传统曲面图像跟踪依赖曲率输入且通常只能处理单一目标的问题,构建了Blender合成的2万余张多Logo圆柱数据,并提出YOLOv8检测、CNN估计直径、SIFT匹配与PnP求解6D位姿的混合流程。结果显示该方法可同时支持多个预训练Logo,曲率估计中Huber loss优于MSE,但文中未充分说明相对基线的定量增益。

DROP: Dexterous Reorientation via Online Planning Figure 1
arXiv preprint2024-09-22

DROP: Dexterous Reorientation via Online Planning

Albert H. Li, Preston Culbertson, Vince Kurtz, Aaron D. Ames

6D位姿估计

DROP针对灵巧手方块重定向中过度依赖离线RL和大规模域随机化、任务变更不灵活的问题,检验接触丰富操作能否用在线规划完成。其核心是用并行仿真的采样式预测控制实时搜索动作,并结合视觉关键点位姿估计、平滑与碰撞感知校正形成闭环。实机实验显示,这种相对简洁的在线方法在方块重定向上达到与既有RL方法相近的表现,但仍依赖较强在线计算,泛化到新物体的视觉部分需重训。

Combining Absolute and Semi-Generalized Relative Poses for Visual Localization Figure 1
arXiv preprint2024-09-21

Combining Absolute and Semi-Generalized Relative Poses for Visual Localization

Vojtech Panek, Torsten Sattler, Zuzana Kukelova

Faculty of Electrical Engineering, Czech Technical University (CTU) in Prague, Czech Institute of Informatics, Robotics and Cybernetics, CTU in Prague, Visual Recognition Group, Faculty of Electrical Engineering, CTU in Prague

6D位姿估计相机位姿

针对视觉定位中结构化2D-3D方法依赖精确3D模型、而无结构2D-2D方法精度通常较低的问题,本文系统研究在两者间自适应选择位姿的实用性。核心洞察是位姿评分函数而非简单合并内点数决定效果,并评估了RANSAC内外的选择策略。真实数据实验表明,在参考图像稀疏或3D几何不准时,该组合可显著提升定位表现,同时保留几何可靠时的高精度。

SpotLight: Robotic Scene Understanding through Interaction and Affordance Detection Figure 1
arXiv preprint2024-09-18

SpotLight: Robotic Scene Understanding through Interaction and Affordance Detection

Tim Engelbracht, René Zurbrügg, Marc Pollefeys, Hermann Blum, Zuria Bauer

ETH Zürich, Microsoft, Uni Bonn, \dagger denotes

6D位姿估计机器人操作

面向家庭机器人难以操作灯开关等小型功能部件的问题,SpotLight将RGB-D检测与3D位姿配准结合,并用VLM预测可供性以生成交互运动基元;机器人还通过实际开关操作观察灯状态,更新场景图中的隐藏关系。论文构建715张灯开关数据集并微调YOLOv8,真实实验中灯开关操作成功率最高84%,并展示可扩展到摆门等功能交互。

End-to-End Probabilistic Geometry-Guided Regression for 6DoF Object Pose Estimation Figure 1
arXiv preprint2024-09-18

End-to-End Probabilistic Geometry-Guided Regression for 6DoF Object Pose Estimation

Thomas Pöllabauer, Jiayin Li, Volker Knauthe, Sarah Berkei, Arjan Kuijper

Interactive Graphics Systems Group, Thomas Pöllabauer

6D位姿估计物体位姿

针对单视角6D位姿在遮挡、对称等情况下存在一图多解的问题,本文将GDRNPP从单一位姿回归改造成端到端概率几何引导回归,直接预测每个检测目标的位姿概率密度,并可采样多个带不确定性的候选位姿。按BOP流程在4个核心数据集评测,EPRO-GDR在LM-O、YCB-V和ITODD上优于GDRNPP,说明建模位姿分布能提升精度并服务后续场景级优化。

Bridging Domain Gap for Flight-Ready Spaceborne Vision Figure 1
arXiv preprint2024-09-18

Bridging Domain Gap for Flight-Ready Spaceborne Vision

Tae Ha Park 1 GN&C Engineer, 632 Gukhoe-daero, Yeongdeungpo-gu, thpark@naraspace.com. Member AIAA, Simone D’Amico 2 Associate Professor, Astronautics, 496 Lomita Mall, damicos@stanford.edu. Associate Fellow AIAA

Nara Space Technology Inc., Seoul, 07245, Republic of Korea, Stanford University, Stanford, CA, 94305, USA, Associate Professor, Department of Aeronautics & Astronautics, Lomita Mall; Associate Fellow AIAA

6D位姿估计仿真到现实

面向非合作航天器近距离交会中缺少真实标注、合成到真实域差导致单目6D位姿网络难以上星的问题,本文提出以飞行算力约束为目标的SPNv3。核心洞察是通过ViT架构、强化数据增强、迁移学习和输入分辨率权衡,在仅用合成图训练下提升OOD鲁棒性而不过度增加推理开销。实验在SPEED+硬件在环图像上达到领先精度,并在Jetson Nano级平台上单次推理不超过40 ms,显示具备导航滤波频率需求下的部署可行性。

Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification Figure 1
arXiv preprint2024-09-17

Good Grasps Only: A data engine for self-supervised fine-tuning of pose estimation using grasp poses for verification

PAGE 1, Frederik Hagelskjær

6D位姿估计

面向小批量工业 bin-picking 中 6D 位姿估计调参和标注成本高的问题,论文提出“只用好抓取”的在线自监督数据引擎:先用零样本位姿估计抓取物体,再以内手位姿估计验证并筛出可靠样本,边执行任务边微调网络而非单独学习阶段。系统在机器人工作站和四类物体上测试,均提升性能,并超过基于 CAD 训练的强基线。

Training Datasets Generation for Machine Learning: Application to Vision Based Navigation Figure 1
arXiv preprint2024-09-17

Training Datasets Generation for Machine Learning: Application to Vision Based Navigation

Jérémy Lebreton, Ingo Ahrns, Roland Brochard, Christoph Haskamp, Hans Krüger, Matthieu Le, Goff, Nicolas Menga, Nicolas Ollagnier, Ralf Regele, Francesco Capolupo, Massimo Casasco

DLR Institute for Space Systems

6D位姿估计数据集/基准

面向航天视觉导航中机器学习难以因训练数据与真值可信度不足而落地的问题,本文围绕ENVISAT交会和月面着陆两类任务,系统比较真实档案、机器人实验台、SurRender高保真仿真、模型捕获与GAN生成数据,并用6D姿态估计和稠密光流作基准验证。结果显示,SurRender与TRON/实验室数据可训练出能泛化到真实图像的模型,光流性能优于预训练模型;GAN因伪影和时序不一致表现最差,尚未具备工业可用性。

OmniGen: Unified Image Generation Figure 1
arXiv preprint2024-09-17

OmniGen: Unified Image Generation

Shitao Xiao, Yueze Wang, Junjie Zhou, Huaying Yuan, Xingrun Xing, Ruiran Yan, Chaofan Li, Shuting Wang, Tiejun Huang, Zheng Liu

Beijing Academy of Artificial Intelligence

6D位姿估计

针对现有扩散模型在编辑、条件生成等任务中依赖插件、检测器和多步流程的问题,OmniGen将文本与图像条件统一为交错序列,用VAE加Phi-3初始化Transformer和混合注意力实现端到端“任意到图像”,并构建约1亿图像的X2I多任务数据集训练。实验显示其在GenEval上接近SD3且参数更少,在编辑、主体驱动和视觉条件生成上达到可比结果,还展示了无需显式中间条件的姿态跟随等迁移能力;但部分增益可能主要来自scaling / data。

ULOC: Learning to Localize in Complex Large-Scale Environments with Ultra-Wideband Ranges Figure 1
arXiv preprint2024-09-17

ULOC: Learning to Localize in Complex Large-Scale Environments with Ultra-Wideband Ranges

Thien-Minh Nguyen, Yizhuo Yang, Tien-Dat Nguyen, Shenghai Yuan, Lihua Xie

School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, Singapore, Faculty of Electrical and Electronic Engineering, Ho Chi Minh City University of Technology

6D位姿估计

面向港口、机场等大尺度复杂环境中 UWB 定位受锚点未知、NLOS、多径和可见锚点不足影响的问题,ULOC 用先验地图与机载自定位生成训练标签,让基于 MAMBA 的序列模型从长时 UWB 测距的“有/无观测”模式中隐式学习锚点、尺度与环境效应。实验在多次真实轨迹上较经典方法和 LSTM 基线取得更高定位精度,但跨场景泛化仍可能主要依赖数据覆盖。

Depth-based Privileged Information for Boosting 3D Human Pose Estimation on RGB Figure 1
arXiv preprint2024-09-17

Depth-based Privileged Information for Boosting 3D Human Pose Estimation on RGB

Alessandro Simoni, Francesco Marchetti, Guido Borghi, Federico Becattini, Davide Davoli, Lorenzo Garattoni, Gianpiero Francesca, Lorenzo Seidenari, Roberto Vezzani

6D位姿估计人体姿态彩色深度

单目 RGB 3D 人体姿态估计受深度歧义影响,而真实深度传感器部署受限。本文把深度作为训练期特权信息:先训练深度骨干,再用幻觉损失约束 RGB 分支学习其特征,并结合 SPDH 热图预测世界坐标姿态;推理时仅需 RGB。实验显示该范式在小数据集上也能显著提升精度,但具体增益幅度需结合表格进一步核对。

HGSLoc: 3DGS-based Heuristic Camera Pose Refinement Figure 1
arXiv preprint2024-09-21

HGSLoc: 3DGS-based Heuristic Camera Pose Refinement

Zhongyan Niu, Zhen Tan, Jinpu Zhang, Xueliang Yang, Dewen Hu

6D位姿估计相机位姿三维重建高斯泼溅

针对视觉定位在光照、视角变化和粗位姿噪声下精度下降、NeRF 类优化开销较高的问题,HGSLoc 将 3D Gaussian Splatting 构建的显式几何地图用于高保真视图渲染,并以启发式搜索加分步细化对 APR/SCR 等初始位姿进行即插即用优化。实验在 7Scenes 和 Deep Blending 上显示其定位精度优于 NeRF 渲染定位方法,且在噪声条件下较神经网络联合优化更稳健。

Pose estimation of CubeSats via sensor fusion and Error-State Extended Kalman Filter Figure 1
arXiv preprint2024-09-17

Pose estimation of CubeSats via sensor fusion and Error-State Extended Kalman Filter

Deep Parikh, Manoranjan Majji

PhD Student, Aerospace Engineering, Texas A&M University, College Station, TX.Associate Professor, Aerospace Engineering, Texas A&M University, College Station, TX

6D位姿估计

面向TPODS/CubeSat近距离编队、对接与脚手架构建中GPS受限且需厘米级位置/数度姿态精度的问题,论文将陀螺、加速度计与UWB相对测距融合进误差状态EKF,并在传播模型中显式考虑传感器偏置导致的平动—转动运动学耦合。仿真覆盖纯平移与平动旋转场景,3-DOF推力线缆卫星样机实验也验证了可行性,但定量精度和相对基线增益文中未充分说明。

CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single Camera Figure 1
arXiv preprint2024-09-16

CtRNet-X: Camera-to-Robot Pose Estimation in Real-world Conditions Using a Single Camera

Jingpei Lu, Zekai Liang, Tristin Xie, Florian Ritcher, Shan Lin, Sainan Liu, Michael C. Yip

Intel Labs, USA

6D位姿估计机器人操作

这篇论文针对真实操作中相机往往只能看到部分机械臂、导致现有无标记相机到机器人位姿估计失效的问题,提出 CtRNet-X:用 CLIP/VLM 做细粒度可见机器人部件检测,并在关键点式 CtRNet 中动态选择可见连杆关键点,结合热图/分布感知坐标解码与 PnP 估计外参。实验覆盖公开数据和自采部分视野数据,在全可见与部分可见场景均优于已有方法,但性能仍受可见部件数量限制。

HiFi-CS: Towards Open Vocabulary Visual Grounding For Robotic Grasping Using Vision-Language Models Figure 1
arXiv preprint2024-09-16

HiFi-CS: Towards Open Vocabulary Visual Grounding For Robotic Grasping Using Vision-Language Models

Vineet Bhat, Prashanth Krishnamurthy, Ramesh Karri, USA vrb9107@nyu.edu

New York University

6D位姿估计未知物体机器人操作

面向语言指令抓取,论文关注杂乱场景中多相似物体和复杂属性描述导致的视觉定位歧义。HiFi-CS采用冻结VLM加轻量分割解码器,并用层次化FiLM融合图文特征,以保留颜色、形状、相对位置等语义;同时可辅助GroundedSAM等开放集检测器。实验显示其在闭集机器人VG数据集上平均IoU约87%,模型规模小约100倍,真实7自由度机械臂15个桌面场景中视觉定位准确率达90.33%。

2D or not 2D: How Does the Dimensionality of Gesture Representation Affect 3D Co-Speech Gesture Generation? Figure 1
arXiv preprint2024-09-16

2D or not 2D: How Does the Dimensionality of Gesture Representation Affect 3D Co-Speech Gesture Generation?

PAGE 1, Téo Guichoux1, Laure Soulier1, Nicolas Obin2, Catherine Pelachaud1

Sorbonne Université, ISIR, F-Paris, France ; Sorbonne Université, IRCAM, Stms Lab, F-75003, Paris France ; CNRS

6D位姿估计

该文针对野外视频共语手势数据本质上先由2D姿态估计、再“提升”为伪3D这一瓶颈,比较生成模型应直接学3D还是先生成2D再用VideoPose3D转3D。创新点在于用同一评测管线考察DDPM与RNN两类语音到手势模型的表示维度影响,并结合客观指标和用户研究。主要结果表明,2D生成后提升在若干质量与感知评价上可与直接3D生成竞争甚至更优,提示伪3D训练并不必然带来收益。

Human Insights Driven Latent Space for Different Driving Perspectives: A Unified Encoder for Efficient Multi-Task Inference Figure 1
arXiv preprint2024-09-16

Human Insights Driven Latent Space for Different Driving Perspectives: A Unified Encoder for Efficient Multi-Task Inference

Huy-Dung Nguyen, Anass Bairouk, Mirjana Maras, Wei Xiao, Tsun-Hsuan Wang, Patrick Chareyre, Ramin Hasani, Marc Blanchon, Daniela Rus

Computer Science and Artificial Intelligence Laboratory (CSAIL), MIT

6D位姿估计

针对自动驾驶单任务或通用预训练特征缺少场景上下文的问题,论文将深度、相机位姿、3D场景流及多类分割等人类驾驶依赖的视觉线索压入同一编码器,并用多尺度位姿解码器与多骨干教师蒸馏缓解多任务训练失衡。实验显示该统一编码器在各视觉任务上接近专用模型,冻结特征用于转向估计优于微调模型和 ImageNet 预训练基线。

Precise Pick-and-Place using Score-Based Diffusion Networks Figure 1
arXiv preprint2024-09-15

Precise Pick-and-Place using Score-Based Diffusion Networks

Shih-Wei Guo, Tsu-Ching Hsiao, Yu-Lun Liu, Chun-Yi Lee

Elsa Lab, National Tsing Hua University, Hsinchu City, Taiwan, Elsa Lab, National Taiwan University, Taipei City, Taiwan, National Yang Ming Chiao Tung University, Hsinchu City, Taiwan

6D位姿估计

针对工业抓取放置中位置与旋转精度要求高、标记/模型/点云或大量真实数据依赖强的问题,论文提出由粗到细的 score-based 扩散网络,从RGB-D顶视投影RGB图像直接生成连续抓取与放置位姿,并用姿态、颜色增强缓解小数据训练。仿真、真实实验和消融显示,该方法在少量数据下取得更高成功率和精度,优于离散角度输出的基线。

Pre-Training for 3D Hand Pose Estimation with Contrastive Learning on Large-Scale Hand Images in the Wild Figure 1
arXiv preprint2024-09-15

Pre-Training for 3D Hand Pose Estimation with Contrastive Learning on Large-Scale Hand Images in the Wild

Nie Lin, Takehiko Ohkawa, Mingfang Zhang, Yifei Huang, Ryosuke Furuta

Institute of Industrial Science, The University of Tokyo

6D位姿估计手部姿态

针对3D手部姿态标注稀缺、野外视频中大量未标注手部数据尚未被充分用于预训练的问题,HandCLR从Ego4D、100DOH等构建约200万手图像,并用2D关键点离线寻找跨图像相似手势作为对比学习正样本,而非仅依赖单图增强。实验在FreiHand、DexYCB、AssemblyHands上较SOTA分别提升15%、10%、4%,但部分收益可能也来自大规模数据扩展。

Proximity operations of CubeSats via sensor fusion of ultra-wideband range measurements with rate gyroscopes, accelerometers and monocular vision Figure 1
arXiv preprint2024-09-15

Proximity operations of CubeSats via sensor fusion of ultra-wideband range measurements with rate gyroscopes, accelerometers and monocular vision

Deep Parikh, Ali Hasnain Khowaja, Ravi Kumar Thakur, Manoranjan Majji

Department of Aerospace Engineering, Texas A&M University, College Station, TX. {deep, alikhowaja

6D位姿估计

面向CubeSat近距离操作与对接中功耗、燃料和传感器受限导致的可靠相对位姿估计难题,论文构建了结合TPODS平面动力学的扩展卡尔曼滤波框架,融合UWB测距、陀螺仪、加速度计和单目视觉,并用马氏距离进行异常测距剔除与降权以应对雷达量程造成的突变。实验在低成本雷达、IMU和相机平台上验证了估计器,并将其用于TPODS模块对固定目标的接近与对接。

A Scalable Tabletop Satellite Automation Testbed:Design And Experiments Figure 1
arXiv preprint2024-09-15

A Scalable Tabletop Satellite Automation Testbed:Design And Experiments

Deep Parikh, Ali Hasnain Khowaja : 1, Nathan Long : 1, Ian Down : 1, James McElreath : 1, Aniket Bire : 1, Manoranjan Majji, College Station

Graduate Research Assistant, Land, Air and Space Robotics (LASR) Laboratory, Aerospace Engineering, Associate Professor, Director, Land, Air and Space Robotics (LASR) Laboratory, Aerospace Engineering, Texas A&M University, College Station, TX, 77843-3141

6D位姿估计航天器

面向在轨服务、装配与制造中低成本验证自由飞行航天器近距离操作的需求,论文设计了1U CubeSat尺度的TPODS桌面测试平台,将张拉整体轻量结构、四相机位姿估计、X形气动推进与闭环控制集成到近无摩擦实验台。仿真比较控制策略后,实物在燃料和时间约束下完成移动目标跟踪,验证了姿态估计、推进选型和控制集成的可行性。

MAC-VO: Metrics-aware Covariance for Learning-based Stereo Visual Odometry Figure 1
arXiv preprint2024-09-14

MAC-VO: Metrics-aware Covariance for Learning-based Stereo Visual Odometry

Yuheng Qiu, Yutian Chen, Zihao Zhang, Wenshan Wang, Sebastian Scherer

6D位姿估计相机位姿多视角

针对传统视觉里程计依赖梯度选点、协方差常用经验常数,以及学习方法置信度缺乏真实尺度的问题,MAC-VO学习度量感知的2D匹配不确定性,并将其转化为含轴间相关的3D协方差,用于剔除不可靠关键点和加权位姿图残差。在光照、纹理和运动变化较大的公开基准上,其精度和鲁棒性优于多种VO,甚至超过部分SLAM系统。

Distributed Invariant Kalman Filter for Object-level Multi-robot Pose SLAM Figure 1
arXiv preprint2024-09-14

Distributed Invariant Kalman Filter for Object-level Multi-robot Pose SLAM

Haoying Li, Qingcheng Zeng, Haoran Li, Yanglin Zhang, Junfeng Wu

a : School of Data Science, The Chinese University of Hong Kong (Shenzhen), Shenzhen, China, b : System Hub, Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China

6D位姿估计物体位姿相机位姿机器人操作

面向多机器人在共享物体地图中同时估计自身轨迹与6D物体位姿时的未知相关性和通信负担,论文提出DInCIKF:在李群上建模机器人/物体状态,用不变卡尔曼滤波提升线性化一致性,并结合协方差交集与KF抑制过度自信或过保守融合;物体级观测减少带宽需求。仿真和真实数据表明其在精度、鲁棒性与实时分布式协作上优于对比方法。

Causal Transformer for Fusion and Pose Estimation in Deep Visual Inertial Odometry Figure 1
arXiv preprint2024-09-13

Causal Transformer for Fusion and Pose Estimation in Deep Visual Inertial Odometry

Yunus Bilge Kurt 0000-0002-1564-3450, Ahmet Akman 0000-0001-5112-6963, A. Aydın Alatan 0000-0001-5556-7301

6D位姿估计相机位姿

针对深度视觉惯性里程计中RNN时序建模不足、旋转回归表示不理想的问题,本文提出因果视觉-惯性融合Transformer(VIFT),在冻结视觉/IMU编码器产生的潜向量上建模历史依赖,并结合SE(3)流形感知梯度(RPMG)改进旋转学习。实验显示其在KITTI上提升单目VIO精度并达到优于既有方法的结果。

WheelPoser: Sparse-IMU Based Body Pose Estimation for Wheelchair Users Figure 1
arXiv preprint2024-09-13

WheelPoser: Sparse-IMU Based Body Pose Estimation for Wheelchair Users

Yunzhi Li, Vimal Mollyn, Kuang Yuan, Patrick Carrington

Carnegie Mellon University

6D位姿估计人体姿态

针对轮椅用户移动场景中相机受遮挡/隐私限制、密集 IMU 难日常佩戴且既有稀疏 IMU 模型泛化差的问题,WheelPoser 仅用布置在身体与轮椅上的 4 个 IMU,通过通用上肢数据预训练、167 分钟轮椅动作数据微调,并结合物理优化平滑姿态。实验实现 14.30° 平均关节角误差和 6.74 cm 关节位置误差,相比类似稀疏 IMU 方法提升超过 3 倍。

Bayesian Inverse Graphics for Few-Shot Concept Learning Figure 1
arXiv preprint2024-09-12

Bayesian Inverse Graphics for Few-Shot Concept Learning

Octavio Arriaga, Jichen Guo, Rebecca Adam, Sebastian Houben, Frank Kirchner

6D位姿估计

针对少样本视觉模型仍依赖大量数据且缺乏不确定性的问题,本文用贝叶斯逆图形将物体表示为物理一致的概率程序,并结合JAX可微渲染器、MCMC后验采样与神经颜色似然来估计形状属性和6D位姿。作者构建低样本CLEVR/YCB基准,结果显示其在少样本分类和位姿估计上优于纯神经方法,并能跨光照、背景和OOD形状泛化。

Touch2Touch: Cross-Modal Tactile Generation for Object Manipulation Figure 1
arXiv preprint2024-09-12

Touch2Touch: Cross-Modal Tactile Generation for Object Manipulation

Samanta Rodriguez, Yiming Dou, Miquel Oller, Andrew Owens, Nima Fazeli

University of Michigan

6D位姿估计机器人操作

触觉传感器形态差异大,导致位姿估计等操作算法常被绑定到特定硬件。Touch2Touch的核心是采集同一接触位置下GelSlim与Soft Bubble的成对触觉数据,并用潜扩散模型做跨传感器触觉生成,从而让Soft Bubble上的ICP位姿估计算法可迁移到GelSlim信号。实验显示,生成信号能支撑在手物体6D位姿估计,并完成插入与堆叠任务。

GateAttentionPose: Enhancing Pose Estimation with Agent Attention and Improved Gated Convolutions Figure 1
arXiv preprint2024-09-12

GateAttentionPose: Enhancing Pose Estimation with Agent Attention and Improved Gated Convolutions

1 Liang Feng, 2 Zhixuan Shen, 2 Lihua Wen, 2 Shiyao Li, Ming Xu

Shenzhen University

6D位姿估计

该文关注姿态估计中精度与计算效率难以兼顾的问题,在 UniRepLKNet 上用 Agent Attention 替代大核卷积以保留全局上下文,并引入门控增强前馈块、CBAM/SE 与多尺度上采样来改善复杂场景特征流。COCO 和 MPII 实验报告其相较原模型及若干 SOTA 取得相当或更高精度且复杂度更低,但增益来源仍需更细消融支撑。

GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolution Figure 1
arXiv preprint2024-09-12

GatedUniPose: A Novel Approach for Pose Estimation Combining UniRepLKNet and Gated Convolution

Untitled Document

Shenzhen University

6D位姿估计

该文针对遮挡、光照变化和拥挤场景下关节点依赖建模不足的问题,提出 GatedUniPose:在 UniRepLKNet 中引入门控卷积,用 GLACE 做嵌入,并以 DySample 改进多尺度特征拼接。实验显示其以 52.4M 参数在 COCO test-dev 达 76.7 AP,较基线提升约 1.0;MPII 为 90.2,CrowdPose 为 70.8,复杂场景收益存在但并非全面领先。

FaVoR: Features via Voxel Rendering for Camera Relocalization Figure 1
arXiv preprint2024-09-11

FaVoR: Features via Voxel Rendering for Camera Relocalization

Vincenzo Polizzi, Marco Cannici, Davide Scaramuzza, cannici@ifi.uzh.ch

University of Toronto, University of Zurich

6D位姿估计相机位姿

FaVoR针对稀疏特征匹配在大视角和外观变化下易失效的问题,将跟踪三角化得到的地标编码为“全局稀疏、局部稠密”的体素特征场,用体渲染和三线性插值从初始位姿合成未见视角的高维描述子,再进行特征匹配定位。相比需学习稠密辐射场的方法,它更省训练、计算和存储;在7-Scenes室内场景中中位平移误差最高降低39%,室外Cambridge Landmarks表现相近且资源开销更低。

Benchmarking 2D Egocentric Hand Pose Datasets Figure 1
arXiv preprint2024-09-11

Benchmarking 2D Egocentric Hand Pose Datasets

Olga Taran, Damian M. Manzone, Canada olga.taran@uhn.ca, damian.manzone@uhn.ca, jose.zariffa@utoronto.ca

University Health Network

6D位姿估计手部姿态数据集/基准

面向第一视角机器人操作、人机交互与康复场景中的手部姿态学习,论文聚焦训练数据质量这一瓶颈,系统筛选含2D关节标注的自我中心手部数据集,并提出结合元信息核验、随机标注质量检查与SOTA模型跨数据集评测的基准协议。核心洞察是现有数据集多为特定用途设计,覆盖模态、交互、关节数和规模差异大,尚无理想通用基准;实验认为真实数据中H2O、合成数据中GANerated Hands相对最有潜力。

iKalibr-RGBD: Partially-Specialized Target-Free Visual-Inertial Spatiotemporal Calibration For RGBDs via Continuous-Time Velocity Estimation Figure 1
arXiv preprint2024-09-11

iKalibr-RGBD: Partially-Specialized Target-Free Visual-Inertial Spatiotemporal Calibration For RGBDs via Continuous-Time Velocity Estimation

Shuolong Chen, Xingxing Li, Shengyu Li, Yuxuan Zhou

the School of Geodesy and Geomatics, Wuhan University, Wuhan 430070, China

6D位姿估计点云彩色深度

针对传统无靶标视觉惯性标定在 RGBD 场景中仍依赖 SfM/位姿估计、计算开销较高的问题,iKalibr-RGBD 利用深度与光流重构视觉残差,以连续时间自速度估计替代建图式轨迹估计,并配套多阶段初始化与批优化。真实实验表明其标定精度与 iKalibr 接近,但计算效率显著提升。

Equivariant Filter for Tightly Coupled LiDAR-Inertial Odometry Figure 1
arXiv preprint2024-09-11

Equivariant Filter for Tightly Coupled LiDAR-Inertial Odometry

Anbo Tao, Yarong Luo, Chunxi Xia, Chi Guo, Xingxing Li

6D位姿估计相机位姿点云

针对传统 EKF/IEKF 在紧耦合激光-惯性里程计中因非线性、IMU 零偏和外参破坏对称性而导致的一致性与鲁棒性问题,论文提出 Eq-LIO,将导航状态、IMU bias 与 LiDAR 外参置于半直积群对称结构下,用等变滤波固定线性化原点并加入 S² 重力约束。公私数据集实验显示其在不增加计算开销的情况下提升精度、一致性,并在剧烈运动等挑战场景更稳健。

A Bayesian framework for active object recognition, pose estimation and shape transfer learning through touch Figure 1
arXiv preprint2024-09-13

A Bayesian framework for active object recognition, pose estimation and shape transfer learning through touch

Haodong Zheng, Andrei C. Jalba, Raymond H. Cuijpers, Wijnand A. IJsselsteijn, Sanne Schoenmakers

6D位姿估计

针对视觉受限时触觉观测稀疏、难以同时判别物体类别、6D 位姿与新物体形状的问题,论文将定制粒子滤波与 GPIS 统一到贝叶斯主动探索框架中,用渐进采样保持联合后验可计算,并以模型证据触发新物体检测、借 MAP 先验迁移已知形状知识。仿真显示该方法可识别已知物体、重建新形状,并在学习后实现较可靠的再识别。

Alignist: CAD-Informed Orientation Distribution Estimation by Fusing Shape and Correspondences Figure 1
ECCV 20242024-09-10

Alignist: CAD-Informed Orientation Distribution Estimation by Fusing Shape and Correspondences

Shishir Reddy Vutukur, Rasmus Laurvig Haugaard, Junwen Huang, Benjamin Busam, Tolga Birdal

6D位姿估计

面向机器人中对称、遮挡物体导致的6D姿态多解问题,Alignist不再只从图像对比学习单一姿态,而是利用CAD先验构造SO(3)上的姿态分布监督:结合SDF几何对齐与SurfEMB对称感知对应特征,以专家乘积和广义KL训练双分支MLP,并提出立方体顶点旋转编码。实验在SYMSOL-I和T-Less上取得基准级结果,低数据场景下收敛更快、分布模式更清晰。

PoseEmbroider: Towards a 3D, Visual, Semantic-aware Human Pose Representation Figure 1
arXiv preprint2024-09-10

PoseEmbroider: Towards a 3D, Visual, Semantic-aware Human Pose Representation

Ginger Delmas, Philippe Weinzaepfel Francesc Moreno-Noguer, Grégory Rogez

6D位姿估计人体姿态

PoseEmbroider针对现有CLIP式或姿态-文本表示难以区分细粒度、非常规人体姿态的问题,将3D姿态、人物图像和文本描述视为互补观测,用Transformer把任意可用模态汇聚为语义、视觉与3D感知的统一姿态嵌入,并以检索式对比目标训练。在多模态组合检索中优于标准对齐基线,且可直接用于带可选文本提示的SMPL回归和姿态变化指令生成,在真实图像上也展示出一定泛化效果。

Test-Time Certifiable Self-Supervision to Bridge the Sim2Real Gap in Event-Based Satellite Pose Estimation Figure 1
IROS 20242024-09-10

Test-Time Certifiable Self-Supervision to Bridge the Sim2Real Gap in Event-Based Satellite Pose Estimation

Mohsi Jawaid, Rajat Talak, Yasir Latif, Luca Carlone, Tat-Jun Chin

Sentient Satellites Laboratory (SSL), Australian Institute for Machine Learning (AIML), The University of Adelaide, SA 5005, Australia, Laboratory for Information and Decision Systems (LIDS), Massachusetts Institute of Technology, Cambridge, MA 02139, USA

6D位姿估计事件相机仿真到现实航天器

面向在轨服务中的航天器6D位姿估计,论文关注真实太空光照难获取、事件相机虽抗光照但在强定向光下仍产生噪声和事件密度不均导致的Sim2Real问题。其核心是在测试时用CAD先验和事件帧对齐优化修正位姿,并通过certifier只筛选可信样本反传自监督更新。实验含新采集RGB/事件数据,显示事件域间隙小于RGB,且该测试时适应优于既有TTA方法。

From Words to Poses: Enhancing Novel Object Pose Estimation with Vision Language Models Figure 1
arXiv preprint2024-09-09

From Words to Poses: Enhancing Novel Object Pose Estimation with Vision Language Models

Tessa Pulli1, Stefan Thalhammer2, Simon Schwaiger2, Markus Vincze1

Vision for Robotics Laboratory, Automation and Control Institute, TU Wien, Austria, Industrial Engineering Department, UAS Technikum Vienna, Austria

6D位姿估计物体位姿未知物体

面向机器人在未知场景中抓取新物体时缺少实例训练数据的问题,本文把VLM的开放词表定位能力引入6D位姿估计:用LERF/NeRF的语言相关性图获得目标粗位置与质心,再结合点云聚类和TEASER++式RGB-D配准估计位姿,并分析提示粒度与激活阈值等因素。论文目前主要给出框架和HouseCat6D上的适用性分析设想,真实抓取实验和定量位姿增益文中未充分说明。

HelmetPoser: A Helmet-Mounted IMU Dataset for Data-Driven Estimation of Human Head Motion in Diverse Conditions Figure 1
arXiv preprint2024-09-08

HelmetPoser: A Helmet-Mounted IMU Dataset for Data-Driven Estimation of Human Head Motion in Diverse Conditions

Jianping Li, Qiutong Leng, Jinxin Liu, Xinhang Xu, Tongxin Jin, Muqing Cao, Thien-Minh Nguyen, Shenghai Yuan, Kun Cao, Lihua Xie

6D位姿估计数据集/基准

面向工地、救援等烟尘、弱纹理或遮挡环境中头盔定位易因 LIO/VIO 失效而退化的问题,HelmetPoser 提供带 VICON 真值的头戴 IMU 数据集,覆盖 10 名受试者的行走、跑步、上下楼等头部高动态运动,并用预积分估计偏置、训练 LSTM/Transformer 进行校正。实验比较窗口长度、运动模式和不同 IMU,表明数据驱动偏置补偿可改善纯 IMU 定位,并给出头盔定位基线。

Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto Hands Figure 1
arXiv preprint2024-09-06

Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto Hands

Yotam Erel, Or Kozlovsky-Mordenfeld, Daisuke Iwai, Kosuke Sato, Amit H. Bermano

Tel Aviv University, Osaka University, Amit H. Bermano

6D位姿估计手部姿态

针对无穿戴手部动态投影中手形高度非刚性、运动快导致3D跟踪慢且易错位的问题,Casper DPM将较慢的粗3D手姿估计与高速2D屏幕空间校正级联,并利用人眼对轮廓运动敏感的感知边界修正来降低主观延迟。两项用户研究显示,相比直接按3D位姿渲染投影,用户更少感知错位/延迟伪影,任务完成更快且更轻松。

GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers Figure 1
arXiv preprint2024-09-06

GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers

Lorenza Prospero, Abdullah Hamdi, Joao F. Henriques, Technology

The Podium Institute for Sports Medicine and Technology, University of Oxford, Visual Geometry Group, University of Oxford

6D位姿估计三维重建高斯泼溅

面向体育场景中低成本、快速的单目人体三维建模与位姿估计,GST将SMPL网格顶点作为3D高斯的空间脚手架,由Transformer联合预测顶点偏移、高斯属性和SMPL参数,用多视角渲染监督替代昂贵3D标注或扩散先验。实验表明其可近实时输出可渲染人体并提升姿态估计,适合新场景微调;但训练仍依赖多视角数据,部分渲染偏模糊。

Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamics Figure 1
arXiv preprint2024-09-06

Dense Hand-Object(HO) GraspNet with Full Grasping Taxonomy and Dynamics

PAGE 1, Woojin Cho1, Jihyun Lee1, Minjae Yi1, Minje Kim1, Taeyun Woo1

KAIST1, Imperial College London2, Kwangwoon University3, Surromind4

6D位姿估计手部姿态

针对现有手-物交互数据在规模、抓取类型覆盖和标注质量上的不足,论文提出真实多视角 RGB-D 数据集 HOGraspNet,以抓取分类作为原子动作,覆盖重定义后的完整抓取 taxonomy,并为 30 个物体、99 名受试者、150 万帧提供手/物体网格、关键点、接触图和抓取标签;通过 MANO 与 HALO 拟合及仅对物体使用 MoCap 获得标注。实验用于抓取分类和 3D 手-物体位姿估计,显示不同抓取与物体类别下性能差异明显,数据多样性可能主要带来跨场景精度提升。

Matched Filtering based LiDAR Place Recognition for Urban and Natural Environments Figure 1
arXiv preprint2024-09-06

Matched Filtering based LiDAR Place Recognition for Urban and Natural Environments

Therese Joseph Tobias Fischer Michael Milford

6D位姿估计点云

面向跨城市与自然场景的激光雷达地点识别,论文针对学习法泛化弱、手工描述子难兼顾旋转平移不变与位姿估计的问题,提出低/高分辨率BEV描述子结合匹配滤波的两阶段搜索,直接从滤波响应估计相对位姿。在NCLT、Oxford Radar和WildPlaces上均优于基线,自然场景Recall@1约提升15%,NCLT约提升10%,位姿成功率也高于BVmatch。

The Influence of Faulty Labels in Data Sets on Human Pose Estimation Figure 1
arXiv preprint2024-09-09

The Influence of Faulty Labels in Data Sets on Human Pose Estimation

Germany kristian.hildebrand@bht-berlin.de

6D位姿估计人体姿态

本文关注人体姿态估计基准中被忽视的标注错误问题:在模型性能趋于饱和时,COCO、MPII 等训练/测试集的脏标签会同时影响学习和排行榜解释。作者对常用数据集建立错误类型分析,并用简单启发式识别异常/困难标注。实验显示清洗数据可提升模型表现,也表明 MPII 可能已接近可区分性能上限,而 COCO 因指标更稳健仍有改进空间。

MaskVal: Simple but Effective Uncertainty Quantification for 6D Pose Estimation Figure 1
arXiv preprint2024-09-05

MaskVal: Simple but Effective Uncertainty Quantification for 6D Pose Estimation

Philipp Quentin, Daniel Goehring

BMW Group, Munich, Germany, Freie Universitaet Berlin, Dahlem Center for Machine Learning and Robotics, Berlin, Germany

6D位姿估计

面向机器人抓取等安全敏感场景,论文关注6D位姿估计缺少可靠不确定性、或不确定性与真实误差相关性弱的问题。MaskVal的核心思路是无需改动位姿网络,将估计位姿渲染成掩码并与实例分割掩码计算一致性,用作置信度/不确定性;对两阶段估计器计算开销较低。实验显示其在数据集和真实机器人设置中优于集成式不确定性方法,并可通过阈值筛除高风险位姿,提升操作可靠性。

UAV (Unmanned Aerial Vehicles): Diverse Applications of UAV Datasets in Segmentation, Classification, Detection, and Tracking Figure 1
arXiv preprint2024-09-05

UAV (Unmanned Aerial Vehicles): Diverse Applications of UAV Datasets in Segmentation, Classification, Detection, and Tracking

Analytics Lab Dhaka, GA kgupta@cau.edu

Silicon Orchard Research and Analytics Lab, Daffodil International University, BRAC University, Texas Tech University, Clark Atlanta University

6D位姿估计数据集/基准航天器

面向无人机视觉数据在灾害评估、空中监控和动态目标理解中的快速扩张,本文不是提出新的6D位姿方法,而是综述15个UAV相关数据集,梳理其模态、标注与分割、分类、检测、跟踪、姿态估计等任务的适配关系。核心洞察是多模态与任务专用数据集能显著支撑模型落地,但跨域泛化、标注成本和机载实时性仍是主要瓶颈;主要结果来自既有基准汇总,如UAV-Human提升行为理解,AIDER上轻量模型约90%准确率,统一增益来源文中未充分说明。

Recoverable Anonymization for Pose Estimation: A Privacy-Enhancing Approach Figure 1
arXiv preprint2024-09-01

Recoverable Anonymization for Pose Estimation: A Privacy-Enhancing Approach

Wenjun Huang, Yang Ni, Arghavan Rezvani, SungHeon Jeong, Hanning Chen, Yezi Liu, Fei Wen, Mohsen Imani

University of California, Irvine, USA Texas A&M University, USA

6D位姿估计

针对监控/云端人体姿态估计中原始图像会泄露人脸、性别等敏感信息的问题,论文提出在相机侧运行的可恢复匿名化框架:用cGAN式图像转换生成只改人物、保留背景的隐私增强图,并与隐私恢复模块和姿态估计器端到端联合训练。实验显示其在匿名化后仍保持较好HPE性能,较仅微调姿态模型AP约高10%,恢复图像上质量再提升约3%。

Object Gaussian for Monocular 6D Pose Estimation from Sparse Views Figure 1
arXiv preprint2024-09-04

Object Gaussian for Monocular 6D Pose Estimation from Sparse Views

Luqing Luo, Shichu Sun, Jiangang Yang, Linfang Zheng, Jinwei Du, Jian Liu

6D位姿估计高斯泼溅

针对单目6D位姿估计依赖CAD模型、而稀疏视角重建又易过拟合的问题,SGPose用仅约10张带位姿RGB参考图从随机立方体初始化Object Gaussian,通过几何一致深度监督、在线合成视角变换和剪枝生成密集2D-3D对应,供GDRNet++类估计器训练。在LM与Occlusion LM-O上表现优于或匹配现有CAD-free/CAD-based方法,遮挡场景增益尤其明显。

EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision Figure 1
arXiv preprint2024-09-03

EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Vision

Zürich

ETH Zürich Microsoft Spatial AI Lab, Zürich

6D位姿估计手部姿态数据集/基准

面向机器人模仿与AR/VR交互中难以从第一视角获取接触压力的问题,EgoPressure构建了含21人、5小时、头戴与7个Kinect同步RGB-D的裸手数据集,并用多视角序列优化生成MANO手网格与高分辨率压力标注。实验表明,引入手部姿态可使压力估计相较RGB基线在体积IoU误差上降低超过5%,使用真值姿态超过7%,且支持手网格与压力的联合三维定位。

Deep learning for objective estimation of Parkinsonian tremor severity Figure 1
arXiv preprint2024-09-03

Deep learning for objective estimation of Parkinsonian tremor severity

Felipe Duque-Quiceno MSc, Grzegorz Sarapata MSc, Yuriy Dushin MSc, Miles Allen MSc, Jonathan O’Keeffe MD, PhD

Machine Medicine Technologies Ltd., The Biscuit Factory Unit J112, Drummond Road, London SE16 DG, UK

6D位姿估计

针对帕金森震颤临床量表主观性强、姿态估计在模糊和遮挡下不稳定的问题,本文用基于像素的 3D Conv-LSTM 从手部时空 ROI 直接学习震颤模式,减少对逐帧关键点的依赖。在 5 个中心 2742 次评估上,该方法较姿态特征 RFC 显著更稳健,并能区分严重度、识别用药/DBS 效应和左右不对称,但增益可能部分来自多中心数据规模。

SPiKE: 3D Human Pose from Point Cloud Sequences Figure 1
arXiv preprint2024-09-03

SPiKE: 3D Human Pose from Point Cloud Sequences

Irene Ballester, Ondřej Peterka, Martin Kampel

6D位姿估计人体姿态点云

针对深度/点云人体姿态估计多按单帧处理、难以利用遮挡前后时序线索的问题,SPiKE直接以点云序列为输入,将每帧划分为局部体素并用点空间卷积提取特征,再由Transformer建模跨帧时空关系。在ITOP上达到89.19% mAP,优于直接式深度/体素/点云方法,并较2D-3D lifting方案推理更快。

Kalman Filtering for Precise Indoor Position and Orientation Estimation Using IMU and Acoustics on Riemannian Manifolds Figure 1
arXiv preprint2024-09-02

Kalman Filtering for Precise Indoor Position and Orientation Estimation Using IMU and Acoustics on Riemannian Manifolds

Mohammed H. AlSharif, Mohanad Ahmed, Mohamed Siala, Tareq Y. Al-Naffouri

6D位姿估计

面向室内机器人/目标的长期 6D 位姿跟踪,论文针对纯 IMU 易漂移、声学定位更新慢且受 NLOS 影响的问题,将基于黎曼优化的声学位置与姿态估计同 INS 通过 EKF/UKF 融合,并把滤波输出投影回黎曼流形以约束旋转结构。数值仿真和自建实验表明,该方法在位置与姿态误差上优于基准算法。

Detection, Recognition and Pose Estimation of Tabletop Objects Figure 1
arXiv preprint2024-09-01

Detection, Recognition and Pose Estimation of Tabletop Objects

Sanjuksha Nirgude, Kevin DuCharme, Namrita Madhusoodanan

6D位姿估计

面向社交/工业机器人整理凌乱桌面的需求,本文将桌面物体识别与朝向估计结合,用CNN先识别杯子、鼠标、订书机,再按离散角度预测平面朝向,以便计算搬运到固定“归位”姿态的变换。实验中简单CNN物体识别达98%,朝向跨拍摄高度测试订书机约80%、杯子77%、鼠标55%,显示性能强受物体旋转对称性影响;文中并未充分实现完整6D位姿。

DSLO: Deep Sequence LiDAR Odometry Based on Inconsistent Spatio-temporal Propagation Figure 1
arXiv preprint2024-09-01

DSLO: Deep Sequence LiDAR Odometry Based on Inconsistent Spatio-temporal Propagation

Huixin Zhang, Guangming Wang, Xinrui Wu, Chenfeng Xu, Mingyu Ding, Masayoshi Tomizuka, Wei Zhan, Hesheng Wang

Department of Automation, Education, Key Laboratory of Marine Intelligent Equipment and System of, Ministry of Education, Shanghai Engineering Research Center of Intelligent, Control and Management, Shanghai Jiao Tong University, Shanghai

6D位姿估计相机位姿点云

DSLO针对学习式LiDAR里程计中2D投影损失三维结构、逐对帧估计忽略历史运动以及多尺度信息可靠性不一致的问题,提出点云金字塔特征复用、顺序位姿初始化、门控层级细化和时间特征传播,以在不一致空间上下文中传递运动信息。在KITTI和Argoverse上相较基线RTE提升至少15.67%、RRE提升12.64%,运行时间降低34.69%。

MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds Figure 1
arXiv preprint2024-09-01

MoManifold: Learning to Measure 3D Human Motion via Decoupled Joint Acceleration Manifolds

Ziqiang Dang

6D位姿估计

针对单帧3D人体/SMPL估计易因遮挡和局部观测产生抖动、而简单时间平滑会压制自然动态的问题,MoManifold将人体运动先验建模为神经距离场,并把高维序列拆成各关节加速度流形,以距离分数量化运动合理性并指导优化。实验显示其在动捕去噪、部分观测恢复、姿态估计去抖和运动补全细化等任务上优于已有先验,但关节间关系仍主要依赖SMPL拓扑隐式建立。

Augmented Reality without Borders: Achieving Precise Localization Without Maps Figure 1
arXiv preprint2024-08-30

Augmented Reality without Borders: Achieving Precise Localization Without Maps

Albert Gassol Puigjaner, Irvin Aloise, Patrik Schmuck

6D位姿估计

面向 AR 中大范围、动态场景难以预先构建 SfM/SLAM 地图的问题,MARLOC 利用查询图像序列内已知相对位姿做序列内三角化,把2D匹配提升为3D-2D对应,再经 PnP 与位姿图优化完成无地图定位。实验显示其在无地图基准上达到同类 SOTA,精度接近传统 SfM 地图方法,并在 Magic Leap 2 与 Mapillary 参考图的户外实测中验证了可用性。

BOP-D: Revisiting 6D Pose Estimation Benchmark for Better Evaluation under Visual Ambiguities Figure 1
arXiv preprint2024-08-30

BOP-D: Revisiting 6D Pose Estimation Benchmark for Better Evaluation under Visual Ambiguities

Boris Meden, Asma Brazi, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit Université Paris-Saclay, CEA, List LIGM, Ecole des Ponts, Univ Gustave Eiffel, CNRS, Marne-la-vallée

6D位姿估计数据集/基准

现有BOP等6D位姿基准多用“单一真值姿态+物体全局对称”处理歧义,忽略视角与遮挡会让每张图的可见表面产生不同多解,从而偏置评测。本文提出BOP-Distrib,利用已有标注、可见掩码和3D模型自动生成逐图像的非参数位姿分布真值,并为分布式位姿估计设计精确率/召回率评测。基于T-LESS和YCB-V重评后,单姿态方法排名发生显著变化,也首次在真实数据上量化多模态位姿分布方法。

EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUs Figure 1
arXiv preprint2024-08-30

EMHI: A Multimodal Egocentric Human Motion Dataset with HMD and Body-Worn IMUs

Zhen Fan, Peng Dai, Zhuo Su, Xu Gao, Zheng Lv, Jiarui Zhang, Tianyuan Du, Guidong Wang, Yang Zhang

6D位姿估计数据集/基准

针对VR/AR中自我中心人体姿态估计受单目遮挡、IMU稀疏漂移以及真实多模态数据缺乏限制的问题,EMHI在真实VR设备上采集下视双目图像、头手6DoF与肢体IMU信号,并提供SMPL标注;同时给出融合视觉、IMU与时序特征的MEPoser基线。实验显示多模态方法优于单模态基线,标注经光学动捕交叉验证,说明该数据集可支撑更贴近产品形态的6D/人体姿态研究。

Generic Objects as Pose Probes for Few-Shot View Synthesis Figure 1
arXiv preprint2024-09-01

Generic Objects as Pose Probes for Few-Shot View Synthesis

Zhirui Gao, Renjiao Yi, Chenyang Zhu, Ke Zhuang, Wei Chen, Kai Xu

6D位姿估计

该文针对少视角、宽基线或弱纹理场景中 COLMAP 难以提供可靠相机位姿的问题,提出 PoseProbe:把场景中的普通物体当作“位姿探针”,以立方体初始化并结合 PnP 增量位姿初始化、物体 NeRF 与场景 NeRF 双分支联合优化,通过几何与特征一致性约束细化位姿和形状。实验显示其在多个数据集上提升位姿估计与新视角合成效果,尤其在 COLMAP 失败率高的少视角场景中更稳定。

OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation Figure 1
arXiv preprint2024-08-29

OP-Align: Object-level and Part-level Alignment for Self-supervised Category-level Articulated Object Pose Estimation

Yuchen Che, Ryo Furukawa, Asako Kanezaki

6D位姿估计物体位姿类别级位姿

面向机器人操作中常见的关节物体,类别级位姿估计受形状/关节状态变化和标注成本制约。OP-Align的关键洞察是先降低整体位姿方差再做部件对齐:从单帧点云自监督学习整物体规范重建、物体级对齐与部件级关节运动对齐,避免EAP式迭代。实验显示其显著优于既有自监督方法,性能接近监督SOTA,并在新建真实RGB-D基准上具备实时推理能力。

GRPose: Learning Graph Relations for Human Image Generation with Pose Priors Figure 1
arXiv preprint2024-08-29

GRPose: Learning Graph Relations for Human Image Generation with Pose Priors

Xiangchen Yin, Donglin Di, Lei Fan, Hao Li, Wei Chen, Xiaofei Gou, Yang Song, Xiao Sun, Xun Yang

6D位姿估计

针对扩散式人体图像生成中姿态先验只按欧氏特征注入、难以刻画关节拓扑关系而导致肢体对齐差的问题,GRPose 将姿态部件与潜变量构造成图,并用渐进式图集成器在 Adapter 各层传播姿态关系,同时引入基于预训练姿态估计器的感知损失约束生成结果。在 Human-Art 与 LAION-Human 上,方法相对 ControlNet/HumanSD 等基线在图像质量和姿态对齐指标上取得明显提升。

Are Pose Estimators Ready for the Open World? STAGE: Synthetic Data Generation Toolkit for Auditing 3D Human Pose Estimators Figure 1
arXiv preprint2024-08-28

Are Pose Estimators Ready for the Open World? STAGE: Synthetic Data Generation Toolkit for Auditing 3D Human Pose Estimators

Nikita Kister, István Sárándi, Jiayi Wang, Anna Khoreva, Gerard Pons-Moll Bosch IoC Lab, Tübingen AI Center

Zalando SE Max Planck Institute for Informatics, Saarland Informatics Campus

6D位姿估计人体姿态仿真到现实

面向自动驾驶、协作机器人等安全场景,论文指出现有真实/CG基准难以逐一控制天气、服装、年龄等因素来审计3D人体姿态估计器。STAGE用具备SMPL级3D姿态控制的生成模型和成对属性评测协议,按文本生成只改变单一属性的基准。实验显示多种自然变化会显著降低主流方法性能,且平均精度高并不等于开放世界鲁棒。

Multi-view Pose Fusion for Occlusion-Aware 3D Human Pose Estimation Figure 1
arXiv preprint2024-08-28

Multi-view Pose Fusion for Occlusion-Aware 3D Human Pose Estimation

Laura Bragagnolo 0009-0007-8096-4588, Matteo Terreran 0000-0001-9862-8469, Davide Allegro 0009-0008-1180-9290, Stefano Ghidoni 0000-0003-3406-8719

6D位姿估计人体姿态多视角

面向人机协作工位中遮挡严重、视角有限导致传统2D关键点三角化失效的问题,本文改为融合各视角绝对单目方法输出的3D骨架,并用基于重投影误差的逐关节加权、重投影优化和无需先验骨长的肢体对称约束修正幻觉与尺度误差。在Human3.6M、合成遮挡版Human3.6M-Occluded及真实工位数据上,该方法在重遮挡场景优于现有多视角姿态方法,显示较好的跨场景泛化能力。

Addressing the challenges of loop detection in agricultural environments Figure 1
arXiv preprint2024-08-30

Addressing the challenges of loop detection in agricultural environments

Soncini, Nicolas, Civera, Javier, Pire, Taihú

6D位姿估计数据集/基准

论文针对农业开阔地中视觉特征稀少、重复且受光照天气影响导致SLAM回环检测不稳的问题,提出面向农田的双目回环检测流程:先用BoW检索粗候选,再扩展时序邻近帧并通过双目几何一致性与相对位姿估计验证。实验在两个农业数据集上显示可稳定检测回环,位姿误差中位数约15 cm,同时指出远处地平线特征和非刚性植被仍是主要瓶颈。

Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph Figure 1
arXiv preprint2024-08-28

Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph

Zherong Zhang, Chunyu Lin, Shujuan Huang, Shangrong Yang, Yao Zhao

With Institute of Information Science, Beijing Jiaotong University, Beijing 100044, China, Beijing Key Laboratory of Advanced Information Science and Network Technology, Beijing 10044, China

6D位姿估计相机位姿

针对相对位姿估计中过度依赖点匹配、在低纹理或重复结构场景易受误匹配影响的问题,Str-L Pose 将匹配点与结构化线段端点共同建成几何对应图,并通过双图网络用几何关系引导视觉特征学习,再用加权融合模块抑制噪声匹配。论文在 DeMoN 与 KITTI Odometry 上验证了方法,结果显示其相对现有方法具有竞争力,但具体优势幅度需结合实验表格进一步判断。

Benchmarking ML Approaches to UWB-Based Range-Only Posture Recognition for Human Robot-Interaction Figure 1
arXiv preprint2024-08-28

Benchmarking ML Approaches to UWB-Based Range-Only Posture Recognition for Human Robot-Interaction

PAGE 1, Salma Salimi∗, Sahar Salimpour∗, Jorge Pe˜na Queralta, Wallace Moreira Bessa∗, Tomi Westerlund∗

Faculty of Technology, University of Turku, Finland, Swiss Federal School of Technology, ETH Z¨urich,Switzerland

6D位姿估计机器人操作数据集/基准

针对视觉姿态估计易受遮挡、深度歧义影响以及 IMU 难以稳定识别静态姿态的问题,论文将佩戴在手腕、脚踝和腹部的 5 个 UWB 节点的两两测距作为输入,构建 range-only 姿态识别基准,并比较 KNN、SVM、MLP 用于 9 类姿态到机器人指令的映射。实验在 ROS 2 中实现实时推理并控制移动/飞行机器人,结果表明该方案能以较高准确率完成姿态分类和对应动作触发,但具体增益幅度需结合完整指标判断。

Bengali Sign Language Recognition through Hand Pose Estimation using Multi-Branch Spatial-Temporal Attention Model Figure 1
arXiv preprint2024-08-26

Bengali Sign Language Recognition through Hand Pose Estimation using Multi-Branch Spatial-Temporal Attention Model

Abu Saleh Musa Miah, Md. Al Mehedi Hasan, Md Hadiuzzaman, Muhammad Nazrul Islam, Jungpil Shin

6D位姿估计手部姿态

针对孟加拉手语识别中公开数据少、现有方法多依赖RGB外观且跨场景泛化评估不足的问题,论文将视频序列先转为手部关节骨架,以保护隐私并降低算力需求,再用可分离TCN结合多头时空注意力建模关节结构位移和短程时序依赖。在自建数据集和两个BSL基准上的 intra/inter-dataset 评估显示,该方法在保持较低计算复杂度和更快推理速度的同时取得有竞争力的准确率。

InterTrack: Tracking Human Object Interaction without Object Templates Figure 1
arXiv preprint2024-08-25

InterTrack: Tracking Human Object Interaction without Object Templates

Xianghui Xie, Jan Eric Lenssen, Germany Tübingen AI Center, Saarland Informatic Campus

University of Tübingen, Germany 2 Tübingen AI Center, Germany, Max Planck Institute for Informatics, Saarland Informatic Campus, Germany

6D位姿估计

该文面向单目视频中的人体—物体交互跟踪,解决以往视频方法依赖预扫描物体模板、单帧无模板方法时序不一致的问题。InterTrack 将4D重建拆为逐帧初始化与规范空间形状优化,用 CorrAE 建立人体 SMPL 时序对应,用 TOPNet 利用视频信息在遮挡下估计平滑物体旋转,并构建 ProciGen-Video 合成训练集。BEHAVE 和 InterCap 上优于模板式 VisTracker 与单帧 HDM,CorrAE 速度约快30倍且性能相近。

Temporally-consistent 3D Reconstruction of Birds Figure 1
arXiv preprint2024-08-24

Temporally-consistent 3D Reconstruction of Birds

Johannes Hägerlind, Jonas Hentati-Sundberg, Bastian Wandt

Linköping University, Sweden, Swedish University of Agricultural Sciences, Sweden

6D位姿估计三维重建

面向海鸟作为环境变化指示物的长期行为与形态分析,论文针对普通海鸦单目视频中快速、非刚性运动和遮挡导致的3D重建不稳定问题,构建检测、跟踪、分割到参数化鸟体拟合的完整流程,并用速度/加速度等时间一致性损失将单帧估计扩展到序列优化,同时发布1万帧真实数据集。实验显示时间窗口优化、共享尺度和加速度约束均有贡献,最佳设置较单帧基线关键点误差降低约6.6%。

Explainable Convolutional Networks for Crater Detection and Lunar Landing Navigation Figure 1
arXiv preprint2024-08-24

Explainable Convolutional Networks for Crater Detection and Lunar Landing Navigation

Jianing Song, Nabil Aouf, Duarte Rondao, Christophe Honvault, Luis Mansilla

6D位姿估计

面向月面自主着陆中深度视觉导航难以被航天专家信任的问题,论文把可解释性引入陨石坑检测与相对位姿估计:在Darknet53/YOLOv3中加入注意力,并将检测骨干与LSTM组成端到端导航网络,同时用PCC量化不同卷积层与任务相关特征的关系。实验基于合成月面图像,显示陨石坑检测和着陆位姿估计性能具有竞争力,但真实飞行场景泛化仍文中未充分说明。

Sapiens: Foundation for Human Vision Models Figure 1
arXiv preprint2024-08-27

Sapiens: Foundation for Human Vision Models

Rawal Khirodkar, Timur Bagautdinov, Julieta Martinez, Su Zhaoen, Austin James, Peter Selednik, Stuart Anderson

6D位姿估计

面向写实人体生成与数字化中关键点、部件、深度和法线估计难以在野外高精度泛化的问题,Sapiens用3亿人体图像进行MAE自监督预训练,并以1K分辨率、0.3B到2B规模ViT配轻量任务头微调,强调同等算力下人体域数据比通用数据更有效。实验在姿态、分割、深度和法线基准均超越既有方法,最大模型在Humans-5K提升7.6 mAP、Humans-2K提升17.1 mIoU。

GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splatting Figure 1
arXiv preprint2024-08-21

GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splatting

Wanshui ⁢ Gan Wanshui Gan Wanshui\, Gan roman_Wanshui roman_Gan, Fang ⁢ Liu Fang Liu Fang\, Liu roman_Fang roman_Liu, Hongbin ⁢ Xu Hongbin Xu Hongbin\, Xu roman_Hongbin roman_Xu, Ningkai ⁢ Mo Ningkai Mo Ningkai\, Mo roman_Ningkai roman_Mo, Naoto ⁢ Yokoya Naoto Yokoya Naoto\, Yokoya roman_Naoto roman_Yokoya 1, } start_FLOATSUPERSCRIPT 1, end_FLOATSUPERSCRIPT, 2 RIKEN, of\, Tokyo, ^ RIKEN, ^ South\, China\, % of\, start_POSTSUPERSCRIPT 2 end_POSTSUPERSCRIPT roman_RIKEN, Advanced\, Technology, \ Chinese\, Academy\, of% \, Equal\, contribution, Corresponding% \

6D位姿估计三维重建高斯泼溅

GaussianOcc针对环视3D占据估计中自监督方法仍依赖真值6D自车位姿、且体渲染训练/渲染开销高的问题,引入高斯泼溅:GSP利用相邻视角投影提供尺度约束并联合学习位姿,GSV直接在体素空间泼溅以替代密集采样。实验显示其在无需真值位姿下保持有竞争力精度,训练快2.7倍、渲染快5倍。

GSLoc: Efficient Camera Pose Refinement via 3D Gaussian Splatting Figure 1
arXiv preprint2024-08-20

GSLoc: Efficient Camera Pose Refinement via 3D Gaussian Splatting

Changkun Liu, Shuai Chen, Yash Bhalgat, Siyan Hu, Ming Cheng Zirui Wang, Victor Adrian Prisacariu, Tristan Braud HKUST, Dartmouth College

HKUST University of Oxford Dartmouth College

6D位姿估计相机位姿三维重建高斯泼溅

针对APR精度/泛化不足、SCR计算重以及NeRF式测试时位姿优化收敛慢的问题,GS-CPR用3D Gaussian Splatting快速渲染合成RGB与深度,并借助MASt3R在真实查询图和渲染图间建立匹配,再由2D-3D对应进行一次性位姿细化;同时加入曝光自适应以缓解户外外观偏移。实验显示其能提升APR和SCR在7Scenes、12Scenes、Cambridge Landmarks上的定位精度,速度和精度均优于主要NeRF细化方法,并在两个室内数据集达到新SOTA。

ZebraPose: Zebra Detection and Pose Estimation using only Synthetic Data Figure 1
arXiv preprint2024-08-20

ZebraPose: Zebra Detection and Pose Estimation using only Synthetic Data

Elia Bonetto, Aamir Ahmad

6D位姿估计仿真到现实

针对野生动物尤其航拍斑马缺少可靠标注、真实采集昂贵且检测器在分布外视角易失效的问题,ZebraPose用3D写实仿真一次性生成检测框与27个关键点,训练YOLOv5s和ViTPose+,不依赖真实图像、风格迁移或预训练。实验在多个真实/合成数据集上显示,纯合成训练也能较好泛化,并发布10.4万张精标航拍斑马数据;但任务实际聚焦2D检测与姿态而非严格6D位姿。

MPL: Lifting 3D Human Pose from Multi-view 2D Poses Figure 1
arXiv preprint2024-08-20

MPL: Lifting 3D Human Pose from Multi-view 2D Poses

Seyed Abolfazl Ghasemzadeh 0000-0001-7111-5778, Alexandre Alahi 0000-0002-5004-1498, Christophe De Vleeschouwer 0000-0001-5049-2929

6D位姿估计人体姿态多视角

针对多视角3D人体姿态方法依赖实验室内图像-3D标注、难以泛化到真实场景的问题,MPL将流程拆为现成2D姿态检测与Transformer式多视角2D到3D提升,在2D关键点特征空间融合,并用AMASS渲染生成带检测噪声的合成2D-3D训练对以适配任意相机布局。实验显示相较直接三角化,MPJPE最高降低约45%,但实际增益可能部分来自合成数据与噪声建模。

RUMI: Rummaging Using Mutual Information Figure 1
arXiv preprint2024-08-19

RUMI: Rummaging Using Mutual Information

Sheng Zhong, Nima Fazeli, Dmitry Berenson

and Dmitry Berenson, Department of Robotics, University of Michigan, MI 48109, USA

6D位姿估计

面向柜体等强遮挡场景中已知形状可移动物体的6D位姿估计,RUMI将“翻找”建模为接触式主动探索问题:用粒子信念表示候选位姿,并以机器人轨迹覆盖区域与物体位姿的互信息近似信息增益,同时加入可达性代价,嵌入随机动力学MPC闭环规划。实验显示其在仿真和真实翻找任务中比基线更稳定成功,尤其能避免接触把目标推出工作空间。

SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views Figure 1
arXiv preprint2024-08-19

SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views

Chao Xu 0009-0001-0574-5357, Ang Li, Linghao Chen, Yulin Liu, Ruoxi Shi, Hao Su, Minghua Liu

6D位姿估计三维重建

SpaRP面向只有1到数张、无位姿且重叠很少的物体图片,解决传统SfM和已知位姿稀疏重建方法难以使用的问题。其核心是微调2D扩散模型,同时预测适合扩散生成的NOCS位姿代理表示和固定视角多视图图像,再用PnP与重建模块得到相机相对位姿和纹理网格,并可渲染细化。三组数据实验显示其重建质量和位姿精度优于基线,约20秒完成输出。

SHARP: Segmentation of Hands and Arms by Range using Pseudo-Depth for Enhanced Egocentric 3D Hand Pose Estimation and Action Recognition Figure 1
arXiv preprint2024-08-19

SHARP: Segmentation of Hands and Arms by Range using Pseudo-Depth for Enhanced Egocentric 3D Hand Pose Estimation and Action Recognition

Wiktor Mucha, Michael Wray, Martin Kampel

6D位姿估计手部姿态彩色深度

针对第一视角RGB手部3D姿态估计缺少深度、背景干扰导致误差较大的问题,SHARP利用单目深度模型生成伪深度,并按手臂可达距离分割掉远处无关区域,无需额外深度传感器或训练深度模型。在H2O上,姿态平均误差由35.48mm降至28.66mm,结合物体检测与Transformer动作识别达到91.73%准确率。

Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation Figure 1
arXiv preprint2024-08-19

Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation

Qianhui Men, Xiaoqing Guo, Aris T. Papageorghiou, J. Alison Noble

6D位姿估计

本文面向胎儿头部超声标准切面获取中对操作者三维空间判断和外部传感器的依赖,提出 Pose-GuideNet 将自由手 2D 超声直接配准到 3D 解剖图谱以估计 6D 位姿,并用标准切面几何先验与语义感知对比学习对离切面帧进行一致对齐。两项头部生物测量任务显示其能较准确恢复胎头方向与切面位姿,基于探头运动的评估也支持其用于无传感器扫描导航。

OPPH: A Vision-Based Operator for Measuring Body Movements for Personal Healthcare Figure 1
arXiv preprint2024-08-18

OPPH: A Vision-Based Operator for Measuring Body Movements for Personal Healthcare

Longfei Chen 0000-0002-3935-8021, Subramanian Ramamoorthy 0000-0002-6300-5103, Robert B Fisher 0000-0001-6860-9371

6D位姿估计

面向个人医疗中的长期、无接触身体运动监测,论文指出通用姿态估计难以捕捉细微运动,光流在弱光和真实噪声下易误判静止状态。OPPH将人体运动与噪声特性建模为多阶段视觉滤波算子,用于增强现有姿态/光流方法。在两个真实和一个合成数据集上,它显著降低静止检测误差,HuMoLs上速度RMSE低至2.7×10^-4像素,并基本保持主动运动估计与长期趋势相关性。

An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface Figure 1
arXiv preprint2024-08-17

An Open-Source American Sign Language Fingerspell Recognition and Semantic Pose Retrieval Interface

1 Background

6D位姿估计

该文面向美国手语学习与无障碍交互中对实时指拼识别和姿态检索工具的需求,提出开源界面,将手语识别流程与基于语义的姿态检索结合,关联指拼、gloss 与人体/手部姿态表示。由于可抽取文本主要是背景综述,具体模型细节、数据集、6D 位姿定义与定量实验文中未充分说明,主要结果和增益来源判断受限于 PDF 文本抽取质量。

ADen: Adaptive Density Representations for Sparse-view Camera Pose Estimation Figure 1
arXiv preprint2024-08-16

ADen: Adaptive Density Representations for Sparse-view Camera Pose Estimation

Hao Tang, Weiyao Wang, Pierre Gleize, Matt Feiszli

6D位姿估计相机位姿

面向稀疏视角下传统 SfM 因重叠少而失效、直接回归又难处理对称多解的问题,ADen 的核心洞察是位姿分布通常集中在少数模式而非均匀铺满空间,因此用生成器自适应产生多种 6DoF 位姿假设、判别器选择最能解释图像的候选。实验显示其用约数百个样本即可优于需密集采样的概率方法,在低误差阈值下精度更高且推理更快。

Correspondence-Guided SfM-Free 3D Gaussian Splatting for NVS Figure 1
arXiv preprint2024-08-16

Correspondence-Guided SfM-Free 3D Gaussian Splatting for NVS

Wei Sun, Xiaosong Zhang, Fang Wan, Yanzhao Zhou, Yuan Li, Qixiang Ye, Jianbin Jiao

6D位姿估计三维重建高斯泼溅

本文面向无 SfM 预处理位姿的新视角合成,指出初始位姿不准时逐像素 L2 监督会因渲染图与目标图错位产生过大梯度,导致 3DGS 联合优化不稳定。方法用渲染图—目标图的 2D 对应关系替代固定像素网格监督,并通过近似表面渲染把屏幕空间对应误差反传到 3D Gaussian,先逐帧估计相对位姿再重建全场景。实验显示其相较现有 SfM-free NVS/3DGS 基线在质量与时间效率上更优。

HyperTaxel: Hyper-Resolution for Taxel-Based Tactile Signals Through Contrastive Learning Figure 1
IROS 20242024-08-15

HyperTaxel: Hyper-Resolution for Taxel-Based Tactile Signals Through Contrastive Learning

Hongyu Li, Snehal Dikhale, Jinda Cui, Soshi Iba, Nawid Jamali

6D位姿估计

针对 taxel 触觉传感器分辨率低、布局不统一而难以用于灵巧操作与 6D 手内位姿估计的问题,HyperTaxel 将触觉信号建模为图,用对比学习对齐低分辨率 taxel 与高分辨率接触表面,并通过多接触联合概率降低定位歧义。实验显示其表征优于两类基线,可捕获平面、曲率和边缘等几何特征,并提升表面分类、6D 位姿估计及仿真到真实迁移表现。

Comparative Evaluation of 3D Reconstruction Methods for Object Pose Estimation Figure 1
arXiv preprint2024-08-15

Comparative Evaluation of 3D Reconstruction Methods for Object Pose Estimation

Varun Burde, Assia Benbihi, Pavel Burget, Robotics, Cybernetics

Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague

6D位姿估计物体位姿三维重建

针对通用6D位姿估计依赖难获取CAD模型的问题,本文将“图像重建的3D模型是否足够用于位姿估计”作为下游任务来评测,构建了与YCB-V/BOP对齐的重建-位姿基准。实验显示,现代重建几何常可支撑较准位姿,但传统MVS在速度-精度上不逊学习方法;同时常规重建指标与位姿精度相关性弱,且相比CAD仍有明显差距。

Towards Practical Human Motion Prediction with LiDAR Point Clouds Figure 1
arXiv preprint2024-08-15

Towards Practical Human Motion Prediction with LiDAR Point Clouds

Xiao Han, Yiming Ren, Yichen Yao, Yujing Sun, Yuexin Ma

ShanghaiTech University, Shanghai, The University of Hong Kong, Hong Kong

6D位姿估计点云

该文针对传统人体运动预测依赖历史真值骨架、落地时需先做姿态估计而易累积误差的问题,提出 LiDAR-HMP,直接从单个 LiDAR 原始点云预测未来 3D 人体姿态。核心在于结构感知身体特征、可学习查询的运动隐空间映射和时空相关细化,并支持多样化预测。在 LiDARHuman26M 与 LIPD 上短期、长期 MPJPE 均显著优于既有方法,并展示了远距离、遮挡、噪声及真实部署下的鲁棒性。

Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Models Figure 1
arXiv preprint2024-08-15

Polaris: Open-ended Interactive Robotic Manipulation via Syn2Real Visual Grounding and Large Language Models

Tianyu Wang, Haitao Lin, Junqiu Yu, Yanwei Fu

Tianyu Wang, Haitao Lin, Junqiu Yu and Yanwei Fu are with Fudan University, China

6D位姿估计机器人操作

Polaris瞄准LLM能理解开放式指令却缺少可靠视觉落地、难以在真实桌面中定位并操作目标的问题,将GPT-4任务解析、视觉grounding与基于6D位姿的规划结合;其关键在于用可渲染3D模型自动生成带位姿标注的合成深度数据,训练Syn2Real类别级位姿估计模型并迁移到真实场景。论文报告真实图像测试和实体机器人抓取、多步操作实验均取得较好成功率,但泛化到更复杂场景仍主要由实验展示支撑。

GOReloc: Graph-based Object-Level Relocalization for Visual SLAM Figure 1
arXiv preprint2024-08-15

GOReloc: Graph-based Object-Level Relocalization for Visual SLAM

Yutong Wang, Chaoyang Jiang, Xieyuanli Chen

6D位姿估计物体位姿相机位姿

针对视觉SLAM重定位中点特征易受光照/视角影响、物体级方法又常因语义噪声和重复场景导致关联错误的问题,GOReloc将当前帧检测与轻量物体地图建成带语义不确定性的对象图,用图核增强节点可区分性,并保留多候选子图后以类RANSAC联合细化关联和相机位姿。多数据集结果显示,其数据关联精度、重定位成功率和位姿误差均优于非图方法、随机游走等基线及ORB-SLAM2。

Grasping by Hanging: a Learning-Free Grasping Detection Method for Previously Unseen Objects Figure 1
arXiv preprint2024-08-13

Grasping by Hanging: a Learning-Free Grasping Detection Method for Previously Unseen Objects

Wanze Li, Wan Su, Gregory S. Chirikjian

6D位姿估计未知物体

针对学习式抓取依赖大量数据且对薄片、扁平或带把手未知物体表现不稳的问题,本文把抓取重新表述为“可悬挂结构”的检测与钩挂:先从物体网格中找悬挂位置和方向,再为改装平行夹爪生成无碰撞6D抓取位姿并排序。真实机器人实验显示,GbH在单视角和10视角下成功率达72%和90.7%,显著高于基线30.7%,优势主要体现在衣架、杯柄等可挂结构上。

A Miniature Vision-Based Localization System for Indoor Blimps Figure 1
arXiv preprint2024-08-13

A Miniature Vision-Based Localization System for Indoor Blimps

Shicong Ma

6D位姿估计

针对室内飞艇载荷小、传统声呐/IMU方案成本高且依赖外部视觉标记不适合大范围环境的问题,本文构建轻量单目相机加 WiFi 的感知系统,将图像传至地面站处理;方法上用 SuperPoint 特征进行 SfM 离线建稀疏点云地图,并通过地图投影剔除外点、搜索窗完成 2D-3D 关联,再用因子图与 GTSAM 连续估计 6DoF 位姿。文中表明系统可支持室内飞艇无标记视觉定位,但定量精度、鲁棒性对比和实际飞行效果未充分说明。

Moo-ving Beyond Tradition: Revolutionizing Cattle Behavioural Phenotyping with Pose Estimation Techniques Figure 1
arXiv preprint2024-08-12

Moo-ving Beyond Tradition: Revolutionizing Cattle Behavioural Phenotyping with Pose Estimation Techniques

PAGE 1, Navid Ghassemi1, Ali Goldani3, Ian Q. Whishaw4, Majid H. Mohajerani2

Psychiatry, Douglas Hospital Research Centre, McGill University, Montréal, Québec, Canada; The, Hub for Neuroengineering Solutions, University of Lethbridge, Lethbridge, Alberta, Canada, Canadian Centre for Behavioural Neuroscience, Department of Neuroscience, University of, Lethbridge, Lethbridge, Alberta, Canada

6D位姿估计

针对传统牛只巡检成本高、难以规模化的问题,本文综述将计算机视觉姿态估计用于牛行为表型、健康监测和福利评估的研究进展。核心洞察是把视频压缩为关节位置与运动轨迹,可支持跛行、采食、产犊等事件识别;同时指出数据多样性、关键点标准不一致、跨牧场泛化和评测设计是主要瓶颈。论文主要产出是系统梳理开发流程、指标与应用缺口,并提出 Open Cattle 平台连接产业与学术;文中未给出新的模型实验增益。

CAD-Mesher: A Convenient, Accurate, Dense Mesh-based Mapping Module in SLAM for Dynamic Environments Figure 1
arXiv preprint2024-08-12

CAD-Mesher: A Convenient, Accurate, Dense Mesh-based Mapping Module in SLAM for Dynamic Environments

Yanpeng Jia, Fengkui Cao, Ting Wang, Yandong Tang, Shiliang Shao, Lianqing Liu

6D位姿估计相机位姿

针对传统 LiDAR SLAM 点云地图离散、放大后稀疏且动态物体易造成网格鬼影的问题,CAD-Mesher提出可插拔的动态环境三角网格建图模块,通过配准前基于可见性的粗动态剔除、配准后体素概率精剔除,并结合滑窗关键帧聚合与自适应降采样生成均匀训练点。五个公开数据集结果显示,它可与多种里程计集成,提升定位精度并构建更干净、稠密的连续网格地图。

PAFormer: Part Aware Transformer for Person Re-identification Figure 1
arXiv preprint2024-08-12

PAFormer: Part Aware Transformer for Person Re-identification

Hyeono Jung, Jangwon Lee, Jiwon Yoo, Dami Ko, Gyeonghwan Kim

6D位姿估计

针对部分行人重识别中“部件原型”常被颜色等非解剖线索误导、难以真正同部位匹配的问题,PAFormer用姿态热图监督Transformer内的pose token,使其学习身体部位与图像patch的关联,并用可学习可见性预测处理遮挡;推理时不依赖额外定位模块。实验称其在Market-1501、DukeMTMC-ReID和Occluded-Duke上超过已有方法。

SABER-6D: Shape Representation Based Implicit Object Pose Estimation Figure 1
arXiv preprint2024-08-11

SABER-6D: Shape Representation Based Implicit Object Pose Estimation

Shishir Reddy Vutukur 0000-0002-4406-8491, Mengkejiergeli Ba 0009-0008-7905-9609, Benjamin Busam 0000-0002-0620-5774, Matthias Kayser 0009-0000-5228-3397, Gurprit Singh 0000-0003-0970-5835

6D位姿估计物体位姿

面向机器人抓取中仅有CAD模型且物体对称性未知时的6D位姿估计难题,SABER将位姿学习转化为由RGB图像条件化的旋转形状表示:CNN预测旋转嵌入,DeepSDF解码对应姿态下的SDF形状,并用两阶段训练稳定学习。该设计利用形状/图像对对称变换不敏感的特性,无需对称标签;在Occlusion-LineMOD和T-LESS上对对称与非对称物体取得接近基准的结果。

Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis Figure 1
arXiv preprint2024-08-10

Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis

Zhongche Qu, Zhi Zhang, Cong Liu, Jianhua Yin

Columbia University, New York University, Peng Cheng Laboratory, Peng Cheng Laborbatory

6D位姿估计相机位姿彩色深度高斯泼溅

针对传统几何 SLAM 难以兼顾稠密重建、学习式方法实时性和精度不足的问题,本文将 3D Gaussian Splatting 用于 RGB-D SLAM 的场景表示与位姿优化,并引入深度先验约束及旋转/平移解耦的反向优化,以缓解高斯表面多视角不一致。实验在公开基准上显示其在相机位姿、几何精度和渲染性能上优于已有方法,并可达到厘米级定位与更准确的深度重建。

Anticipation through Head Pose Estimation: a preliminary study Figure 1
arXiv preprint2024-08-10

Anticipation through Head Pose Estimation: a preliminary study

Federico Figari Tomenotti, Nicoletta Noceti

6D位姿估计

面向人机共处中机器人需提前理解人类取物、搬运意图的问题,本文将头部6D姿态作为 gaze 的可用代理,结合人体关键点、YOLO物体框与简单时空几何关系,无监督判断人先看向目标与手/物体到达目标的时间差。私有桌面操作数据上的初步实验显示,头部方向常可在手到达前约十余帧(约1/3秒)指向目标,支持短时意图预判;但数据规模与泛化性文中未充分说明。

Mesh-based Object Tracking for Dynamic Semantic 3D Scene Graphs via Ray Tracing Figure 1
arXiv preprint2024-08-09

Mesh-based Object Tracking for Dynamic Semantic 3D Scene Graphs via Ray Tracing

Lennart Niecksch1, Alexander Mock2, Felix Igelbrink1, Thomas Wiemann3, Joachim Hertzberg12

German Research Centre for Artificial Intelligence, Osnabrück University, Institute of Computer Science, Fulda University of Applied Sciences, Department of Applied Computer Science, Robotics in Computer Science, Fulda, Germany

6D位姿估计

面向机器人在动态场景中维护可推理的语义3D场景图,本文将YOLOv8关键点检测与PnP得到的已知物体初始6D位姿,用基于网格模型的光线追踪/Mesh-ICP在深度数据上细化并持续跟踪。核心洞察是用统一的mesh场景图同时服务自定位、传感器预分割和物体跟踪,遮挡下较点对点匹配更稳健。Tiago实机初步实验显示能自然跟踪多物体并接入SEMAP推断on、left-of等空间关系,但定量基准评测仍待补充。

PoseMamba: Monocular 3D Human Pose Estimation with Bidirectional Global-Local Spatio-Temporal State Space Model Figure 1
arXiv preprint2024-08-07

PoseMamba: Monocular 3D Human Pose Estimation with Bidirectional Global-Local Spatio-Temporal State Space Model

Yunlong Huang, Junshuo Liu, Ke Xian, Robert Caiming Qiu

6D位姿估计人体姿态

针对单目视频 2D-to-3D 人体姿态估计中 Transformer 自注意力计算/显存开销高、时空关系建模不充分的问题,PoseMamba 用纯 SSM/Mamba 取代注意力,设计双向全局-局部时空块,并通过符合骨架几何的关节重排序强化局部肢体扫描。实验在 Human3.6M 与 MPI-INF-3DHP 上达到 SOTA,同时参数和 MACs 更少,推理较 MotionAGFormer 快 2.8×、显存降低 64.7%。

Line-based 6-DoF Object Pose Estimation and Tracking With an Event Camera Figure 1
arXiv preprint2024-08-06

Line-based 6-DoF Object Pose Estimation and Tracking With an Event Camera

Zibin Liu, Banglei Guan, Member, IEEE, Yang Shang, Qifeng Yu, Laurent Kneip, Senior Member

6D位姿估计物体位姿事件相机

针对传统相机在高速运动、强动态光照和反光物体中易模糊或跟踪失效的问题,本文用事件相机的边缘触发特性做6D位姿估计与跟踪。核心思路是直接从事件中提取线特征,在未知2D-3D线对应下用全局BnB初始化,再通过事件-模型线匹配和带鲁棒权重的事件到线距离最小化持续优化位姿。作者还构建了事件运动物体数据集,并在合成与真实数据上相较现有方法表现出更好的精度和鲁棒性。

Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mW Figure 1
arXiv preprint2024-08-06

Training on the Fly: On-device Self-supervised Learning aboard Nano-drones within 20 mW

Elia Cereda, Alessandro Giusti, Daniele Palossi

6D位姿估计

针对纳米无人机在新环境中因域偏移导致感知退化、且算力/内存/标签受限的问题,论文将预训练 PULP-Frontnet 在机端用少量部署域图像微调,并以自运动一致性构造自监督损失替代真值标签。系统在 GAP9 上用 512 张图仅需约 1MB 内存,可低至 19mW 或 510ms 完成训练;实地闭环跟随中,相比未微调基线水平位置误差最高降低 26%,困难未见环境下由失败转为基本完成任务。

BodySLAM: A Generalized Monocular Visual SLAM Framework for Surgical Applications Figure 1
arXiv preprint2024-08-06

BodySLAM: A Generalized Monocular Visual SLAM Framework for Surgical Applications

Guido Manni, Clemente Lauretti, Francesco Prata, Rocco Papalia, Loredana Zollo, Paolo Soda

6D位姿估计相机位姿医学/手术

针对内窥镜手术中单目相机、无里程计且组织低纹理/光照变化导致深度与位姿难估的问题,BodySLAM将无监督GAN式CycleVO位姿估计、Zoe单目深度和三维重建组合成MVSLAM框架。在Hamlyn、EndoSLAM、SCARED的腹腔镜、胃镜、结肠镜场景中,CycleVO推理最快且位姿表现有竞争力,Zoe深度估计优于对比方法,显示出跨场景泛化潜力。

Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network Figure 1
arXiv preprint2024-08-07

Pose Magic: Efficient and Temporally Consistent Human Pose Estimation with a Hybrid Mamba-GCN Network

Xinyi Zhang, Qiqi Bao, Qinpeng Cui, Wenming Yang, Qingmin Liao

6D位姿估计人体姿态

针对单目视频3D人体姿态估计中 Transformer 难兼顾精度、时序一致性与计算效率的问题,Pose Magic 用 Mamba 建模长程时空依赖,并以 GCN 补足相邻关节的局部结构关系,再自适应融合两路特征;还提供仅用过去与当前帧的因果版本以支持实时推理。实验显示其在两个基准上达到新 SOTA,误差降低约0.9mm,同时减少74.1% FLOPs,并在运动平滑性和未见序列长度泛化上表现更好。

Analyzing Data Efficiency and Performance of Machine Learning Algorithms for Assessing Low Back Pain Physical Rehabilitation Exercises Figure 1
arXiv preprint2024-08-05

Analyzing Data Efficiency and Performance of Machine Learning Algorithms for Assessing Low Back Pain Physical Rehabilitation Exercises

Aleksa Marusic, Louis Annabi, Sao Mai Nguyen, Adriana Tapus

6D位姿估计

针对低背痛患者居家康复缺少治疗师监督、数据又较少的问题,本文比较了基于骨架序列的 GMM 似然评分与 STGCN 运动质量评估,并考察 Kinect、OpenPose、BlazePose 等不同姿态来源的数据效率。在 KIMORE 与 Keraal 数据集上,三类姿态输入得到相近评分,STGCN 在多数设置下优于 GMM,提示普通 RGB 姿态估计可替代部分深度传感器用于康复评估。

Joint-Motion Mutual Learning for Pose Estimation in Videos Figure 1
arXiv preprint2024-08-05

Joint-Motion Mutual Learning for Pose Estimation in Videos

Sifan Wu, Haipeng Chen, Yifang Yin, Sihao Hu, Runyang Feng, Yingying Jiao, Ziqi Yang, Zhenguang Liu

College of Computer Science and Technology, Jilin University, Institute for Infocomm Research ( I, Georgia Institute of Technology, School of Artificial Intelligence, Jilin University, The State Key Laboratory of Blockchain and Data Security, Zhejiang University, Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security, Hangzhou, China

6D位姿估计

这篇论文针对视频人体姿态估计在失焦、自遮挡等困难帧中仅用热图或仅用特征都不稳的问题,提出 JM-Pose,将初始热图中的局部关节依赖与像素级运动流的全局动态进行互学习。其关键是用热图引导的上下文关节学习器提取局部关节特征,并通过渐进式关节-运动信息交换与正交约束减少冗余。实验显示其在三个公开视频姿态基准上优于已有方法。

AvatarPose: Avatar-guided 3D Pose Estimation of Close Human Interaction from Sparse Multi-view Videos Figure 1
arXiv preprint2024-08-04

AvatarPose: Avatar-guided 3D Pose Estimation of Close Human Interaction from Sparse Multi-view Videos

Feichi Lu 0009-0007-4017-9606, Zijian Dong 0009-0003-4150-5072, Jie Song 0009-0003-7484-1937, Otmar Hilliges 0000-0002-5068-3474

6D位姿估计多视角

针对多人近距离互动中遮挡、接触导致2D关节检测不可靠、进而影响多视角3D位姿的问题,AvatarPose先从稀疏多视角视频重建每个个体的隐式带纹理avatar,并将其作为个性化先验,通过颜色与轮廓渲染损失直接优化3D姿态,同时加入基于avatar重叠区域的碰撞损失并交替优化姿态与avatar。实验显示其在多个公开近距离互动数据集上优于已有SOTA,尤其提升遮挡和身体接触场景的鲁棒性。

Generalized Maximum Likelihood Estimation for Perspective-n-Point Problem Figure 1
arXiv preprint2024-08-04

Generalized Maximum Likelihood Estimation for Perspective-n-Point Problem

Tian Zhan, Chunfeng Xu, Cheng Zhang, Ke Zhu

6D位姿估计

针对传统 PnP 常假设各向同性噪声、在真实传感器观测和鱼眼等相机中易导致位姿次优的问题,本文提出 GMLPnP:用迭代广义最小二乘同时估计位姿与观测不确定性,并以与相机模型解耦的目标函数实现广义最大似然求解。合成与真实实验显示其在 TUM-RGBD、KITTI-360 上较最佳基线提升旋转/平移精度,且在高噪声 UAV 定位中平移误差优势更明显。

MotionTrace: IMU-based Field of View Prediction for Smartphone AR Interactions Figure 1
arXiv preprint2024-08-03

MotionTrace: IMU-based Field of View Prediction for Smartphone AR Interactions

Rahul Islam, Vasco Xu, Karan Ahuja

Stevens Institute of Technology, University of Chicago, Northwestern University

6D位姿估计

手机 AR 受带宽与持续视觉跟踪功耗限制,需要提前预测用户视场以优先加载内容。MotionTrace 的关键思路是只依赖手机 IMU,结合历史手部位置、姿态四元数与加速度,用双层双向 LSTM 预测持机手的未来 3D 位置,从而辅助 FOV 预测。其在 AMASS 与 Pose-on-the-Go 上评估 50–800 ms 预测,平均 MSE 为 0.11–143.62 mm,最佳效果集中在 50–400 ms,长时域误差明显增大。

BEVPlace++: Fast, Robust, and Lightweight LiDAR Global Localization for Unmanned Ground Vehicles Figure 1
arXiv preprint2024-08-03

BEVPlace++: Fast, Robust, and Lightweight LiDAR Global Localization for Unmanned Ground Vehicles

Lun Luo, Si-Yuan Cao, Xiaorui Li, Jintao Xu, Rui Ai, Zhu Yu, Xieyuanli Chen

S. Cao is with Ningbo Innovation Center, Zhejiang University

6D位姿估计点云

面向无人地面车无初值的 LiDAR 全局定位,论文针对点云稀疏性、跨雷达泛化和精确位姿标注昂贵的问题,采用 BEV 表示并指出普通 CNN 已能在 BEV 上提取可匹配的局部特征;在此基础上设计 REM/REIN,将旋转等变局部特征与 NetVLAD 旋转不变全局描述结合,先检索地点再估计 3-DoF 位姿。仅用 KITTI 少量地点标签训练后,在 7 个公开数据集和 UGV 平台上实现实时、轻量且跨环境/传感器表现稳定,地点识别、闭环和全局定位达到 SOTA。

E $^3$ NeRF: Efficient Event-Enhanced Neural Radiance Fields from Blurry Images Figure 1
arXiv preprint2024-08-03

E $^3$ NeRF: Efficient Event-Enhanced Neural Radiance Fields from Blurry Images

Yunshan Qi, Jia Li, Yifan Zhao, Yu Zhang, Lin Zhu

6D位姿估计事件相机三维重建

针对真实采集中的低光照、快速非匀速运动导致的模糊图像难以训练清晰 NeRF,E³NeRF 将事件流与模糊 RGB 联合建模:用模糊渲染损失对应曝光积分,用事件渲染损失约束亮度变化,并利用事件的时空分布分配训练、定位空间模糊,同时引入事件引导位姿估计以适配实拍数据。合成与真实实验显示其在严重运动模糊和低光场景下能重建更清晰的辐射场与新视角结果。

Survey on Emotion Recognition through Posture Detection and the possibility of its application in Virtual Reality Figure 1
arXiv preprint2024-08-03

Survey on Emotion Recognition through Posture Detection and the possibility of its application in Virtual Reality

PAGE 1

Journal of Artificial Intelligence Research 23 (2005) 533-585, Submitted _/2024; published _/2024, Sciences, Ain Shams University, Egypt, Information Sciences, Ain Shams University, Egypt, and Information Sciences, Ain Shams University, Egypt

6D位姿估计综述

面向情感机器人、VR 交互等需要理解人体情绪的场景,本文综述了2019–2023年基于姿态/体态进行情绪识别的19项研究,比较普通相机、深度相机、图像/视频与3D姿态向量等输入及分类方法。核心洞察是单独姿态线索仍受场景、下肢捕获和数据集限制,多模态融合通常取得最高准确率;同时文中指出VR在该任务中的直接应用文献较少,更多仍停留在潜在可行性讨论。

Full-range Head Pose Geometric Data Augmentations Figure 1
arXiv preprint2024-08-02

Full-range Head Pose Geometric Data Augmentations

Huei-Chung Docomo Innovations heidi.hu@docomoinnovations.com, Liu, Wei, Hsin-Tai : 1 Docomo Innovations hwu@docomoinnovations.com

Santa Clara University

6D位姿估计

本文针对全范围头部6D位姿估计中常见的坐标系、欧拉角顺序和姿态可视化定义混乱问题,指出这些细节会导致大角度标注和增强失真。核心贡献是系统推导特定坐标系下旋转矩阵的2D几何增强、轴绘制与pitch-yaw覆盖验证,用于生成更可靠的全范围头姿数据。实验显示将这些增强加入现有HPE方法可提升性能,但具体增益幅度和来源在给定文本中未充分说明。

Adapting Skills to Novel Grasps: A Self-Supervised Approach Figure 1
arXiv preprint2024-07-31

Adapting Skills to Novel Grasps: A Self-Supervised Approach

Georgios Papagiannis, Kamil Dreczkowski, Vitalis Vosylius

The Robot Learning Lab, at Imperial College London

6D位姿估计

这篇论文面向工具等被抓取物体在部署时抓姿变化导致原有操作轨迹失效的问题,避免为每种抓姿重新示教或依赖重抓取。核心做法是不显式估计物体6D位姿,而通过机器人自监督采集外部相机下的抓取物体图像,训练网络直接预测轨迹修正变换;无需CAD模型、相机标定,可用RGB/深度。真实实验1360次显示,RGB自监督版本误差最低,并在多种日常任务中较最佳基线平均成功率提升28.5%。

Certifying Robustness of Learning-Based Keypoint Detection and Pose Estimation Methods Figure 1
arXiv preprint2024-07-31

Certifying Robustness of Learning-Based Keypoint Detection and Pose Estimation Methods

Xusheng Luo, Tianhao Wei, Simin Liu, Ziwei Wang, Luis Mattei-Mendez, Taylor Loper, Joshua Neighbor, Casidhe Hutchison, Changliu Liu

Carnegie Mellon University

6D位姿估计

面向机器人等安全关键场景,本文关注两阶段关键点检测+PnP的6D位姿估计缺乏可证明鲁棒性的问题。其核心是把系统级局部鲁棒性转化为分类式神经网络验证:用更易验证的代理关键点模型、凸包刻画语义扰动,并通过PnP敏感性分析把位姿误差约束分配到关键点阈值。实验在真实扰动下验证框架有效,并给出一定条件下的可靠性与完备性分析。

StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with Offset Figure 1
arXiv preprint2024-07-30

StackFLOW: Monocular Human-Object Reconstruction by Stacked Normalizing Flow with Offset

Chaofan Huo, Ye Shi, Yuexin Ma, Lan Xu, Imaging @shanghaitech.edu.cn

ShanghaiTech University, Shanghai Engineering Research Center of Intelligent Vision and Imaging

6D位姿估计三维重建

针对单目图像中人和物体联合三维重建易受遮挡、深度歧义和交互约束不足影响的问题,StackFLOW用人体与物体表面密集锚点间的HO-offset表示全局空间关系,并以堆叠归一化流建模其后验分布,再结合似然与重投影损失优化人体姿态和物体6D位姿。在BEHAVE与InterCap上优于既有方法,论文称相对精度提升16%、优化时间减少88%,重遮挡场景表现尤为突出。

HandDAGT: A Denoising Adaptive Graph Transformer for 3D Hand Pose Estimation Figure 1
arXiv preprint2024-07-30

HandDAGT: A Denoising Adaptive Graph Transformer for 3D Hand Pose Estimation

Wencan Cheng, Eunji Kim, Jong Hwan Ko

6D位姿估计手部姿态

针对手部自遮挡和手-物交互遮挡下静态图难以适应动态关键点关系的问题,HandDAGT以深度图和点云为多模态输入,在3D关键点空间中用自适应图Transformer权衡局部几何与运动学关联,并加入去噪训练提升鲁棒性。在ICVL、NYU、DexYCB、HO3D四个基准上报告达到SOTA,误差分别为5.66mm、7.12mm、8.03mm和1.81cm。

Markers Identification for Relative Pose Estimation of an Uncooperative Target Figure 1
arXiv preprint2024-07-30

Markers Identification for Relative Pose Estimation of an Uncooperative Target

Batu Candan, Simone Servadio

PhD Student, Department of Aerospace Engineering, Iowa State University, IA 50011, USA

6D位姿估计相机位姿

面向ENVISAT等非合作失效卫星的安全离轨,论文将追踪航天器图像中的结构角点/标记作为相对位姿观测来源,采用经噪声、模糊增强训练的改进CNN检测标记,并结合UKF建模相对状态估计。实验显示CNN可较稳定识别卫星角点,平移与姿态估计误差保持在可接受水平;但CNN与UKF的在线闭环集成仍属后续工作,整体增益来源部分可能来自数据增强。

BaseBoostDepth: Exploiting Larger Baselines For Self-supervised Monocular Depth Estimation Figure 1
arXiv preprint2024-07-29

BaseBoostDepth: Exploiting Larger Baselines For Self-supervised Monocular Depth Estimation

Kieran Saunders

6D位姿估计彩色深度

这篇工作针对自监督单目深度估计中过度依赖相邻帧、难以利用大基线的问题,指出直接扩大时间间隔会带来亮度变化、遮挡和位姿漂移。BaseBoostDepth通过课程式从小到大基线训练、三重重建最小化、增量位姿估计与误差扰动重建来稳定优化,并强调亮度-对比线索可改善物体边界。实验在KITTI和SYNS-patches上报告了图像、边缘和点云指标的SOTA,且测试时不增加计算复杂度。

Skeleton-based Group Activity Recognition via Spatial-Temporal Panoramic Graph Figure 1
arXiv preprint2024-07-28

Skeleton-based Group Activity Recognition via Spatial-Temporal Panoramic Graph

Zhengcen Li 0000-0001-9736-7375, Xinle Chang, Yueran Li, Jingyong Su 0000-0003-3216-7027

6D位姿估计

针对群体活动识别中 RGB 方法计算开销大、易受背景/遮挡影响,而现有关键点方法又依赖精确个体标注和额外交互模块的问题,论文将多人体骨架与物体关键点组织成全景时空图,用 MP-GCN 统一建模人体内部、人与人及人与物关系,并通过姿态估计、检测与跟踪替代真值轨迹。在 Volleyball、NBA 等数据集上,仅用估计 2D 关键点即达到或超过现有方法,且效率优于 RGB 路线。

Flexible graph convolutional network for 3D human pose estimation Figure 1
arXiv preprint2024-07-26

Flexible graph convolutional network for 3D human pose estimation

Abu Taib Mohammed Shahjahan

6D位姿估计人体姿态

针对标准 GCN 在 3D 人体姿态估计中只聚合一跳关节、难以处理遮挡与深度歧义的问题,Flex-GCN 用可调缩放因子融合一跳与二跳邻域,并调制邻接矩阵、加入残差块和全局响应归一化以增强全局依赖建模。在两个基准数据集上的定量、定性和消融实验显示其相对强基线具有竞争力,但具体优势幅度需结合完整表格判断。

From 2D to 3D: AISG-SLA Visual Localization Challenge Figure 1
arXiv preprint2024-07-26

From 2D to 3D: AISG-SLA Visual Localization Challenge

Jialin Gao, Bill Ong, Darld Lwi, Zhen Hao Ng, Xun Wei Yee, Mun-Thye Mak, Wee Siong Ng, See-Kiong Ng, Hui Ying Teo, Victor Khoo, Georg Bökman, Johan Edstedt, Kirill Brodt, Clémentin Boittiaux, Maxime Ferrera &Stepan Konev AI Singapore, Singapore Singapore Land Authority, Sweden Université de Montréal, Canada Ifremer, Centre Méditerranée, France Booking.com, Netherlands @aisingapore.org, @sla.gov.sg, @aisingapore.org, wsng@i2r.a-star.edu.sg, seekiong@nus.edu.sg, bokman@chalmers.se, johan.edstedt@liu.se, kirill.brodt@umontreal.ca, @gmail.com

Institute for Infocomm Research, Singapore, National University of Singapore, Singapore, Chalmers University of Technology, Sweden, Linköping University, Sweden, Ifremer, Centre Méditerranée, France, Booking.com, Netherlands

6D位姿估计相机位姿数据集/基准

面向智慧城市和机器人/自动驾驶中低成本3D定位需求,本文将单目街景图像的6D相机位姿估计整理为AISG-SLA VLC挑战与数据集,突出低帧率、时间间隔不均、转弯和光照变化导致的匹配困难。其主要贡献更像是真实新加坡车载场景基准与优胜方案梳理;挑战吸引300余名参与者、50多个团队,优胜队在相对旋转和位移估计上取得较高精度,但具体增益来源文中未充分说明。

HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation Figure 1
arXiv preprint2024-07-28

HumanVid: Demystifying Training Data for Camera-controllable Human Image Animation

Zhenzhi Wang, Yixuan Li, Yanhong Zeng, Youqing Fang, Yuwei Guo, Wenran Liu, Jing Tan, Kai Chen, Tianfan Xue, Bo Dai, bdai@hku.hk

The Chinese University of Hong Kong, Shanghai Artificial Intelligence Laboratory, The University of Hong Kong

6D位姿估计

针对人体图像动画依赖私有高质量数据、且多忽略相机运动导致新视角控制不稳的问题,HumanVid公开结合2万段1080P真实人体视频与基于约1万3D avatar合成的视频数据,并用2D姿态估计、SLAM和规则化相机轨迹生成提供人体/相机运动标注。作者进一步提出CamAnimate基线同时条件化人体姿态与相机运动,实验显示在姿态与相机控制上达到新的SOTA,但增益可能主要来自数据规模与标注质量。

Active Loop Closure for OSM-guided Robotic Mapping in Large-Scale Urban Environments Figure 1
arXiv preprint2024-07-24

Active Loop Closure for OSM-guided Robotic Mapping in Large-Scale Urban Environments

Wei Gao, Zezhou Sun, Mingle Zhao, Cheng-Zhong Xu, Hui Kong

6D位姿估计机器人操作

面向大规模城市自主建图中仅依赖 OSM/GPS 全局路径易因传感噪声、地形复杂和机体扰动导致位姿漂移累积的问题,论文将 OSM 道路拓扑规划、可通行区域引导点优化与基于不确定性评估的主动回环闭合结合,使机器人在必要时重规划到已访问地点触发后端优化。实地大规模户外实验显示,该机制能降低位姿误差和不确定性,并提升 OSM 引导建图的稳定性。

DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstruction Figure 1
arXiv preprint2024-07-24

DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstruction

Xiaobiao Du, Haiyang Sun, Ming Lu, Tianqing Zhu, Xin Yu

Xin Yu is with The University of Queensland

6D位姿估计三维重建

DreamCar面向自动驾驶仿真中高质量车辆资产依赖人工建模、真实数据又常只有单侧少视角且位姿不准的问题,提出利用车辆镜像对称补充监督,并构建含5600余辆车的Car360来训练车类专用生成先验,通过SDS指导重建,同时用PoseMLP校正相机位姿以缓解纹理错位。实验表明其在真实自动驾驶数据和Car360上较现有方法能重建更完整、几何与纹理更好的3D车辆。

Pose Estimation from Camera Images for Underwater Inspection Figure 1
arXiv preprint2024-07-24

Pose Estimation from Camera Images for Underwater Inspection

Luyuan Peng, Hari Vishnu, Mandar Chitre, Yuen Min Too, Bharath Kalyan, Rajat Mishra, Soo Pieng Tan

6D位姿估计

面向水下复检中GPS不可用、声学/惯导方案昂贵且易漂移的问题,论文研究用相机图像做6D重定位。核心做法是在PoseNet式网络中引入符合巡检几何的d-loss,比较RGB/灰度与CNN+LSTM/ResNet配置,并用NeRF/3DGS类新视角合成扩充训练数据,再经EKF融合高度计、罗盘等传感器。结果显示RGB优于灰度,ResNet50+CNN-LSTM最佳,在水池数据达约0.12 m、1.34°;跨航次泛化依赖数据多样性,NVS增强和EKF可提升未覆盖区域精度与轨迹平滑性。

COALA: A Practical and Vision-Centric Federated Learning Platform Figure 1
arXiv preprint2024-07-23

COALA: A Practical and Vision-Centric Federated Learning Platform

Weiming Zhuang, Jian Xu, Chen Chen, Jingtao Li, Lingjuan Lyu

6D位姿估计

现有联邦学习平台多停留在分类和静态、全监督、单模型设定,难以评估视觉任务在真实隐私场景中的异构性。COALA 将基准扩展到15类视觉任务,并从任务、数据、模型三层支持多任务、半/无监督、特征偏移、持续学习、拆分模型与异构模型训练。系统实验表明该平台能自动化复现实用FL场景并暴露性能瓶颈;具体算法增益并非论文重点。

Probabilistic Parameter Estimators and Calibration Metrics for Pose Estimation from Image Features Figure 1
arXiv preprint2024-07-23

Probabilistic Parameter Estimators and Calibration Metrics for Pose Estimation from Image Features

Untitled Document

Stanford Intelligent Systems Laboratory, Stanford University, Stanford, CA, A3 by Airbus LLC, Sunnyvale, CA

6D位姿估计

面向安全关键的自主视觉着陆,论文关注如何把图像特征检测的不确定性传递到6D/位姿估计而非只给点估计。作者比较采样最小二乘、线性近似和MCMC概率编程三类估计器,并给出多元正态校准与尖锐度的闭式度量。实验显示线性近似在高斯已知协方差下快约两个数量级且校准较好,但非高斯噪声会过度自信;MCMC更稳健。接入卡尔曼滤波后尖锐度约提升2倍,但联合校准仍受协方差误差影响。

Optimal camera-robot pose estimation in linear time from points and lines Figure 1
arXiv preprint2024-07-23

Optimal camera-robot pose estimation in linear time from points and lines

Guangyang Zeng

6D位姿估计机器人操作

针对机器人视觉位姿估计中点特征精度高、线特征适合弱纹理场景但难以统一建模的问题,论文提出 AOPnP(L),用二维点噪声统一点/线观测,并以 Plücker 线表示构建最大似然问题;通过偏差消除初始化加一次 Gauss-Newton 精修,实现渐近无偏、误差趋近 CRLB 且线性复杂度。实验显示其在静态定位和动态里程计中兼顾精度与实时性。

3D-UGCN: A Unified Graph Convolutional Network for Robust 3D Human Pose Estimation from Monocular RGB Images Figure 1
arXiv preprint2024-07-23

3D-UGCN: A Unified Graph Convolutional Network for Robust 3D Human Pose Estimation from Monocular RGB Images

PAGE 1, Proceedings of IEEE AICON2024

Academy of Artificial Intelligence, Beijing Institute of Petrochemical Technology, Beijing 102617, China

6D位姿估计人体姿态

针对单目视频中遮挡和部分帧3D人体骨架缺失导致姿态估计不稳的问题,论文将HybrIK直接回归得到的3D关键点序列送入改造后的UGCN,用时空图卷积对3D骨架进行细化而非仅处理2D输入。在Human3.6M上,3D-UGCN平均MPJPE为47.34,优于HybrIK的54.4和2D UGCN的76.83,但仍弱于部分对比方法;复杂姿态和遮挡处理能力文中也承认仍有限。

CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models Figure 1
arXiv preprint2024-07-21

CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models

Zheng Chong, Xiao Dong, Haoxiang Li, Shiyue Zhang, Wenqing Zhang, Xujie Zhang, Hanqing Zhao, Dongmei Jiang, Shenzhen, Guangdong 518107, P.R. China School of Artificial Intelligence, Zhuhai Campus, Zhuhai 519082, Chinese Academy of Sciences, Processing, Guangzhou, China @gmail.com, haoxiang@pixocial.com, @mail2.sysu.edu.cn, hq.zhao79@gmail.com, jiangdm@pcl.ac.cn, xdliang328@gmail.com

School of Artificial Intelligence, Sun Yat-sen University, Zhuhai Campus, Zhuhai 519082, China, Pixocial Technology, Pengcheng Laboratory, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China, Guangdong Key Laboratory of Big Data Analysis and Processing, Guangzhou, 510006, China

6D位姿估计

针对扩散式虚拟试衣依赖额外编码器、ReferenceNet和姿态/解析等预处理导致训练推理沉重的问题,CatVTON的核心洞察是人像与服装可在同一潜空间直接沿空间维拼接,由单个简化UNet完成交互;进一步只微调自注意力层即可适配任务。模型去除文本与图像编码器,总参数899M、可训练参数49.57M,推理仅需人像和服装参考,在VITON-HD、DressCode及野外场景中优于多种扩散基线,并降低约49%以上显存。

RADA: Robust and Accurate Feature Learning with Domain Adaptation Figure 1
arXiv preprint2024-07-22

RADA: Robust and Accurate Feature Learning with Domain Adaptation

Jingtai He, Gehao Zhang, Tingting Liu, Songlin Du

6D位姿估计仿真到现实

RADA针对昼夜、季节等外观变化导致局部特征检测与描述在跨域场景下不稳定的问题,提出多层特征聚合框架:在检测前用MMD与梯度反转式域适应对齐高层分布,并用带波位置编码的Transformer融合描述子与几何位置以增强上下文鲁棒性。实验覆盖图像匹配、相机位姿估计和视觉定位,显示其在强域偏移条件下优于现有局部特征方法。

Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection Figure 1
arXiv preprint2024-07-22

Local Occupancy-Enhanced Object Grasping with Multiple Triplanar Projection

Kangqi Ma, Hao Dong, Yadong Mu

6D位姿估计

针对单视角点云在遮挡杂乱场景中形状缺失、易导致6D抓取姿态估计碰撞或不准的问题,论文将补全限制在候选抓取点邻域,用局部占据预测恢复抓取相关几何,并以多组三平面投影融合局部与全局上下文以降低全场景体素建模开销。在 GraspNet-1Billion 和真实机械臂实验中,该方法提升了遮挡区域补全与抓取平均精度,优于对比方法。

6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model Figure 1
ECCV 20242024-07-22

6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model

Matteo Bortolon, Theodore Tsesmelis, Stuart James, Fabio Poiesi, Alessio Del Bue

6D位姿估计三维重建高斯泼溅

针对 iNeRF 等基于合成分析的位姿估计依赖初值、迭代慢且易陷入局部最优的问题,6DGS利用3D Gaussian Splatting的显式椭球表示反向推断相机位姿:通过 Ellicell 从高斯椭球发射候选射线,并用注意力匹配像素—射线束,再以加权最小二乘闭式求相机中心和旋转。实验显示其在真实场景中较NVS基线旋转精度提升约12%、平移精度提升约22%,消费级硬件约15fps。

Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditions Figure 1
arXiv preprint2024-07-23

Domain-Adaptive 2D Human Pose Estimation via Dual Teachers in Extremely Low-Light Conditions

Yihao Ai 0009-0005-2336-4813, Yifei Qi 0009-0007-4197-947X, Bo Wang 0000-0002-0127-2281, Yu Cheng 0000-0002-9830-0081, Xinchao Wang 0000-0003-0057-1404, Robby T. Tan 0000-0001-7532-6919

6D位姿估计人体姿态

针对极低照度下人体姿态标注困难、现有方法依赖成对低照/正常光真值数据的问题,论文提出仅用正常光标注与未标注低照图像的域自适应框架:中心式主教师负责较可见行人,关键点式互补教师补全漏检个体,并用人实例级低照退化增强训练学生模型。在 ExLPose-OCN 上无需低照真值仍较 SOTA 提升 6.8%(2.4 AP)。

avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality Figure 1
arXiv preprint2024-07-22

avaTTAR: Table Tennis Stroke Training with On-body and Detached Visualization in Augmented Reality

Dizhi Ma, Xiyun Hu, Jingyu Shi, Mayank Patel, Rahul Jain, Ziyi Liu, Zhengzhe Zhu, Karthik Ramani

Elmore Family School of Electrical and Computer Engineering, Purdue University, School of Mechanical Engineering

6D位姿估计

针对乒乓球初学者难以从教练或视频中理解三维挥拍轨迹、也缺少即时纠错的问题,avaTTAR 将3D人体姿态估计与球拍IMU结合,在AR中同时提供贴合身体的第一人称轨迹提示和分离式第三人称专家/用户化身对比。用户研究显示,相比传统视频学习,该系统能改善训练体验并提升挥拍学习效果。

From Underground Mines to Offices: A Versatile and Robust Framework for Range-Inertial SLAM Figure 1
2024 7th Iberian Robotics Conference (ROBOT)2024-07-20

From Underground Mines to Offices: A Versatile and Robust Framework for Range-Inertial SLAM

Lorenzo Montano-Oliván, Julio A. Placed, Luis Montano, María T. Lázaro

6D位姿估计相机位姿

面向矿井、城市和办公室等场景中光照差、结构弱、传感器配置多变导致的SLAM适配困难,论文提出LG-SLAM,将LiDAR、IMU与GNSS统一到图优化中,并改进子地图管理与带不确定性验证的回环闭合,结合并行和GPU实现在线优化。实验覆盖公开与真实数据,平均误差低于20 cm,并优于多种现有方法。

ESCAPE: Energy-based Selective Adaptive Correction for Out-of-distribution 3D Human Pose Estimation Figure 1
arXiv preprint2024-07-19

ESCAPE: Energy-based Selective Adaptive Correction for Out-of-distribution 3D Human Pose Estimation

Luke Bidulka, Mohsen Gholami, Jiannan Zheng, Martin J. McKeown, Z. Jane Wang

6D位姿估计人体姿态

针对3D人体姿态估计在分布外样本上泛化差、传统测试时自适应依赖标注且推理开销很大的问题,ESCAPE用自由能筛选OOD样本:常规样本仅经轻量CNet前向修正远端关节,困难样本再通过RCNet构造近端—远端自一致损失适配。该方法不改动骨干模型,在五种HPE模型上将远端MPJPE最高降低7%,并在两个基准上达到SOTA且显著快于现有TTA。

RT-Pose: A 4D Radar Tensor-based 3D Human Pose Estimation and Localization Benchmark Figure 1
arXiv preprint2024-07-18

RT-Pose: A 4D Radar Tensor-based 3D Human Pose Estimation and Localization Benchmark

Yuan-Hao Ho 0000-0003-1089-5509, Jen-Hao Cheng 0000-0002-6970-3738, Sheng Yao Kuan 0009-0001-5054-3033, Zhongyu Jiang 0000-0003-4462-6497, Wenhao Chai 0000-0003-2611-0008 Hsiang-Wei Huang 0009-0009-2474-8869, Chih-Lung Lin, Jenq-Neng Hwang 0000-0002-8877-2421 * Indicates equal contribution

6D位姿估计人体姿态数据集/基准

针对RGB人体定位与姿态估计在隐私、光照和遮挡下受限的问题,RT-Pose将原始4D雷达张量而非CFAR点云作为核心输入,发布含LiDAR/RGB标注辅助的72k帧、240序列基准,并给出单阶段HRRadarPose。其在基准上优于既有雷达HPE方法,MPJPE为9.91cm,但复杂真实场景精度仍有明显提升空间。

GlobalPointer: Large-Scale Plane Adjustment with Bi-Convex Relaxation Figure 1
arXiv preprint2024-07-19

GlobalPointer: Large-Scale Plane Adjustment with Bi-Convex Relaxation

Bangyan Liao 0009-0007-7739-4879, Zhenjun Zhao 0009-0000-6551-4537, Lu Chen 0009-0003-5779-4673, Haoang Li 0000-0002-1576-9408, Daniel Cremers 0000-0002-3079-7984, Peidong Liu 0000-0002-9767-6220

6D位姿估计

针对多帧点云平面调整中位姿与平面强耦合、传统非线性或谱方法依赖初始化且难扩展的问题,论文提出双凸松弛策略,将原问题拆成位姿/平面子问题并交替用凸松弛求解,形成基于点到平面误差的 GlobalPointer 和基于平面到平面误差的 GlobalPointer++。合成与真实实验显示其收敛域更大、对差初始化更稳,GlobalPointer 近线性扩展,精度接近既有方法但全局最优性主要为经验结论。

SCAPE: A Simple and Strong Category-Agnostic Pose Estimator Figure 1
arXiv preprint2024-07-18

SCAPE: A Simple and Strong Category-Agnostic Pose Estimator

Yujia Liang 0009-0009-1432-3461, Zixuan Ye 0000-0001-8517-682X, Wenze Liu 0000-0002-1510-6196, Hao Lu 0000-0003-3854-8664

6D位姿估计类别级位姿

SCAPE针对类别无关少样本位姿估计中过度依赖显式相似度头、热图监督和两阶段细化的问题,指出CAPE本质可由Transformer注意力完成特征匹配。方法以纯自注意力层加MLP直接回归坐标为基线,并用GKP向支持关键点注入全局语义、用KAR建模关键点相关性以处理对称和遮挡。MP-100上1-shot/5-shot分别提升2.2/1.3 PCK,推理更快且非骨干参数约为CapeFormer的51%。

SG-NeRF: Neural Surface Reconstruction with Scene Graph Optimization Figure 1
arXiv preprint2024-07-17

SG-NeRF: Neural Surface Reconstruction with Scene Graph Optimization

Yiyang Chen, Siyan Dong, Xulong Wang, Lulu Cai Youyi Zheng, Yanchao Yang

6D位姿估计三维重建

SG-NeRF关注真实多视图重建中SfM给出的相机位姿含明显离群点时,NeRF表面重建容易失效的问题。其核心是把SfM场景图纳入辐射场联合优化,用自适应内点/外点置信度削弱异常图像影响,并通过跨视图IoU损失和由粗到细训练改进位姿与几何。作者还构建含典型错误位姿的新数据集;在该数据集及DTU等实验中,方法相对已有联合位姿优化方案表现出更强鲁棒性和更高重建质量。

Invertible Neural Warp for NeRF Figure 1
arXiv preprint2024-07-17

Invertible Neural Warp for NeRF

Shin-Fang Chng, Ravi Garg, Hemanth Saratchandran, Simon Lucey

6D位姿估计三维重建

本文针对 NeRF 在相机位姿未知时联合优化易陷入差收敛域的问题,尝试用 MLP 将位姿过参数化为射线的刚性 warp,而非传统 6D SE(3) 表示。核心洞察是这类 warp 必须满足可逆性,因此引入可逆神经网络并结合几何约束。合成与真实数据上,该方法相较 BARF、L2G 等提升位姿估计并带来更高保真重建,文中称相对标准 SE(3) 位姿精度提升超过 50%。

NeuSurfEmb: A Complete Pipeline for Dense Correspondence-based 6D Object Pose Estimation without CAD Models Figure 1
arXiv preprint2024-07-16

NeuSurfEmb: A Complete Pipeline for Dense Correspondence-based 6D Object Pose Estimation without CAD Models

Francesco Milano, Jen Jen Chung, Hermann Blum, Roland Siegwart, Lionel Ott

ETH Zurich, Switzerland, The University of Queensland, Australia

6D位姿估计物体位姿

针对现有6D位姿方法依赖高质量CAD模型和手工PBR合成数据、难以快速用于真实物体的问题,NeuSurfEmb用少量真实RGB图像经SfM、通用分割与跟踪半自动训练NeuS2物体表示,并利用其新视角渲染加剪贴增强生成训练数据,替代CAD与PBR来训练SurfEmb密集对应估计器。在LINEMOD-Occlusion和自采物体上,其性能接近CAD/PBR方法,并优于已有无CAD方法,且对轻度遮挡更稳健。

GV-Bench: Benchmarking Local Feature Matching for Geometric Verification of Long-term Loop Closure Detection Figure 1
arXiv preprint2024-07-17

GV-Bench: Benchmarking Local Feature Matching for Geometric Verification of Long-term Loop Closure Detection

Jingwen Yu, Hanjing Ye, Jianhao Jiao, Ping Tan, Hong Zhang

The Hong Kong University of Science and Technology, Hong Kong SAR, China, Shenzhen Key Laboratory of Robotics and Computer Vision, Southern University of, Science and Technology, Shenzhen, China

6D位姿估计数据集/基准

针对长期SLAM中候选回环仅靠外观检索易受季节、光照和天气变化影响、误回环代价高的问题,GV-Bench将局部特征匹配置于几何验证场景下统一评测,而非沿用位姿/单应估计基准。其开源模块化流程基于三类数据集生成候选对,并比较SIFT、SuperPoint/SuperGlue、LightGlue、LoFTR等六类方法;实验主要给出方法选择参考,指出现有匹配器在条件变化下仍受限,后续增益可能来自使用此类变化数据训练特征与匹配器。

TCFormer: Visual Recognition via Token Clustering Transformer Figure 1
arXiv preprint2024-07-16

TCFormer: Visual Recognition via Token Clustering Transformer

Wang Zeng, Sheng Jin, Lumin Xu, Wentao Liu, Chen Qian, Wanli Ouyang, Ping Luo, Xiaogang Wang

Manuscript received XX XX, XXXX; revised XX XX, XXXX

6D位姿估计

本文针对ViT固定网格token忽略图像语义、难以把计算集中到关键细节的问题,提出TCFormer:通过特征聚类生成动态token,并用局部CTM降低早期聚类开销,配合MTA/CR-MTA在token形式下做多尺度聚合并保持对象对齐。实验覆盖分类、人体姿态、语义分割和检测,TCFormerV2在多任务上优于同类网格Transformer且复杂度更低,但文中未直接验证6D位姿估计。

A BlueROV2-based platform for underwater mapping experiments Figure 1
arXiv preprint2024-07-15

A BlueROV2-based platform for underwater mapping experiments

Tudor Alinei-Poiană, David Rețe, Davian Martinovici, Vicu-Mihalis Maer, Lucian Buşoniu

Technical University of Cluj-Napoca, Romania (e-mail

6D位姿估计

针对水下机器人外场测试成本高、定位困难且投放目标物有风险的问题,本文搭建了基于 BlueROV2、顶视 GoPro 和 ROS 的低成本水池实验平台;其重点不在新算法,而在将顶视分割、IMU/磁力计/压力传感器通过 EKF 融合为 ROV 位姿,并结合 YOLO 检测实现垃圾目标映射。实验分别验证了位姿估计、检测和建图流程,且公开了垃圾检测数据集与代码。

LVCP: LiDAR-Vision Tightly Coupled Collaborative Real-time Relative Positioning Figure 1
arXiv preprint2024-07-15

LVCP: LiDAR-Vision Tightly Coupled Collaborative Real-time Relative Positioning

Zhuozhu Jian, Qixuan Li, Shengtao Zheng, Xueqian Wang, Xinlei Chen

6D位姿估计点云

面向无 GPS、无先验地图的空地协同,相机无人机与 LiDAR 地面车的相对定位易受单目 VIO 漂移和初值不准影响。LVCP 用 LiDAR 几何约束紧耦合视觉特征点云,设计 PSO 粗匹配、点到平面关联与 point-aided BA,并用 SFM+多级采样完成初始化。开源和自建数据实验表明其可实时运行、对初值误差和复杂环境更稳健,并可扩展到多无人机定位。

Domain Generalization for 6D Pose Estimation Through NeRF-based Image Synthesis Figure 1
arXiv preprint2024-07-15

Domain Generalization for 6D Pose Estimation Through NeRF-based Image Synthesis

Antoine Legrand Dept. of Electrical Engineering, ICTEAM, UCLouvain Dept. of Electrical Engineering, ESAT, KU Leuven Dept. of Mechanical Engineering, MECH, UCLouvain

Aerospacelab

6D位姿估计三维重建

针对6D位姿估计中合成训练图像与真实场景在光照、纹理和视角上的域偏移,本文用合成数据训练 in-the-wild NeRF,再通过新视角、外推外观光照和随机纹理生成增强集,与原合成集联合训练位姿网络。航天器位姿实验表明,该数据层面的域泛化策略在 SPEED+ 两个目标域上将位姿误差降低约50%,消融也支持外观与纹理增强的贡献。

GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation Figure 1
arXiv preprint2024-07-16

GTPT: Group-based Token Pruning Transformer for Efficient Human Pose Estimation

Haonan Wang 0000-0002-7159-2432, Jie Liu 0000-0002-9297-7729, Jie Tang 0000-0002-6086-3559, Gangshan Wu 0000-0003-1391-1762, Bo Xu 0009-0006-2136-3814, Yanbing Chou 0009-0006-1137-4771, Yong Wang 0009-0001-2844-6296

6D位姿估计人体姿态

面向工业部署中人体/全身姿态估计关键点多、计算开销高的问题,GTPT用Transformer显式建模关键点关系,同时以粗到细逐步引入人体、部位和密集关键点,并按头/上身/下身分组剪枝视觉token;MHGA在低开销下补充分组间全局交互。COCO与COCO-WholeBody实验显示,其在更少计算量下取得更高精度,优势在全身关键点场景更明显。

Learning to Estimate the Pose of a Peer Robot in a Camera Image by Predicting the States of its LEDs Figure 1
arXiv preprint2024-07-15

Learning to Estimate the Pose of a Peer Robot in a Camera Image by Predicting the States of its LEDs

Nicholas Carlotti, Mirko Nava, Alessandro Giusti

the Dalle Molle Institute for Artificial Intelligence (IDSIA), USI-SUPSI, Lugano, 6962, Switzerland

6D位姿估计机器人操作

本文针对多机器人中相对6D位姿标注昂贵的问题,利用机器人机身多个可独立控制LED的开关状态作为自监督前置任务:FCN通过预测各LED状态,被迫学习同伴机器人在图像中的位置与朝向。真实双轮式机器人实验表明,即使多数训练图像不含目标,该预训练也能无位姿标签学到图像定位,并在少量标注微调时显著优于无预训练和CLIP特征基线,且可泛化到未见环境。

Deep-Learning-Based Markerless Pose Estimation Systems in Gait Analysis: DeepLabCut Custom Training and the Refinement Function Figure 1
arXiv preprint2024-07-15

Deep-Learning-Based Markerless Pose Estimation Systems in Gait Analysis: DeepLabCut Custom Training and the Refinement Function

PAGE 1, Giulia Panconi1, Stefano Grasso2, Sara Guarducci3, Lorenzo Mucchi3, Diego Minciacchi1

Department of Experimental and Clinical Medicine, University of Florence, Italy, Department of Physiology and Pharmacology, SAPIENZA University of Rome, Italy, Department of Information Engineering, University of Florence, Italy, Keyword: Deep Learning, DeepLabCut, Gait Analysis, OpenPose, Pose Estimation, Video

6D位姿估计人体姿态

针对有标记动捕成本高、受实验室环境限制的问题,本文在40名健康受试者步态实验中,用单RGB相机比较OpenPose预训练、DeepLabCut预训练与自定义训练模型,并以力平台时序步态参数为参考。核心洞察是DLC的迁移学习、自定义标注训练及refinement外点修正对步态关键点更关键;结果显示DLC自训练模型优于两种预训练方案,加入refinement后最适合作为低成本无标记步态评估方案。

3D Foundation Models Enable Simultaneous Geometry and Pose Estimation of Grasped Objects Figure 1
arXiv preprint2024-07-14

3D Foundation Models Enable Simultaneous Geometry and Pose Estimation of Grasped Objects

Weiming Zhi, Haozhan Tang, Tianyi Zhang, Matthew Johnson-Roberson

The Robotics Institute, Carnegie Mellon University

6D位姿估计

面向机器人把手中物体当工具使用时缺少物体几何与机器人坐标系下位姿的问题,论文提出 GPE:用 DUSt3R 等 3D 基础模型从少量外部 RGB 图像重建手中物体,再通过坐标对齐恢复真实尺度并映射到机器人坐标系,无需相机外参标定。实验在多种日常物体和有限数据下验证了鲁棒性,并展示可按物体上指定点来塑造机器人运动。

psifx -- Psychological and Social Interactions Feature Extraction Package Figure 1
arXiv preprint2024-07-14

psifx -- Psychological and Social Interactions Feature Extraction Package

Guillaume Rochette, Mathieu Rochat, Nizar Michaud, Matthew J. Vowels

Institute of Neuroinformatics, ETH Zurich, Switzerland

6D位姿估计

psifx针对心理与社会互动研究中人工标注成本高、标准不一且难扩展的问题,将视频姿态/表情/凝视、多目标跟踪、音频说话人分离与转写、文本LLM特征抽取整合为可本地运行的模块化工具包,并提供CLI、pip与Docker以降低部署门槛。论文主要贡献是工程化标准流程而非新的6D位姿算法;定量实验与性能增益文中未充分说明。

PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimation Figure 1
arXiv preprint2024-07-14

PAFUSE: Part-based Diffusion for 3D Whole-Body Pose Estimation

Nermin Samet 0000-0001-9247-2504, Cédric Rommel 0000-0002-9416-0288, David Picard 0000-0002-6296-4222, Eduardo Valle 0000-0001-5396-9868

6D位姿估计人体姿态

PAFUSE针对3D全身姿态中躯干、手、脸尺度和形变差异大、视频采样不均且细粒度关键点难以共享同一表示的问题,将全身拆成身体、双手和脸等局部坐标系,并在层级部件表示上引入去噪扩散进行2D到3D时序提升。该设计让各部件在相近尺度内建模运动与多解性,可模块化接入现有方法;在扩展后的H3WB时空基准上达到41.4mm MPJPE,明显优于此前88.3mm SOTA,并优于多种时空基线。

3DEgo: 3D Editing on the Go! Figure 1
arXiv preprint2024-07-14

3DEgo: 3D Editing on the Go!

Umar Khalid 0000-0002-3357-9720, Hasan Iqbal 0009-0005-2162-3367, Azib Farooq 0009-0006-7867-2546, Jing Hua 0000-0002-3981-2933, Chen Chen 0000-0003-3957-7061

6D位姿估计

3DEgo瞄准文本驱动3D场景编辑中依赖COLMAP位姿估计、需先训练未编辑模型且多视角编辑不一致的问题。其核心是先用IP2P逐帧编辑视频,并通过自回归噪声融合让相邻已编辑视角约束当前视角,再用3D Gaussian Splatting在无SfM预处理下连续估计位姿并生长场景。六个数据集实验显示其在编辑一致性、精度和速度上优于传统三阶段流程,尤其适合随手拍和360度视频。

iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning Figure 1
arXiv preprint2024-07-12

iNeMo: Incremental Neural Mesh Models for Robust Class-Incremental Learning

Tom Fischer 0009-0009-6776-2767, Yaoyao Liu 0000-0002-5316-3028, Artur Jesslen, Noor Ahmed 0009-0002-0084-0141, Prakhar Kaushik 0000-0001-6449-8088, Angtian Wang 0009-0006-9189-5277, Alan Yuille, Adam Kortylewski, Eddy Ilg

6D位姿估计

这篇工作针对类增量学习在分布外场景和6D/3D姿态估计中易遗忘、鲁棒性不足的问题,将NeMo式3D神经网格扩展为可随新类别增长的iNeMo。核心做法是在蒸馏与回放外维护不断扩展的网格记忆,并用潜空间预分配和位置正则稳定各类别特征区域。Pascal3D与ObjectNet3D实验显示,分类较基线在域内提升2–6%,OOD提升6–50%,并给出首个增量姿态估计方案。

HUP-3D: A 3D multi-view synthetic dataset for assisted-egocentric hand-ultrasound pose estimation Figure 1
arXiv preprint2024-07-12

HUP-3D: A 3D multi-view synthetic dataset for assisted-egocentric hand-ultrasound pose estimation

Manuel Birlo, Razvan Caramalau, Philip J. “Eddie” Edwards, Brian Dromey, Matthew J. Clarkson, Danail Stoyanov

6D位姿估计手部姿态仿真到现实数据集/基准多视角

面向产科超声培训中的第一视角、无标记手—探头联合位姿估计,HUP-3D用合成数据缓解真实标注困难和遮挡问题。其核心是基于生成模型的临床探头抓握生成、球面多视角相机采样,以及带RGB-D与分割标注的自动渲染管线,构建3.1万余帧多模态数据。作者用HOPE-net等模型验证,报告在合成手—物体关键点误差上取得最低结果,但真实域泛化仍主要依赖后续验证。

KGpose: Keypoint-Graph Driven End-to-End Multi-Object 6D Pose Estimation via Point-Wise Pose Voting Figure 1
arXiv preprint2024-07-12

KGpose: Keypoint-Graph Driven End-to-End Multi-Object 6D Pose Estimation via Point-Wise Pose Voting

Andrew Jeong, Seokhwan Jeong

6D位姿估计物体位姿

面向机器人抓取中多物体场景需同时恢复各物体6D位姿的问题,KGpose将RGB-D特征融合、3D关键点估计与可学习位姿回归做成端到端流程,把逐点预测的关键点构成keypoint-graph,并用图卷积进行逐点位姿投票,省去额外目标定位步骤。论文在YCB-Video上取得有竞争力结果,但相对各模块的具体增益来源仍不够清晰。

RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation Figure 1
arXiv preprint2024-07-11

RTMW: Real-Time Multi-Person 2D and 3D Whole-body Pose Estimation

Tao Jiang, Xinchen Xie, Yining Li

Shanghai AI Laboratory

6D位姿估计人体姿态

面向全身多人姿态在交互、虚拟人和 AIGC 中对高精度低延迟部署的需求,RTMW在RTMPose上加入FPN/PAFPN与HEM以增强手、脸、脚等小尺度部位特征,并对14个开源关键点数据集做定义对齐,结合两阶段蒸馏训练;还将SimCC式坐标分类扩展到单目3D全身姿态。RTMW-l在COCO-Wholebody达到70.2 mAP,成为首个开源超过70 mAP的模型,同时保持实时和部署友好。

SRPose: Two-view Relative Pose Estimation with Sparse Keypoints Figure 1
arXiv preprint2024-07-11

SRPose: Two-view Relative Pose Estimation with Sparse Keypoints

Rui Yin, Yulun Zhang, Zherong Pan, Jianjun Zhu, Cheng Wang, Biao Jia

6D位姿估计相机位姿

SRPose针对传统两视图位姿估计依赖RANSAC等鲁棒估计器、速度慢,而深度回归器又难适配不同分辨率和相机内参的问题,改用稀疏关键点作为输入,通过内参校准位置编码和可提示的先验引导注意力隐式建立对应关系,同时覆盖相机相对位姿与物体6D跟踪。实验显示其在精度和速度上达到或超过多种SOTA,并可在低算力下部署。

SGLC: Semantic Graph-Guided Coarse-Fine-Refine Full Loop Closing for LiDAR SLAM Figure 1
arXiv preprint2024-07-11

SGLC: Semantic Graph-Guided Coarse-Fine-Refine Full Loop Closing for LiDAR SLAM

Neng Wang, Xieyuanli Chen, Chenghao Shi, Zhiqiang Zheng, Hongshan Yu, Huimin Lu

6D位姿估计相机位姿点云

针对现有 LiDAR 闭环多重检测、轻位姿估计且 6DoF 校正精度或实时性不足的问题,SGLC 将前景实例构成语义图用于描述子、候选验证和粗位姿估计,并结合背景几何与平面约束进行 coarse-fine-refine 配准。多数据集实验显示其闭环检测和位姿估计优于对比方法,集成进 SLAM 后可降低累积漂移。

RoCap: A Robotic Data Collection Pipeline for the Pose Estimation of Appearance-Changing Objects Figure 1
arXiv preprint2024-07-10

RoCap: A Robotic Data Collection Pipeline for the Pose Estimation of Appearance-Changing Objects

Jiahao Nick Li, Toby Chong, Zhongyi Zhou, Hironori Yoshida, Koji Yatani, Xiang 'Anthony' Chen, Takeo Igarashi

UCLA HCI Research, TOEI Zukun Research, University of Tokyo, Future University Hakodate

6D位姿估计机器人操作

RoCap针对传统基于3D重建/合成数据的6D位姿方法难以处理毛绒、透明、反光、关节等操作中外观变化物体的问题,提出用6DoF机械臂模拟人手抓持并自动采集多姿态图像,通过正运动学生成真值标签。论文强调贡献主要在数据采集管线而非新模型;在8类挑战物体上的定量与定性比较显示,基于RoCap真实数据训练的简单模型优于Gen6D式重建合成方案,增益可能主要来自更贴近真实操作的数据。

Hybrid Structure-from-Motion and Camera Relocalization for Enhanced Egocentric Localization Figure 1
arXiv preprint2024-07-10

Hybrid Structure-from-Motion and Camera Relocalization for Enhanced Egocentric Localization

Technology (KAUST) Visual Geometry Group

King Abdullah University of Science and Technology (KAUST) Visual Geometry Group, University of Oxford

6D位姿估计相机位姿

该文面向 Ego4D VQ3D 中相机位姿缺失会限制自我中心目标三维定位的问题,在 EgoLoc 的 SfM 流程外,引入基于已有 Matterport 3D 扫描与视频帧的 2D-3D 匹配和 PnP 重定位,将两类位姿取并集以提高可用帧覆盖率。方法在公开榜单整体成功率上超过 EgoLoc 约 1.5%,但增益较小,且依赖预先可用的扫描与关键点,实际泛化受限。

Greit-HRNet: Grouped Lightweight High-Resolution Network for Human Pose Estimation Figure 1
arXiv preprint2024-07-10

Greit-HRNet: Grouped Lightweight High-Resolution Network for Human Pose Estimation

Junjia Han 0009-0002-5102-1824, Yanxia Wang

6D位姿估计人体姿态

针对 HRNet/Lite-HRNet 在人体关键点估计中计算开销高、跨阶段权重形状不稳定且全局空间信息不足的问题,Greit-HRNet 在轻量高分辨率框架中引入 GCW 分组通道加权与 GSW 全局空间加权,并结合大核注意力提升特征交互效率。文中在 MS-COCO 与 MPII 上报告其优于多种轻量级姿态网络,但具体增益来源与各模块贡献需结合消融进一步判断。

Category-level Object Detection, Pose Estimation and Reconstruction from Stereo Images Figure 1
arXiv preprint2024-07-09

Category-level Object Detection, Pose Estimation and Reconstruction from Stereo Images

PAGE 1, Chuanrui Zhang1, Yonggen Ling2∗, Minglei Lu2, Minghan Qin1

Tsinghua University, Beijing, China, Tencent Robotics X, Shenzhen, China

6D位姿估计类别级位姿多视角三维重建

面向机器人操作中透明、反光等日常物体深度缺失导致的尺度歧义,CODERS改用双目图像并提出隐式立体匹配模块,将三维位置信息编码进图像特征,再通过Transformer解码器端到端同时完成类别级检测、6D位姿、尺寸与形状重建。相比两阶段双目或RGB-D方案,它减少级联误差并保留全图上下文;在TOD数据集显著优于竞争方法,且仅用仿真训练也能迁移到真实未见物体操作场景。

Computer vision tasks for intelligent aerospace missions: An overview Figure 1
arXiv preprint2024-07-09

Computer vision tasks for intelligent aerospace missions: An overview

Huilin Chen, Qiyu Sun, Fangfei Li, Yang Tang

Shanghai 200237, China, School of Mathematics, East China University of Science and Technology

6D位姿估计

面向在轨服务、碎片清除和装配等任务中传统滤波、SfM/MVS难以适应强光照变化、辐射和数据稀缺的问题,本文综述空间基视觉感知的6D位姿估计、三维重建与识别,核心洞察是深度学习正成为提升鲁棒性与自主性的关键路径。主要结果是梳理相关任务、传感器、数据集和框架,并指出当前瓶颈仍在有限标注数据、算法可靠性与多源信息融合,文中未给出新的实验增益。

GeoNLF: Geometry guided Pose-Free Neural LiDAR Fields Figure 1
arXiv preprint2024-07-08

GeoNLF: Geometry guided Pose-Free Neural LiDAR Fields

Weiyi Xue, Zehan Zheng, Fan Lu, Haiyun Wei, Guang Chen

Tongji University

6D位姿估计点云

GeoNLF针对现有LiDAR-NeRF依赖精确预计算位姿、低频稀疏点云中纯配准又易陷入局部最优的问题,将全局神经重建与基于点云几何图的位姿优化交替耦合,并用选择性重加权抑制异常位姿帧过拟合、引入Chamfer等三维几何约束。实验显示其在NuScenes和KITTI-360的大规模低频序列上同时提升新视角LiDAR合成与多视图配准精度。

On the power of data augmentation for head pose estimation Figure 1
arXiv preprint2024-07-10

On the power of data augmentation for head pose estimation

Michael Welter

Independent Researcher

6D位姿估计

本文针对野外单目头部6D位姿估计长期依赖300W-LP训练集、模型改进空间受限的问题,系统考察数据扩展、合成与增强的作用,并结合轻量ResNet/MobileNet、多任务预测头及切空间旋转不确定性损失。结果显示,性能提升很大程度可能主要来自更大更多样的数据与增强,模型在精度上超过或接近SOTA,且适合实时应用。

SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning Figure 1
arXiv preprint2024-07-07

SCIPaD: Incorporating Spatial Clues into Unsupervised Pose-Depth Joint Learning

Yi Feng * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Zizhan Guo * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Qijun Chen * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Rui Fan * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT

6D位姿估计彩色深度

针对自监督单目深度学习中浅层 PoseNet 位姿不准、进而污染光度重建监督的问题,SCIPaD 将位姿估计显式引入空间线索:用置信感知特征流提取2D对应关系,结合 DepthNet 生成的伪3D布局并分层注入语义特征。实验显示其在KITTI Odometry上相机位姿平均平移误差降低22.2%、角度误差降低34.8%,同时改善深度-位姿联合学习。

Unsupervised Learning of Category-Level 3D Pose from Object-Centric Videos Figure 1
arXiv preprint2024-07-05

Unsupervised Learning of Category-Level 3D Pose from Object-Centric Videos

Leonhard Sommer, Artur Jesslen, Eddy Ilg, Adam Kortylewski

University of Freiburg Saarland University Max Planck Institute for Informatics

6D位姿估计类别级位姿

本文针对类别级3D/6D位姿估计对标注、CAD或RGB-D依赖强的问题,尝试仅从随手拍的物体中心视频中无监督学习。核心是先用粗网格与DINOv2特征,通过结合几何和外观的3D循环距离跨视频对齐到规范坐标系,再学习图像像素到类别模板网格顶点的稠密对应并拟合位姿。在CO3D无监督对齐上显著优于基线,并能迁移到Pascal3D+、ObjectNet3D的野外单图位姿估计,但仍未达到全监督方法。

Towards Cross-View-Consistent Self-Supervised Surround Depth Estimation Figure 1
arXiv preprint2024-07-04

Towards Cross-View-Consistent Self-Supervised Surround Depth Estimation

PAGE 1, Laiyan Ding1, Hualie Jiang2, Jie Li3, Yongquan Chen4, Rui Huang1∗

6D位姿估计彩色深度

针对自动驾驶环视自监督深度估计中多相机重叠区域深度不一致、且逐视角位姿估计耗显存并可能不稳定的问题,本文只用前视图估计位姿并由外参传播到其他相机,同时加入稠密深度一致性损失、多视图重建一致性损失和适配环视几何的翻转增强。简单模型即在 DDAD 与 nuScenes 上超过 SurroundDepth,重叠区域 Abs Rel 改善更明显,说明收益主要来自显式跨视角约束。

Markerless Multi-view 3D Human Pose Estimation: a survey Figure 1
arXiv preprint2024-07-04

Markerless Multi-view 3D Human Pose Estimation: a survey

Tecnologia e Ciência (INESC TEC, Rua Dr. Roberto Frias, Porto, Rua do Campo Alegre, Portugal

6D位姿估计人体姿态多视角综述

面向人机交互、运动分析等场景中无标记三维人体姿态对遮挡、视角变化和标注稀缺的需求,本文系统梳理2012年以来多视角方法。核心洞察是主流全监督几何约束方案仍受2D匹配误差限制,时序、深度与低监督可缓解,直接3D特征更稳但计算更重。综述73篇工作后指出当前尚无方法兼顾精度、泛化与实时成本,未来应关注主动学习、视角选择和多模态融合。

Graph and Skipped Transformer: Exploiting Spatial and Temporal Modeling Capacities for Efficient 3D Human Pose Estimation Figure 1
arXiv preprint2024-07-03

Graph and Skipped Transformer: Exploiting Spatial and Temporal Modeling Capacities for Efficient 3D Human Pose Estimation

Mengmeng Cui 0000-0003-4281-3125, Kunbo Zhang 0000-0002-4826-6831, Zhenan Sun

6D位姿估计人体姿态

该文针对单目2D到3D人体姿态提升中,逐关节图连接和逐帧Transformer注意力带来的冗余与高计算开销,提出G-SFormer:用粗粒度身体部件构建全数据驱动的自适应空间图,并以跳跃自注意力建模长时序依赖和层级聚合,辅以Data Rolling引入动态信息。在Human3.6M、MPI-INF-3DHP和HumanEva上取得优于既有方法的精度,同时参数约为主流方法一成、复杂度显著降低,并对2D检测误差更稳健。

Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstruction Figure 1
arXiv preprint2024-07-03

Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstruction

Jiaxin Guo, Jiangliu Wang, Di Kang, Wenzhen Dong, Wenting Wang, Yun-hui Liu

6D位姿估计三维重建高斯泼溅医学/手术

面向内窥镜手术场景中纹理少、反光和光照变化导致 SfM 初始化失效的问题,Free-SurGS 放弃 SfM,联合优化相机位姿与 3D Gaussian 表示;其关键是用相邻帧光流约束由高斯投影得到的运动,并通过极几何一致性过滤不可靠流。在 SCARED 上,该方法在新视角合成和位姿估计上优于已有方法,并保持较高重建与实时渲染效率。

SUPER: Seated Upper Body Pose Estimation using mmWave Radars Figure 1
arXiv preprint2024-07-02

SUPER: Seated Upper Body Pose Estimation using mmWave Radars

Bo Zhang, Zimeng Zhou, Boyu Jiang, Rong Zheng

Department of Computing and Software, McMaster University

6D位姿估计人体姿态

论文关注久坐场景中的上半身姿态估计,动机是该任务对车内安全和人机交互更直接,但毫米波雷达在躯干低运动、手部小 RCS 下信息稀疏。SUPER 用近距离正交双雷达和掩码融合生成互补的强度/多普勒点云,再由轻量网络回归 SMPL 姿态。10 名受试者留一实验中,相比基线提升 30–184%,平均 MPJPE 为 112mm,并展示了手-物交互应用。

ReliaAvatar: A Robust Real-Time Avatar Animator with Integrated Motion Prediction Figure 1
arXiv preprint2024-07-02

ReliaAvatar: A Robust Real-Time Avatar Animator with Integrated Motion Prediction

Bo Qian, Zhenhuan Wei, Jiashuo Li, Xing Wei School of Software Engineering, weixing@mail.xjtu.edu.cn

School of Software Engineering, Xi’an Jiaotong University

6D位姿估计

面向VR/AR中仅用少量可穿戴信号驱动全身Avatar时常见的丢包、遮挡和控制器长时不可见问题,ReliaAvatar将稀疏位姿回归与运动预测结合,采用GRU双路径特征提取、Transformer建模22个SMPL关节关系,并用自回归训练模拟标准、瞬时和长时数据缺失场景。AMASS等实验显示其在正常与低质量信号下均优于对比方法,在线推理达到109 fps。

Joint-Dataset Learning and Cross-Consistent Regularization for Text-to-Motion Retrieval Figure 1
arXiv preprint2024-07-02

Joint-Dataset Learning and Cross-Consistent Regularization for Text-to-Motion Retrieval

Nicola Messina, Jan Sedmidubsky, Fabrizio Falchi, Tomáš Rebok

Masaryk University

6D位姿估计数据集/基准

论文针对3D骨架动作数据难以用自然语言检索、且文本-动作配对数据不足的问题,研究跨数据集与联合数据集训练。核心做法是在双塔文本/运动嵌入框架中加入MoT++时空Transformer运动编码器,并用CCCL在跨模态对比学习外约束同模态一致性。作者在KIT Motion-Language和HumanML3D上做单数据集、跨数据集与联合训练实验,显示联合数据与CCCL可提升泛化和检索表现,同时暴露现有方法跨数据集能力有限。

Active Human Pose Estimation via an Autonomous UAV Agent Figure 1
arXiv preprint2024-07-01

Active Human Pose Estimation via an Autonomous UAV Agent

Jingxi Chen, Botao He, Chahat Deep Singh, Cornelia Fermüller, Yiannis Aloimonos Perception, Robotics Group

Perception and Robotics Group, University of Maryland - College Park

6D位姿估计人体姿态航天器

针对无人机拍摄人体时自遮挡会降低2D姿态估计精度的问题,论文把“去哪儿看”形式化为主动视角选择与安全规划联合任务;核心是用HumanNeRF生成半球无人机视角数据,训练轻量PoseErrNet预测各视角姿态误差形成3D感知引导场,再与避障、动力学约束结合规划轨迹。实验在仿真和少量真实视频扰动测试中显示视角误差预测较稳健,复杂障碍环境下可切换次优视角并保持跟踪,但量化增益幅度文中未充分说明。

RoDyn-SLAM: Robust Dynamic Dense RGB-D SLAM with Neural Radiance Fields Figure 1
arXiv preprint2024-07-01

RoDyn-SLAM: Robust Dynamic Dense RGB-D SLAM with Neural Radiance Fields

Haochen Jiang, Yueming Xu, Kejie Li, Jianfeng Feng, Li Zhang

6D位姿估计相机位姿点云彩色深度

RoDyn-SLAM针对NeRF式RGB-D SLAM在动态物体下几何与光度观测不一致、易跟踪失败的问题,融合光流与语义生成运动掩码以剔除动态射线,并用区分关键帧/非关键帧的位姿优化与边缘warp损失加强相邻帧几何约束。在两个动态数据集上,其位姿精度与鲁棒性优于近期神经RGB-D SLAM方法。

Collaborative Graph Exploration with Reduced Pose-SLAM Uncertainty via Submodular Optimization Figure 1
arXiv preprint2024-07-01

Collaborative Graph Exploration with Reduced Pose-SLAM Uncertainty via Submodular Optimization

Ruofei Bai, Shenghai Yuan, Hongliang Guo, Pengyu Yin, Wei-Yun Yau, Lihua Xie, Fellow, IEEE

School of, Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Institute for, Infocomm Research (I2R), Agency for Science, Technology and Research

6D位姿估计相机位姿

本文面向无 GPS 环境下多机器人图探索中“快速覆盖”与“可靠协同 SLAM 位姿估计”难以同时规划的问题。核心做法是先生成覆盖路径,再把回环动作建模为带距离代价的非单调子模最大化,用位姿图拓扑指标近似 SLAM 不确定性以避免昂贵协方差推断,并引入有近似保证的选择算法和排序启发。随机图仿真表明该策略能较快完成覆盖并提升位姿图可靠性,但验证主要限于仿真环境。

When Robots Get Chatty: Grounding Multimodal Human-Robot Conversation and Collaboration Figure 1
arXiv preprint2024-06-29

When Robots Get Chatty: Grounding Multimodal Human-Robot Conversation and Collaboration

Philipp Allgeuer, Hassan Ali, Stefan Wermter

6D位姿估计机器人操作

本文关注机器人在开放式人机协作中如何把语言能力落到真实感知与动作上,而不只是用 LLM 做离线规划。核心做法是在 NICOL 机器人上以 LLM 作为文本协调中枢,模块化接入语音、开放词汇检测、人体姿态/手势识别、凝视、表情和抓取等能力,并允许动作嵌入同一次自然语言回复。实验以定性互动和部分定量评估表明,该系统能较自然地进行对话、社交反馈和协作操作,但具体任务性能增益相对不同模块的来源仍不完全清晰。

Assistive Image Annotation Systems with Deep Learning and Natural Language Capabilities: A Review Figure 1
arXiv preprint2024-06-28

Assistive Image Annotation Systems with Deep Learning and Natural Language Capabilities: A Review

Moseli Mots’oehli

Department of Information and Computer Science, University of Hawai’i at Manoa

6D位姿估计

针对视觉任务尤其位姿估计等场景中高质量标注昂贵且易出错的问题,本文综述带自然语言提示的AI辅助图像标注系统。核心洞察是将主动学习、自监督/少样本学习、多模态模型与神经符号推理结合,可用文本建议、描述或推理帮助标注者而非只给出框/掩码。主要结论是公开系统和论文仍稀缺,现有商业工具多停留在视觉自动标注,缺少可评测的图文交互能力与开放数据集。

EPOCH: Jointly Estimating the 3D Pose of Cameras and Humans Figure 1
arXiv preprint2024-06-28

EPOCH: Jointly Estimating the 3D Pose of Cameras and Humans

Nicola Garau, Giulia Martinelli, Niccolò Bisagno, Denis Tomè, Carsten Stoll

University of Trento

6D位姿估计

针对单目3D人体姿态中2D到3D歧义、弱透视模型带来深度与尺度误差的问题,EPOCH将完整透视相机显式放入循环:RegNet仅用2D姿态弱监督估计2D关节与相机内外参,LiftNet再在相机参与下无监督提升到3D,并用Normalizing Flow约束姿态合理性。实验在Human3.6M和MPI-INF-3DHP上达到或刷新SOTA,显示相机建模有助于未见数据泛化。

CLOi-Mapper: Consistent, Lightweight, Robust, and Incremental Mapper With Embedded Systems for Commercial Robot Services Figure 1
IEEE Robotics and Automation Letters, 20242024-06-28

CLOi-Mapper: Consistent, Lightweight, Robust, and Incremental Mapper With Embedded Systems for Commercial Robot Services

DongKi Noh, Hyungtae Lim, Gyuho Eoh, Duckyu Choi, Jeongsik Choi, Hyunjun Lim, SeungMin Baek, Hyun Myung

6D位姿估计机器人操作

面向商用服务机器人在低算力、低分辨率2D LiDAR和有限内存下仍需稳定SLAM的需求,CLOi-Mapper采用多阶段全局位姿估计、零约束传感器同步图生成,以及带节点整合/剪枝的轻量长期位姿图优化,以减少大幅位姿修正并适配多形态硬件。论文在家庭与大规模室内场景验证了稳定建图与定位,并称已在量产机器人及Airstar等长期运行超过5年的商业系统中使用。

Multimodal Visual-haptic pose estimation in the presence of transient occlusion Figure 1
arXiv preprint2024-06-27

Multimodal Visual-haptic pose estimation in the presence of transient occlusion

Michael Zechmair, Alban Bornet, Yannick Morel

6D位姿估计

面向人机协作中视觉遮挡导致的人体位姿不可靠问题,论文将具备部分遮挡鲁棒性的预测编码视觉分割/姿态推断与可安装在机器人外壳上的电容式近距触觉感知结合,并用改进 Luenberger 观测器融合两路估计。在机器人臂与人体前臂场景中,该多模态方案在不同遮挡水平下优于任一单传感器。

Human Modelling and Pose Estimation Overview Figure 1
arXiv preprint2024-06-27

Human Modelling and Pose Estimation Overview

Pawel Knap1

University of Southampton

6D位姿估计

面向人机交互、机器人协作、AR/VR与医疗康复等场景中对可靠人体姿态理解的需求,本文系统梳理2D/3D、单人/多人姿态估计与人体建模方法,并比较相机、雷达、激光、IR和可穿戴传感方案的取舍。核心洞察是当前SOTA主要仍由基于相机的深度学习、热图/关键点关联和SMPL等模型表示推动,但遮挡、深度歧义、泛化与可解释性仍未解决。主要结果是给出数据集、指标、代表算法及未来方向的综述性对比,文中未提出新的实验增益。

Towards Human-Level 3D Relative Pose Estimation: Generalizable, Training-Free, with Single Reference Figure 1
arXiv preprint2024-06-26

Towards Human-Level 3D Relative Pose Estimation: Generalizable, Training-Free, with Single Reference

Yuan Gao, Yajing Luo, Junhong Wang, Kui Jia, Gui-Song Xia

6D位姿估计相机位姿

针对未见物体在缺少 CAD、多视角和位姿标注时仍需估计相对 6D/3D 位姿的问题,论文将单张 RGB-D 参考构造成带 RGB 与 DINOv2 语义纹理的 2.5D 网格,用可微渲染器执行 render-and-compare,并通过图像/语义差异反传优化相对姿态,无需训练。LineMOD、LM-O、YCB-V 及跨数据集实验显示,其在 Acc@5/10/15° 上显著超过多种监督方法。

Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods Figure 1
arXiv preprint2024-06-27

Automatic infant 2D pose estimation from videos: comparing seven deep neural network methods

Filipe Gama, Matěj Mísař, Lukáš Navara, Sergiu T. Popescu

Czech Technical University in Prague, Faculty of Electrical Engineering, Department of Cybernetics, Prague, Czech Republic

6D位姿估计

本文面向婴儿运动发育研究和早筛中对无标记、家庭视频姿态分析的需求,系统比较七种成人数据训练的2D姿态估计器,并引入按躯干长度归一化的误差、漏检/冗检、置信度可靠性和速度评估。结果显示除DeepLabCut和MediaPipe外,多数方法无需微调已具竞争力,ViTPose精度最佳,而AlphaPose在可用精度下接近实时约27fps。

High-resolution open-vocabulary object 6D pose estimation Figure 1
arXiv preprint2024-06-24

High-resolution open-vocabulary object 6D pose estimation

Jaime Corsetti, Davide Boscaini, Francesco Giuliari, Changjae Oh, Andrea Cavallaro, Fabio Poiesi

6D位姿估计物体位姿未知物体

针对未知物体6D位姿估计依赖CAD模型、多视角重建或对开放词汇提示利用不足的问题,Horyon用文本提示先定位并裁剪目标,再结合VLM跨注意力与高分辨率多尺度特征做跨场景像素匹配和3D配准。它在REAL275、Toyota-Light、Linemod、YCB-Video上均达到SOTA,Average Recall较此前最佳提升12.6,但仍依赖深度图和相机内参。

Investigating the impact of 2D gesture representation on co-speech gesture generation Figure 1
arXiv preprint2024-06-24

Investigating the impact of 2D gesture representation on co-speech gesture generation

Téo Guichoux, Laure Soulier, Nicolas Obin, Catherine Pelachaud

STMS lab IRCAM, STMS lab

6D位姿估计

这篇论文关注野外视频手势数据常先有2D关键点、再经lifting得到伪3D标签的问题,动机是厘清表示维度会怎样影响语音驱动共语手势生成。作者以DDPM为基线,比较直接生成3D与先生成2D再用VideoPose3D升维的流程,核心洞察是2D到3D的确定性升维会引入偏置并可能损害分布匹配、语音一致性和多样性。具体定量结果在给定文本中未充分说明。

Benchmarking Monocular 3D Dog Pose Estimation Using In-The-Wild Motion Capture Data Figure 1
arXiv preprint2024-06-20

Benchmarking Monocular 3D Dog Pose Estimation Using In-The-Wild Motion Capture Data

Moira Shooter m.shooter@surrey.ac.uk, Charles Malleson charles.malleson@surrey.ac.uk, Centre for Vision, Speech, Signal Processing (CVSSP, Guildford UK

Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey

6D位姿估计人体姿态数据集/基准

针对实验室动捕数据带标记、背景单一导致单目3D犬姿态模型难以泛化到自然场景的问题,论文构建了含多模态真值的3DDogs-Lab,并通过去除光学标记、分割抠像与生成多样背景得到3DDogs-Wild,用于系统基准评测。实验表明,用自然化数据训练能提升野外图像上的3D犬姿态估计表现,同时揭示不同模型在跨场景和跨物种泛化上的差异。

PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptions Figure 1
arXiv preprint2024-06-20

PoseBench: Benchmarking the Robustness of Pose Estimation Models under Corruptions

Sihan Ma, Jing Zhang, Qiong Cao, Dacheng Tao

The University of Sydney, Australia JD Explore Academy, China, Nanyang Technological University, Singapore

6D位姿估计数据集/基准

现实部署中的模糊、噪声、压缩、光照和遮挡会显著削弱姿态估计,但现有评测多停留在干净数据。PoseBench将COCO、OCHuman、AP10K扩展为含10类、5级扰动的鲁棒性基准,系统评测60个CNN/ViT及不同预测范式。结果显示SOTA普遍脆弱,运动模糊和对比度影响最大;干净集精度与鲁棒性相关,预训练、后处理和大Transformer骨干更有帮助,而输入分辨率收益不明显。

NeRF-Feat: 6D Object Pose Estimation using Feature Rendering Figure 1
arXiv preprint2024-06-19

NeRF-Feat: 6D Object Pose Estimation using Feature Rendering

Shishir Reddy Vutukur, Heike Brock, Benjamin Busam, Tolga Birdal, Andreas Hutter, Slobodan Ilic, Siemens AG, Imperial College London

Technical University of Munich, Imperial College London

6D位姿估计物体位姿三维重建

针对6D位姿估计依赖精确CAD模型或昂贵真实位姿标注的问题,NeRF-Feat仅用RGB图像与相对位姿训练:先用NeRF隐式学习物体形状,再通过特征渲染与CNN双向对比学习获得视角一致且符合对称性的表面特征,推理时以2D-3D特征匹配和PnP估计位姿。在LM、LM-Occlusion和T-Less上达到弱标注设定下的基准级精度,并较同类NeRF-Pose在核心PnP设置下有小幅提升。

CNN Based Flank Predictor for Quadruped Animal Species Figure 1
Workshop Camera Traps, AI and Ecology 20232024-06-19

CNN Based Flank Predictor for Quadruped Animal Species

Vanessa Suessle, Marco Heurich, Colleen T. Downs, Andreas Weinmann, Elke Hergenroether

Vanessa Suessle1, Marco Heurich2,3,Colleen T. Downs5 Andreas Weinmann6 Elke Hergenroether1, Department of Computer Science, University of Applied Sciences Darmstadt, Schoefferstrasse 3, Darmstadt, Germany, Department of National Park Monitoring and Animal Management, Bavarian Forest National Park, Freyunger Str. 2, Grafenau, Germany, Faculty of Applied Ecology, Agricultural Sciences and Biotechnology, Inland Norway University of Applied Sciences, Evenstad, Norway, School of Life Sciences, University of KwaZulu-Natal, Carbis Road, Scottsville, Pietermaritzburg, South Africa, Department of Mathematics, University of Applied Sciences Darmstadt, Schoefferstrasse 3, Darmstadt, Germany

6D位姿估计

针对相机陷阱中动物左右体侧花纹不对称导致个体识别和种群估计易出错的问题,本文将四足动物姿态关键点数据自动转化为可见体侧标签,用迁移学习训练通用 CNN 体侧预测器,减少人工标注依赖。模型在跨物种、跨环境场景下评估,EfficientNetV2 在复杂栖息地未知物种欧亚猞猁数据上达到 88.70% 准确率。

MVSBoost: An Efficient Point Cloud-based 3D Reconstruction Figure 1
arXiv preprint2024-06-19

MVSBoost: An Efficient Point Cloud-based 3D Reconstruction

Umair Haroon 0000-0002-1449-1838, Ahmad AlMughrabi 0000-0002-9336-3200, Ricardo Marques 0000-0001-8261-4409, Petia Radeva 0000-0003-0047-5172

Computer Vision Center

6D位姿估计点云三维重建

针对神经隐式重建训练开销大、对数据质量敏感且难以满足实时/可扩展需求的问题,MVSBoost回到显式MVS路线,将360度多视图图像、SfM相机位姿估计、点云稠密化、网格重建与纹理映射串成优化流水线。其核心洞察是通过更稳健的几何位姿和后处理提升点云/网格质量,而非依赖重训练。论文在Realistic Synthetic 360上用Chamfer距离报告优于传统MVS和若干神经隐式方法,并声称在遮挡、视角变化和计算效率上更稳健。

An Efficient yet High-Performance Method for Precise Radar-Based Imaging of Human Hand Poses Figure 1
arXiv preprint2024-06-19

An Efficient yet High-Performance Method for Precise Radar-Based Imaging of Human Hand Poses

Johanna Bräunig, Vanessa Wirth, Marc Stamminger, Ingrid Ullmann, Martin Vossiek

6D位姿估计手部姿态

针对视觉手部姿态估计受光照影响、传统雷达成像帧率低且计算重的问题,论文将此前双频 FSK 近场手部成像扩展为三频连续波方案,用不同频差兼顾无模糊距离与相位灵敏度。在94发94收 MIMO 雷达、摄影测量真值和3D打印手模评测中,重建准确率达99.4%,精度约0.3 mm,并接近宽带SOTA但保留更高帧率与实时潜力。

Head Pose Estimation and 3D Neural Surface Reconstruction via Monocular Camera in situ for Navigation and Safe Insertion into Natural Openings Figure 1
arXiv preprint2024-06-18

Head Pose Estimation and 3D Neural Surface Reconstruction via Monocular Camera in situ for Navigation and Safe Insertion into Natural Openings

Ruijie Tang 1 R. Tang, B. Cui are co-first authors, Beilei Cui 2 R. Tang, Hongliang Ren

Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China, Department of Biomedical Engineering, National University of Singapore, Singapore, Shun Hing Institute of Advanced Engineering, The Chinese University of Hong Kong, Hong Kong, China, Shenzhen Research Institute, The Chinese University of Hong Kong, Shenzhen, China

6D位姿估计三维重建

面向鼻咽拭子、插管等需沿自然开口安全进入的医疗操作,论文试图降低个体化数字孪生导航的硬件成本。其核心是把3D Slicer、单目相机、NeRF头部外观重建、Marching Cubes网格生成、实时头姿估计与ArUco工具跟踪串成一条流程,实现虚拟头模与真实头部姿态同步,并演示工具随头姿变化进行指向导航;但定量精度与临床安全收益文中未充分说明。

Matching Query Image Against Selected NeRF Feature for Efficient and Scalable Localization Figure 1
arXiv preprint2024-06-17

Matching Query Image Against Selected NeRF Feature for Efficient and Scalable Localization

Huaiji Zhou

Binjiang Institute, Zhejiang University, The Hong Kong Polytechnic University, National University of Defense Technology

6D位姿估计三维重建

针对现有 NeRF 定位在大场景中依赖迭代优化、特征冗余且初值敏感的问题,MatLoc-NeRF 将查询图像与预训练 NeRF 内部经学习筛选的中间特征匹配,通过 2D-3D 对应和 PnP 求解位姿,并用姿态感知分块与地点预测提供粗定位。公开大规模数据集实验显示,其相较已有 NeRF 定位方法在精度和效率上均有提升。

Domain Generalization for In-Orbit 6D Pose Estimation Figure 1
arXiv preprint2024-06-17

Domain Generalization for In-Orbit 6D Pose Estimation

Antoine Legrand ID, Renaud Detry ID, Christophe De Vleeschouwer ID

6D位姿估计

面向非合作航天器近距离自主交会,单目6D位姿估计受真实在轨光照难获取、合成训练到真实测试域差影响严重。论文将关键点检测与Transformer位姿回归做成端到端网络,并用多任务学习和强数据增强/域随机化迫使模型学习域不变特征。实验在SPEED/SPEED+上表明,无需目标真实图像训练即可缩小域差并达到当时领先精度,消融验证了增强和结构组件的贡献。

SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking Figure 1
arXiv preprint2024-06-17

SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking

Tianhong Catherine Yu, Manru Mary Zhang, Peter He, Chi-Jung Lee, Cassidy Cheesman, Saif Mahmud, Ruidong Zhang, François Guimbretière, Cheng Zhang

Cornell University

6D位姿估计人体姿态

针对现有智能衣物常需在表面贴大面积导电电极、影响外观与穿着的问题,SeamPose将衬衫原有缝线改造为电容传感器,用绝缘导电线沿缝线机缝,尽量不改变衣物形态。原型含8条感知缝线,并以深度学习从电容信号回归相对骨盆的上半身3D关节位置;12人实验达到6.0 cm MPJPE,证明隐蔽式日常上身姿态跟踪可行。

Galibr: Targetless LiDAR-Camera Extrinsic Calibration Method via Ground Plane Initialization Figure 1
arXiv preprint2024-06-14

Galibr: Targetless LiDAR-Camera Extrinsic Calibration Method via Ground Plane Initialization

PAGE 1, Wonho Song1, Minho Oh1, Jaeyoung Lee2, Hyun Myung1∗, Senior Member, IEEE

6D位姿估计点云

针对自动驾驶/移动机器人中激光雷达-相机外参标定依赖标定板、维护不便且对环境特征敏感的问题,Galibr提出无靶、全自动流程:先用地面平面分别估计相机和LiDAR相对地面的高度与姿态作为GP-init,再通过非地面物体边缘投影匹配细化外参。实验在KITTI和KAIST四足机器人非结构化场景中显示精度和鲁棒性优于对比方法,主要增益来自更可靠的地面初始化。

MMVR: Millimeter-wave Multi-View Radar Dataset and Benchmark for Indoor Perception Figure 1
arXiv preprint2024-06-15

MMVR: Millimeter-wave Multi-View Radar Dataset and Benchmark for Indoor Perception

M. Mahbubur Rahman, Ryoma Yataka, Sorachi Kato, Pu Perry Wang, Peizhao Li, Adriano Cardace, Petros Boufounos

Mitsubishi Electric Research Laboratories (MERL)

6D位姿估计数据集/基准多视角

室内雷达感知缺少覆盖复杂房间、多主体和细粒度标注的公开数据,限制了机器人/室内导航等场景的鲁棒建模。MMVR用多视角高分辨率毫米波热图替代常见低分辨率点云,采集6个房间、25名受试者的345K帧,并提供检测框、分割实例和759万关键点;论文还在开放与杂乱场景、随机与跨环境划分下重实现RF-Pose/RFMask基准,主要贡献可能主要来自scaling/data。

Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference Figure 1
arXiv preprint2024-06-15

Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference

Google DeepMind

University of Toronto, Vector Institute, York University, Google DeepMind

6D位姿估计三维重建

针对冷冻电镜从噪声二维粒子图像中同时估计三维结构与6D位姿时,早期位姿后验多峰、纯摊销推断易落入错误模式且收敛慢的问题,cryoSPIN先用多头编码器生成多个候选位姿并以winner-takes-all损失训练,再切换到逐粒子SGD自解码精修。合成与真实数据表明其位姿收敛更快、重建质量优于cryoAI,并接近cryoSPARC;但切换时机仍缺少原则化判据。

The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiences Figure 1
arXiv preprint2024-06-14

The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiences

Bria Long footnotetext: *Equal contribution, Robert Z. Sparks, Violet Xiang, Stefan Stojanov, Zi Yin, Grace E. Keene, Alvin W. M. Tan, Steven Y. Feng, Auddithio Nag, Chengxu Zhuang, Virginia A. Marchman, Daniel L. K. Yamins, Stanford, San Diego, La Jolla, Cambridge, MA 02139 brlong@ucsd.edu @stanford.edu chengxuz@mit.edu

Stanford University, Stanford, CA, University of California, San Diego, Massachusetts Institute of Technology

6D位姿估计数据集/基准

针对儿童学习数据与机器学习训练数据之间的“data gap”,BabyView 发布了面向6个月至3岁儿童的高分辨率第一视角家庭视频数据集,含31个家庭868小时视频、宽垂直视场及陀螺仪/加速度计,并提供语音转写、说话人分离和人体姿态等评测标注。实验显示自监督语言/视觉模型随数据量提升,但迁移表现仍低于 curated 数据训练模型,尤其视觉任务,说明瓶颈可能主要来自真实儿童数据分布与规模。

OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics Figure 1
arXiv preprint2024-06-14

OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics

PAGE 1, Yoni Gozlan1, Antoine Falisse1, Scott Uhlrich1, Anthony Gatti1, Michael

Stanford University, Max Planck Institute for Intelligent Systems

6D位姿估计数据集/基准

该文针对常规姿态估计基准只看关键点误差、难以反映关节角和生理合理性的缺口,提出 OpenCapBench,将姿态输出自动接入 OpenSim,以临床相关 OpenCap 多视角/动捕数据评估运动学指标。作者还用合成数据微调 2D 模型预测更密集关键点的 SynthPose,揭示稀疏关键点不足,并报告平均关节角 RMSE 约降低两倍、部分关节最高约四倍。

ImageNet3D: Towards General-Purpose Object-Level 3D Understanding Figure 1
arXiv preprint2024-06-13

ImageNet3D: Towards General-Purpose Object-Level 3D Understanding

Wufei Ma, Guanning Zeng, Guofeng Zhang, Qihao Liu, Letian Zhang, Adam Kortylewski, Yaoyao Liu

Johns Hopkins University, Tsinghua University, Tongji University, University of Freiburg, Max Planck Institute for Informatics

6D位姿估计物体位姿

面向机器人与通用智能中的开放类别物体3D理解,论文指出现有6D/3D标注数据类别少、领域窄且难泛化。ImageNet3D在ImageNet的200类、8.6万余物体上补充2D框、6D位姿/位置、跨类别规范姿态对齐与含3D信息的自然语言描述,用于评估视觉基础模型3D意识和开放词汇位姿估计。实验显示该数据可训练更通用的物体级3D模型,同时暴露现有方法在新类别泛化上的不足。

Language-Driven Closed-Loop Grasping with Model-Predictive Trajectory Replanning Figure 1
arXiv preprint2024-06-14

Language-Driven Closed-Loop Grasping with Model-Predictive Trajectory Replanning

Huy Hoang Nguyen, Minh Nhat Vu, Florian Beck, Gerald Ebmer, Anh Nguyen, Andreas Kugi

Automation & Control Institute (ACIN), TU Wien, Vienna, Austria, Department of Computer Science, University of Liverpool, UK, Austrian Institute of Technology (AIT) GmbH, Vienna, Austria

6D位姿估计

针对动态场景中语言指令、视觉定位与机器人控制更新频率不一致导致抓取不稳的问题,论文提出零样本模块化闭环框架:用开放词汇视觉语言模型按指令分割目标,结合 FoundationPose 在线6D位姿跟踪与模型预测轨迹重规划,实现对移动物体的平滑抓取。实验显示位姿定位最高30Hz、滚动优化10Hz,能实时抓取非静止目标。

VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks Figure 1
arXiv preprint2024-06-14

VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Tasks

Jiannan Wu, Muyan Zhong, Sen Xing, Zeqiang Lai, Zhaoyang Liu, Zhe Chen, Wenhai Wang, Xizhou Zhu, Lewei Lu, Tong Lu, Ping Luo, Yu Qiao, Jifeng Dai OpenGVLab

OpenGVLab, Shanghai AI Laboratory The University of Hong Kong Tsinghua University, Beijing Institute of Technology The Hong Kong University of Science and Technology, Nanjing University The Chinese University of Hong Kong SenseTime Research

6D位姿估计

针对传统多模态大模型主要输出文本、难以直接承担检测、分割、6D/关键点位姿与生成等结构化视觉任务的问题,VisionLLM v2 用“super link”将路由 token 与任务查询绑定,端到端连接多个专用解码器并缓解多任务冲突;结合大规模整理的跨域任务数据和三阶段训练,在数百个视觉语言任务上用共享参数达到接近专用模型的表现,但部分增益可能主要来自 scaling / data。

Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization Figure 1
arXiv preprint2024-06-12

Asymptotic Unbiased Sample Sampling to Speed Up Sharpness-Aware Minimization

Jiaxin Deng, Junbiao Pang, Baochang Zhang, Guodong Guo

6D位姿估计

判断受限于 PDF 文本抽取质量;可见内容显示论文动机是降低 Sharpness-Aware Minimization 在训练中因全 mini-batch 计算扰动带来的额外开销。核心思路似乎是用渐近无偏的样本子集估计扰动/梯度差异,并给出采样误差上界证明。实验设置与定量结果在抽取文本中未充分说明,因此加速和精度增益来源不清。

IFTD: Image Feature Triangle Descriptor for Loop Detection in Driving Scenes Figure 1
arXiv preprint2024-06-12

IFTD: Image Feature Triangle Descriptor for Loop Detection in Driving Scenes

Fengtian Lang, Ruiye Ming, Zikang Yuan, Xin Yang

6D位姿估计

针对车载 LiDAR 回环检测中,STD 直接在三维点云提取平面边界特征计算量大、在森林等复杂场景不稳定的问题,IFTD 将点云按高度分层并投影为 BEV 图像,提取 Shi-Tomasi 角点构造三角描述子,再结合三角匹配、RANSAC/SVD 与 BEV 图像相似性验证估计 4-DoF 相对位姿。在 NCLT、KITTI、Mulran 上相较多种方法表现出更高鲁棒性和准确率,并明显快于 STD。

From Variance to Veracity: Unbundling and Mitigating Gradient Variance in Differentiable Bundle Adjustment Layers Figure 1
arXiv preprint2024-06-12

From Variance to Veracity: Unbundling and Mitigating Gradient Variance in Differentiable Bundle Adjustment Layers

Swaminathan Gurumurthy, Karnik Ram, Bingqing Chen, Zachary Manchester

Carnegie Mellon University TU Munich, Bosch Center for Artificial Intelligence

6D位姿估计

针对可微束调整层在视觉里程计/SLAM中训练慢且不稳定的问题,论文将症结归因于外点引发的梯度高方差,包括流损失干扰、BA线性化误差和权重梯度受残差支配。核心做法是用内层BA预测的权重重加权外层对应/光流损失,使训练更关注关键内点,并配合梯度均衡。实验在DPVO上带来约2–2.5倍训练加速,迁移到DROID-SLAM也保持稳定,并提升TartanAir等基准精度。

SPIN: Spacecraft Imagery for Navigation Figure 1
arXiv preprint2024-06-12

SPIN: Spacecraft Imagery for Navigation

PAGE 1, Javier Montalvo∗1, ´Alvaro Garc´ıa-Mart´ın

6D位姿估计航天器

面向非合作航天器相对导航,真实在轨数据稀缺且现有合成数据多依赖闭源工具、标注模态有限。SPIN提出开源航天器图像生成器,可加载自定义3D模型、控制相机位姿与光照,并输出深度、分割、密集姿态和关键点等真值,同时支持场景级数据增强。用其复刻SPEED+训练6D位姿估计,在SPEED+测试台数据上平均误差降低47%,结合增强后降幅达60%。

Realistic Data Generation for 6D Pose Estimation of Surgical Instruments Figure 1
arXiv preprint2024-06-11

Realistic Data Generation for 6D Pose Estimation of Surgical Instruments

Juan Antonio Barragan, Jintan Zhang, Haoying Zhou, Adnan Munawar, Peter Kazanzides

Department of Computer Science, Johns Hopkins University, Baltimore, MD 21218, USA, Department of Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA 01608, USA

6D位姿估计医学/手术

面向手术机器人自动化中器械6D位姿标注数据稀缺、普通图形仿真难以表现真实器械—组织交互的问题,本文在AMBF缝合仿真基础上构建自动数据生成流水线,并引入可物理复现的商用缝合垫场景,以生成更贴近手术操作的合成数据。作者用该系统生成7.5k张带手术针位姿标注的图像训练GDR-Net,在含不同遮挡的测试数据上达到2.59 mm平均平移误差,表明其主要价值在于降低医学位姿数据构建成本。

SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale Figure 1
arXiv preprint2024-06-11

SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scale

Shester Gueuwou, Xiaodan Du, Greg Shakhnarovich

6D位姿估计

本文针对大规模手语视频翻译中全视频自监督预训练计算成本高、通用姿态估计又难以捕捉复杂手形和面部/眼神线索的问题,提出 SignMusketeers:将脸、左右手图像流与身体姿态特征分流建模,并用单帧自监督学习手部和面部表示。How2Sign 实验显示,其以更小模型、41 倍更少预训练数据和约 3% 算力,达到接近既有 SOTA 的翻译性能。

Multicam-SLAM: Non-overlapping Multi-camera SLAM for Indirect Visual Localization and Navigation Figure 1
arXiv preprint2024-06-10

Multicam-SLAM: Non-overlapping Multi-camera SLAM for Indirect Visual Localization and Navigation

Shenghao Li, Luchao Pang, Xianglong Hu

6D位姿估计相机位姿多视角

针对单目/RGB-D SLAM视野受限、弱纹理或光照变化下易跟踪丢失的问题,Multicam-SLAM将多个可非重叠视场的RGB-D相机建模为统一多相机实体,并通过多关键帧、并行SLAM线程及基于位姿图优化的在线外参标定来融合多视角约束。实验显示其相较传统单相机SLAM在多种环境中提升了定位精度与鲁棒性。

A preprocessing-based planning framework for utilizing contacts in high-precision insertion tasks Figure 1
IEEE Robotics and Automation Letters, vol. 8, no. 11, pp. 6947-6954, Nov. 20232024-06-08

A preprocessing-based planning framework for utilizing contacts in high-precision insertion tasks

Muhammad Suhail Saleem, Rishi Veerapaneni, Maxim Likhachev

6D位姿估计

面向插头插入、装配等对6D位姿误差极敏感的任务,论文将初始位姿不确定下的接触/未接触反馈建模为POMDP观测,并针对半结构化、重复场景预处理有限初始分布对应的策略库。核心是E-RTDP-Bel复用相似问题经验,加速策略生成;实验中数据库构建提速超过100倍,真实插头插入成功率达95%,并在仿真管件装配中验证泛化性。

GLACE: Global Local Accelerated Coordinate Encoding Figure 1
arXiv preprint2024-06-06

GLACE: Global Local Accelerated Coordinate Encoding

Fangjinhua Wang 1 Equal contribution, Xudong Jiang 1 Equal contribution, Silvano Galliani, Christoph Vogel, ETH Zurich Microsoft Mixed Reality, AI Zurich Lab

Department of Computer Science, ETH Zurich, Microsoft Mixed Reality & AI Zurich Lab

6D位姿估计

GLACE针对场景坐标回归在大尺度场景中难以仅靠重投影约束完成可靠隐式三角化的问题,引入共视性先验,将预训练全局与局部编码结合,并用特征扩散软化全局特征分组、配合更适合大场景的位置解码器,避免陷入平凡解。无需3D模型或深度监督,单个小模型在多项大尺度定位基准达到SOTA,并在Cambridge Landmarks上较ACE集成版Poker降低17%中位位置误差。

Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Tracking Figure 1
arXiv preprint2024-06-06

Omni6DPose: A Benchmark and Model for Universal 6D Object Pose Estimation and Tracking

Jiyao Zhang, Weiyao Huang, Bo Peng, Mingdong Wu, Fei Hu, Zijian Chen, Bo Zhao, Hao Dong

6D位姿估计物体位姿数据集/基准

针对6D物体位姿估计缺少大规模、跨类别真实评测的问题,Omni6DPose构建了含ROPE真实数据、SOPE混合现实仿真数据和对齐扫描模型的通用基准,覆盖149类与大量实例/标注,并通过降低语义与几何sim2real差距提升数据可用性。论文还提出GenPose++,以语义感知特征和聚类聚合改进类别级估计,在该基准的位姿估计与跟踪评测中取得SOTA表现;具体增益可能也主要来自scaling / data。

Sparse Color-Code Net: Real-Time RGB-Based 6D Object Pose Estimation on Edge Devices Figure 1
arXiv preprint2024-06-05

Sparse Color-Code Net: Real-Time RGB-Based 6D Object Pose Estimation on Edge Devices

Xingjian Yang, Zhitao Yu, Ashis G. Banerjee

6D位姿估计物体位姿

面向机器人和 AR 在边缘端低时延运行的需求,SCCN用纯 RGB 做6D位姿估计:先以Sobel稀疏轮廓和UNet定位目标,再在裁剪区域回归颜色编码建立2D-3D对应,并加入像素级对称性表示缓解对称物体歧义,从而减少PnP计算负担。在Jetson AGX Xavier上,LINEMOD与Occlusion LINEMOD分别达到19 FPS和6 FPS,同时保持较高精度。

CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation Figure 1
arXiv preprint2024-06-04

CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generation

Dejia Xu, Weili Nie, Chao Liu, Sifei Liu, Jan Kautz, Zhangyang Wang, Arash Vahdat

University of Texas at Austin, NVIDIA

6D位姿估计

CamCo针对现有视频扩散模型难以精确按相机位姿生成、导致镜头语言和3D一致性不足的问题,在预训练图生视频模型上引入以Plücker坐标表示的像素级相机条件,并在注意力块中加入极线约束注意力,同时用SfM标注的真实视频微调以兼顾物体运动。实验显示其相较既有方法在相机可控性、几何一致性和视觉质量上更好。

A Robust Filter for Marker-less Multi-person Tracking in Human-Robot Interaction Scenarios Figure 1
arXiv preprint2024-06-03

A Robust Filter for Marker-less Multi-person Tracking in Human-Robot Interaction Scenarios

Enrico Martini, Harshil Parekh, Shaoting Peng, Nicola Bombieri, Nadia Figueroa

Department of Engineering for Innovation Medicine, University of Verona, Verona, Italy, GRASP Lab, Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania, Philadelphia, USA

6D位姿估计机器人操作

面向无标记多人 HRI 中 HPE 与深度相机误差导致的遮挡、身份混淆和机器人抖动,论文提出可插拔的 3D 骨架滤波管线,用空间可信度评估、时间关联跟踪和 permanence filter 处理缺失关键点与长时遮挡。多任务实验以动捕为真值,结果优于 OpenPose 与两种实时 Kalman 变体,并降低人手—机器人安全距离波动,交互更平滑安全。

Equivariant amortized inference of poses for cryo-EM Figure 1
arXiv preprint2024-06-01

Equivariant amortized inference of poses for cryo-EM

Larissa de Ruijter QUVA Lab, Amsterdam QUVA Lab, AMLab

QUVA Lab, University of Amsterdam, Qualcomm AI Research, Amsterdam

6D位姿估计

针对 cryo-EM 重构中粒子 6D/3D 姿态缺失、噪声高且逐图搜索代价大的问题,论文在 cryoAI 式摊销姿态推断中引入旋转/镜像等变编码器,利用图像平面变换与姿态变换的一致性约束学习。模拟实验显示,该设计比标准编码器收敛更快、成功率更高,姿态估计精度与重构分辨率更好;其中 D4 等变性可替代昂贵的对称损失,但仍有少数训练不收敛。

3D WholeBody Pose Estimation based on Semantic Graph Attention Network and Distance Information Figure 1
arXiv preprint2024-06-03

3D WholeBody Pose Estimation based on Semantic Graph Attention Network and Distance Information

Sihan Wen, Xiantan Zhu, Ltd. @fujitsu.com

Fujitsu R&D Center Co., Ltd

6D位姿估计人体姿态

针对2D到3D全身姿态提升中关节关系建模不足、身体/手/脸关键点密度差异大的问题,论文提出SemGAN,将自注意力的全局依赖与SemGCN的骨架局部先验结合,并用身体部位解码器、父子关节距离信息和几何损失约束结构。方法在H3WB全身133点基准上取得第一,MPJPE较第二名低15.44。

CapeX: Category-Agnostic Pose Estimation from Textual Point Explanation Figure 1
arXiv preprint2024-06-01

CapeX: Category-Agnostic Pose Estimation from Textual Point Explanation

Matan Rusanovsky Or Hirschorn Shai Avidan

Tel Aviv University

6D位姿估计类别级位姿

针对传统类别无关姿态估计仍依赖带关键点标注的支持图像、且纯视觉匹配难以处理外观差异的问题,CapeX用带文本描述节点的姿态图替代支持图像,将开放词汇语义与关键点结构关系结合,以缓解对称、遮挡和结构漂移。在MP-100的100类、1.8万图像上,1-shot设置较已有方法提升1.07%,并补充了关键点文本标注。

Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach Figure 1
arXiv preprint2024-05-30

Estimating Human Poses Across Datasets: A Unified Skeleton and Multi-Teacher Distillation Approach

Muhammad Saif Ullah Khan

6D位姿估计人体姿态数据集/基准

针对 COCO、MPII 等人体姿态数据集骨架定义不一致导致模型难以跨集泛化的问题,本文将多教师知识蒸馏与骨架并集学习结合,在 RTMPose 上训练可预测 21 个关键点的统一学生模型。联合模型在跨 COCO/MPII 评测的平均准确率达 70.89/76.40,明显高于单数据集训练的 53.79/55.78,并在 Halpe 上对 21 点取得 66.84/72.75 AP。

TAMBRIDGE: Bridging Frame-Centered Tracking and 3D Gaussian Splatting for Enhanced SLAM Figure 1
arXiv preprint2024-05-30

TAMBRIDGE: Bridging Frame-Centered Tracking and 3D Gaussian Splatting for Enhanced SLAM

Hyper-parameter Values of Implementation

6D位姿估计相机位姿三维重建高斯泼溅

判断受限于 PDF 文本抽取质量。TAMBRIDGE针对3DGS-SLAM中前端帧中心跟踪与在线高斯地图优化衔接不足、冗余视角影响定位和收敛的问题,提出带视角选择与融合优化的Fusion Bridge,连接稀疏特征前端和3DGS后端。实验称其在TUM小运动序列和真实会议室数据上较SplaTAM定位更准,重建质量相当或更好。

Exploring AI-based Anonymization of Industrial Image and Video Data in the Context of Feature Preservation Figure 1
arXiv preprint2024-05-29

Exploring AI-based Anonymization of Industrial Image and Video Data in the Context of Feature Preservation

Sabrina C. Triess 0009-0003-0839-901X, Timo Leitritz 0009-0009-2109-4724, Christian Jauch 0000-0002-2769-2831

6D位姿估计

面向工业现场图像/视频在隐私合规后仍可用于姿态估计与动作识别的需求,论文将 GAN 式全身匿名化 DeepPrivacy2 引入办公、实验室和工厂场景,并与模糊、像素化比较,关注身份生成质量、视频时序一致性和下游特征保留;但给定文本未充分说明定量结果与相对增益,难判断其优势是否稳定。

World Models for General Surgical Grasping Figure 1
arXiv preprint2024-05-28

World Models for General Surgical Grasping

Hongbin Lin, Bin Li, Chun Wai Wong, Juan Rojas, Xiangyu Chu, binli.link, xiangyuchu, samuelau}@cuhk.edu.hk juan.rojas@lipscomb.edu, brianwongcw@gmail.com

The Chinese University of Hong Kong, Lipscomb University

6D位姿估计医学/手术

面向手术机器人在未知小尺寸器械/组织上的抓取,论文指出传统依赖6D位姿或特征跟踪的方法难以应对几何未知、深度噪声和控制扰动。GAS用世界模型强化学习学习像素级视觉运动策略,并通过小目标区域动态放大、深度不确定性估计压缩RGB-D/掩码信息。仿真训练后直接迁移到真实机器人,在多类未见目标和不同夹爪上平均成功率约69%,且在背景、相机、控制误差、噪声和掉落重抓等扰动下保持较强鲁棒性。

MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds Figure 1
arXiv preprint2024-05-27

MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds

Jiahui Lei, Yijia Weng, Adam W. Harley, Leonidas Guibas, Archimedes, Athena RC @cis.upenn.edu, @cs.stanford.edu

University of Pennsylvania Stanford University Archimedes, Athena RC

6D位姿估计高斯泼溅

MoSca面向无标定、随手拍单目视频中的动态场景重建,解决真实视频多视角约束不足、运动与外观耦合的问题。其核心是把跟踪、深度等2D基础模型先验提升为4D Motion Scaffold,用稀疏6DoF轨迹和ARAP正则描述平滑低秩形变,并将锚定其上的高斯跨时间全局融合,同时通过BA估计相机内外参。实验显示其在动态新视角渲染基准和真实视频上达到SOTA,但对2D长时跟踪与深度质量仍较敏感。

Occlusion Handling in 3D Human Pose Estimation with Perturbed Positional Encoding Figure 1
arXiv preprint2024-05-27

Occlusion Handling in 3D Human Pose Estimation with Perturbed Positional Encoding

Niloofar Azizi, Mohsen Fayyaz, Horst Bischof

6D位姿估计手部姿态人体姿态

针对2D骨架升维到3D人体姿态时遮挡导致骨架边缺失、传统拉普拉斯特征位置编码失效的问题,论文提出PerturbPE:对图拉普拉斯施加多次删边扰动,并用RSPT近似扰动特征向量,平均提取稳定的“规则”特征作为节点编码。该方法不增加训练参数,可用一个GCN处理多种缺边场景;在Human3.6M上单边缺失最高提升约12%,双边缺失也刷新结果。

Clustering-based Learning for UAV Tracking and Pose Estimation Figure 1
arXiv preprint2024-05-27

Clustering-based Learning for UAV Tracking and Pose Estimation

Jiaping Xiao, Phumrapee Pisutsin, Cheng Wen Tsao, mir.feroskhan@ntu.edu.sg

Nanyang Technological University

6D位姿估计航天器

面向反无人机与编队等场景中小型无人机在复杂环境下难以稳定三维定位的问题,本文提出 CL-Det,将 Livox Avia 与 LiDAR 360 点云时间对齐后分离目标点云,并用 DBSCAN 选择最大簇中心作为无人机位置,同时用历史估计补全缺失帧。方法在 CVPR 2024 UG2+ Track 5 多模态无人机定位评测中获得第 5 名,但姿态维度与分类增益来源文中未充分说明。

Multi-Modal UAV Detection, Classification and Tracking Algorithm -- Technical Report for CVPR 2024 UG2 Challenge Figure 1
CVPR 20242024-05-26

Multi-Modal UAV Detection, Classification and Tracking Algorithm -- Technical Report for CVPR 2024 UG2 Challenge

Tianchen Deng, Yi Zhou, Wenhua Wu, Mingrui Li, Jingwei Huang, Shuhong Liu, Yanzeng Song, Hao Zuo, Yanbo Wang, Yutao Yue, Hesheng Wang, Weidong Chen

Shanghai Jiao Tong University, Institute of Deep Perception Technology, JITRI, Dalian University of Technology, University of Electronic Science and Technology of China, The University of Tokyo, The Hong Kong University of Science and Technology (Guangzhou)

6D位姿估计数据集/基准航天器

面向恶劣天气下小型无人机难以仅靠单一传感器完成识别与三维轨迹估计的问题,本文提出多模态反无人机流程:分类端结合序列融合、ROI裁剪与关键帧选择,位姿/跟踪端利用激光雷达动态点分析、多目标跟踪和轨迹补全,而非单纯端到端训练。在MMUAD数据集与CVPR 2024 UG2+挑战中,该方法获得分类和跟踪综合第一。

Intensity and Texture Correction of Omnidirectional Image Using Camera Images for Indirect Augmented Reality Figure 1
arXiv preprint2024-05-25

Intensity and Texture Correction of Omnidirectional Image Using Camera Images for Indirect Augmented Reality

Hakim Ikebayashi, Norihiko Kawai

6D位姿估计

针对间接AR依赖预拍全景图而易受季节、天气差异影响真实感的问题,本文用用户手机现场视频对旧全景图做外观校准:先语义分割并对齐生成全景,再对天空进行拼接、泊松编辑与修复,对其他区域做直方图匹配和纹理合成。实验在多场景中显示可改善亮度与天空纹理一致性,但效果明显受语义分割精度和类别设计限制,实际IAR体验增益仍文中未充分说明。

CoPeD-Advancing Multi-Robot Collaborative Perception: A Comprehensive Dataset in Real-World Environments Figure 1
arXiv preprint2024-05-23

CoPeD-Advancing Multi-Robot Collaborative Perception: A Comprehensive Dataset in Real-World Environments

Yang Zhou, Long Quang, Carlos Nieto-Granda, and Giuseppe Loianno

Capabilities Development Command, Army Research Laboratory, Adelphi, MD 20783, USA

6D位姿估计机器人操作数据集/基准

针对多机器人协同感知缺少真实世界数据、现有多偏向 SLAM 或仿真且视角重叠不足的问题,CoPeD 构建了空地异构机器人、多模态多频率的室内外数据集,提供原始传感器流、位姿估计及可选高层感知标注,并刻意保证跨机器人视野重叠。论文通过若干协同感知任务做定性展示,说明其可支持传感器融合、目标检测和场景理解研究,但未给出系统量化基准。

Segformer++: Efficient Token-Merging Strategies for High-Resolution Semantic Segmentation Figure 1
arXiv preprint2024-05-23

Segformer++: Efficient Token-Merging Strategies for High-Resolution Semantic Segmentation

Daniel Kienzle, Marco Kantonis, Robin Schön, Rainer Lienhart

University of Augsburg

6D位姿估计

该文针对高分辨率密集预测中 Transformer 注意力随 token 数二次增长、难以实时部署的问题,将分类任务中的 token merging 改造到含金字塔与卷积结构的 Segformer,提出 Segformer++,可在各阶段合并相似 token,且推理时无需重训。实验覆盖 Cityscapes、ADE20K 及人体姿态数据;在 Cityscapes 上 HQ 版本保持 mIoU 基本不变并提速 61%,fast 版本约提速 94%但有小幅精度损失。

Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos Figure 1
arXiv preprint2024-05-21

Geometric Transformation Uncertainty for Improving 3D Fetal Brain Pose Prediction from Freehand 2D Ultrasound Videos

J. Ramesh, Jayroop Ramesh, Nicola Dinsdale, the INTERGROWTH-21 Consortium, Pak-Hei Yeung, Ana I.L. Namburete

6D位姿估计手部姿态

针对自由手二维胎儿脑超声难以稳定定位到三维解剖坐标、且临床部署受算力限制的问题,论文提出 QAERTS:用多头同时回归四元数、轴角、欧拉角、旋转矩阵、平移和尺度等等价几何表征,并显式学习输出不确定性,以降低采集质量和旋转表征不连续带来的噪声影响。实验显示其较 PlaneInVol 在 PA、NCC 等指标上约提升 9% 和 8%,接近深度集成效果但参数约少 5 倍。

Leveraging Neural Radiance Fields for Pose Estimation of an Unknown Space Object during Proximity Operations Figure 1
arXiv preprint2024-05-21

Leveraging Neural Radiance Fields for Pose Estimation of an Unknown Space Object during Proximity Operations

Antoine Legrand ID, Renaud Detry ID, Christophe De Vleeschouwer ID

Department of Electrical Engineering (ELEN), ICTEAM, UCLouvain, Department of Electrical Engineering (ESAT), KU Leuven, Department of Mechanical Engineering (MECH), KU Leuven

6D位姿估计

面向主动清除碎片中的近距离自主交会,本文针对未知航天器缺少 CAD 模型、难以合成训练数据的问题,提出先用少量实拍图训练带外观嵌入的 in-the-wild NeRF,再生成多视角、多光照数据来训练现成 6D 位姿网络。SPEED+ 硬件在环实验显示,该方案显著优于直接用少量真实图训练,并接近使用目标 CAD 合成数据训练的效果。

PoseGravity: Pose Estimation from Points and Lines with Axis Prior Figure 1
arXiv preprint2024-05-21

PoseGravity: Pose Estimation from Points and Lines with Axis Prior

Akshay Chandrasekhar BallerTV

6D位姿估计

针对带重力/旋转轴先验的相机绝对位姿估计,论文希望利用IMU、消失点等先验把6自由度问题降为4自由度,并统一处理点、线特征。核心做法是将求解转化为双曲线与单位圆交点,并给出无奇异参数化及平面、极小情形的闭式简化,整体为O(n)。实验显示其在多数轴先验设定下精度具竞争力,常有更低旋转误差,平面场景和较大线特征规模下速度优势更明显。

Focus on Low-Resolution Information: Multi-Granular Information-Lossless Model for Low-Resolution Human Pose Estimation Figure 1
arXiv preprint2024-05-19

Focus on Low-Resolution Information: Multi-Granular Information-Lossless Model for Low-Resolution Human Pose Estimation

PAGE 1, Zejun Gu, Zhong-Qiu Zhao, Hao Shen, Zhao Zhang

6D位姿估计人体姿态

面向远距离拍摄、低端设备等低分辨率人体姿态场景,论文指出常规下采样会进一步丢失细节且未充分利用骨架运动学关系,提出可替换下采样层的 MGIL:用 FLIE 做近似无损细粒度信息提取,CII 建模不同感受野下的结构关系,并由 MGAF 自适应融合多粒度特征。在 COCO 低分辨率设置上较 SOTA 提升 7.7 mAP,并在不同分辨率、骨干和分类/检测等任务中展示迁移性。

AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movements Figure 1
arXiv preprint2024-05-20

AutoSoccerPose: Automated 3D posture Analysis of Soccer Shot Movements

Japan RIKEN/JST PRESTO, Japan fujii@i.nagoya-u.ac.jp

Nagoya University, Japan

6D位姿估计

面向足球射门姿态分析中缺少连续姿态标注、真实转播场景复杂且传统线性模型难捕捉时空关系的问题,论文构建3DSP射门姿态数据集,并提出AutoSoccerPose半自动提取2D/3D姿态及3DSP-GRAE图循环自编码表示序列。方法在SoccerNet与3DSP上逐阶段验证,并给出射门姿态分析基线;但完全自动化仍未实现,增益更多体现为数据与流程基线。

Advancing 6-DoF Instrument Pose Estimation in Variable X-Ray Imaging Geometries Figure 1
arXiv preprint2024-05-19

Advancing 6-DoF Instrument Pose Estimation in Variable X-Ray Imaging Geometries

Christiaan G.A. Viviers, Lena Filatova, Maurice Termeer, Peter H.N. de With, Fons van der Sommen

Technical University of Eindhoven, Endhoven, The Netherlands (e-mail

6D位姿估计

面向透视/锥束 X 光引导手术中器械位姿依赖人工试错、且成像几何会随 C 臂和视野变化的问题,论文将 YOLOv5 改造成预测 3D 包围盒投影关键点的 YOLOv5-6D,并结合 PnP 与系统内参恢复 6DoF,同时提出用外部光学相机自动采集和标注 X 光数据的流程。其在公开基准保持竞争精度且达 42 FPS,在校准立方体上 ADD 为 99.27%,脊柱螺钉场景 ADD-S 达 92.41%,显示对不同几何和复杂语义有一定泛化能力。

Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation Figure 1
arXiv preprint2024-05-19

Cross-Domain Knowledge Distillation for Low-Resolution Human Pose Estimation

Zejun Gu, Zhong-Qiu Zhao, Henghui Ding, Hao Shen, Zhao Zhang, De-Shuang Huang

6D位姿估计人体姿态

面向监控、远距拍摄等低分辨率人体姿态场景,论文用高分辨率教师提升低分辨率学生,但关键难点是特征尺度和输出类别数不一致。CDKD通过SAPE把不同分辨率特征自适应投到公共空间,并用CCA合并相邻类别分布实现logit蒸馏,再配合由易到难训练。MPII和COCO实验显示其在低分辨率HPE上达到SOTA且几乎不增加推理计算成本。

PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking Figure 1
arXiv preprint2024-05-18

PS6D: Point Cloud Based Symmetry-Aware 6D Object Pose Estimation in Robot Bin-Picking

Yifan Yang, Zhihao Cui, Qianyi Zhang, Jingtai Liu

Zhihao Cui is with the Deep Learning Group, Mech-Mind, Beijing

6D位姿估计物体位姿点云机器人操作

面向工业料箱抓取中锈蚀、反光、弱纹理以及细长/多对称工件导致 RGB/RGB-D 方法不稳的问题,PS6D改用纯点云,结合注意力多尺度特征、对称感知旋转损失、中心距离敏感平移损失与两阶段聚类来联合实例分割和6D位姿估计。在Siléane、IPA及工业工件数据上,相比SOTA的F1_inst提升11.5%、Recall提升14.8%,真实抓取成功率达91.7%。

MotionGS : Compact Gaussian Splatting SLAM by Motion Filter Figure 1
arXiv preprint2024-05-18

MotionGS : Compact Gaussian Splatting SLAM by Motion Filter

Xinli Guo, Weidong Zhang, Ruonan Liu, Peng Han, Hongtian Chen

Shanghai Jiao Tong University

6D位姿估计相机位姿三维重建高斯泼溅

MotionGS面向NeRF类SLAM渲染慢、现有3DGS SLAM帧处理与存储压力仍大的问题,将深度视觉特征、运动滤波与信息滤波组成双关键帧机制,只对筛选帧做3DGS直接位姿优化,并在建图中联合优化相机位姿和高斯参数以获得紧凑表示。论文在Replica和TUM-RGBD上报告跟踪、重建/渲染优于对比方法,内存更低,运行约2.5 fps。

Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation Figure 1
arXiv preprint2024-05-17

Resolving Symmetry Ambiguity in Correspondence-based Methods for Instance-level Object Pose Estimation

Yongliang Lin, Yongzhi Su, Sandeep Inuganti, Yan Di, Naeem Ajilforoushan, Hanqing Yang, Yu Zhang, Jason Rambach

College of Control Science and Engineering, Zhejiang University, China, German Research Center for Artificial Intelligence (DFKI), Germany

6D位姿估计物体位姿

本文针对RGB单目实例级6D位姿估计中对称物体的2D-3D一一对应歧义,提出将表面顶点编码为一对多对应的SymCode,并用SymNet直接从编码和分割掩码回归位姿,绕开PnP/RANSAC及后处理。作者在以对称物体为主的T-LESS和IC-BIN上报告了与现有方法相当的精度,同时推理速度更快。

Diversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder Figure 1
arXiv preprint2024-05-16

Diversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder

Mohamed Ilyes Lakhal, Richard Bowden CVSSP, Guildford, United Kingdom @surrey.ac.uk

CVSSP, University of Surrey, Guildford, United Kingdom

6D位姿估计

本文面向手语生成中的匿名化与多样性需求:在保持输入2D姿态和非手部表情语义的同时,生成不同性别、肤色等属性的签者图像。核心做法是在VAE的KL约束中显式编码姿态,使外观潜变量尽量与姿态解耦,并嵌入UNet生成器,配合分身体部位解码器和边缘损失提升细节。SMILE II实验显示,PENet在多样性、像素质量和姿态保持上优于基线,但真实时序一致性未作为主要约束,泛化范围仍需更多数据验证。

Toon3D: Seeing Cartoons from a New Perspective Figure 1
arXiv preprint2024-05-17

Toon3D: Seeing Cartoons from a New Perspective

Ethan Weber, Riley Peterlinz, Rohan Mathur, Frederik Warburg, Alexei A. Efros, Angjoo Kanazawa Teton.ai UC Berkeley

Ethan Weber, UC Berkeley

6D位姿估计

本文针对手绘卡通/动画多视图常不满足真实几何一致性、导致传统 SfM 难以估计相机位姿和三维结构的问题,提出 Toon3D:利用人工稀疏对应与单目深度先验,在联合优化相机、点云的同时对图像和深度做分段刚性形变,以“解释掉”绘制误差。作者还构建标注工具与 12 个场景数据集;实验显示其相比 COLMAP、DUSt3R 能获得更可靠位姿和几何,并可初始化新视角/3DGS 可视化。

Task-adaptive Q-Face Figure 1
arXiv preprint2024-05-15

Task-adaptive Q-Face

Haomiao Sun, Mingjie He, Shiguang Shan, Hu Han, Xilin Chen

6D位姿估计

该文针对多种人脸分析任务各自建模、难以共享互补信息且目标可能冲突的问题,提出 Q-Face:用大规模预训练共享编码器融合多层特征,并以任务查询向量通过交叉注意力自适应抽取不同任务所需的局部/全局表征。实验在 CelebA、RAF-DB、EmotioNet、AgeDB、BIWI 上覆盖表情、AU、属性、年龄和姿态估计,报告统一模型达到多项 SOTA,但对新任务和开放类别的泛化仍受限。

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images Figure 1
arXiv preprint2024-05-14

RDPN6D: Residual-based Dense Point-wise Network for 6Dof Object Pose Estimation Based on RGB-D Images

chusong@csie.ntu.edu.tw

National Taiwan University

6D位姿估计物体位姿点云彩色深度

RDPN6D针对RGB-D 6D位姿中直接回归不够可解释、稀疏关键点在遮挡和视角变化下不稳且流程耗时的问题,改用每个可见像素的稠密2D-3D/3D-3D对应,并将物体坐标表示为相对3D模型锚点的残差以压缩预测空间,同时处理裁剪后的相机内参重投影。实验在MP6D、YCB-Video、LineMOD和Occlusion LineMOD上整体优于多数方法,遮挡场景提升尤为明显。

TP3M: Transformer-based Pseudo 3D Image Matching with Reference Figure 1
arXiv preprint2024-05-14

TP3M: Transformer-based Pseudo 3D Image Matching with Reference

Liming Han Zhaoxiang Liu Shiguo Lian

AI Innovation Center, China Unicom, Beijing 100013, China, Unicom Digital Technology, China Unicom, Beijing 100013, China

6D位姿估计

针对大视角、光照变化和低纹理场景下仅依赖2D特征匹配不稳的问题,TP3M引入与源图接近视角的参考图,用Transformer筛选源图边缘细粒度点并将其描述子融合成“伪3D”特征,再与目标图2D特征做粗到细匹配。实验显示其在单应估计、相对位姿估计和视觉定位多个数据集上达到SOTA,说明参考图带来的几何/描述增强有助于困难场景匹配。

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey Figure 1
arXiv preprint2024-05-13

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey

PAGE 1, International Journal of Computer Vision (2026) 134:81

6D位姿估计物体位姿综述

面向机器人操作、AR等场景中对可靠物体位姿的需求,本文梳理深度学习取代手工特征后仍存在的标注依赖、紧凑性、鲁棒性与未见物体泛化问题。核心贡献是按实例级、类别级和未见物体三类统一组织6D/9D位姿估计,并覆盖输入模态、训练范式、指标与数据集。主要结果是汇总各基准SOTA表现、比较方法适用条件,并指出未来方向集中在少标注泛化、复杂场景鲁棒性和实用部署。

JointLoc: A Real-time Visual Localization Framework for Planetary UAVs Based on Joint Relative and Absolute Pose Estimation Figure 1
arXiv preprint2024-05-13

JointLoc: A Real-time Visual Localization Framework for Planetary UAVs Based on Joint Relative and Absolute Pose Estimation

Xubo Luo, Xue Wan, Yixing Gao, Yaolin Tian, Wei Zhang, Leizheng Shu

University of Chinese Academy of Sciences, Beijing 101408, China, Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences, Beijing 100094, China, Key Laboratory of Space Utilization, Chinese Academy of Sciences, Beijing 100094, China

6D位姿估计相机位姿航天器

面向无 GNSS、弱纹理且卫星图与机载图像跨模态差异明显的火星无人机定位,JointLoc 将低频粗到细绝对 2-DoF 定位与视觉里程计相对 6-DoF 位姿松耦合,并用置信度自适应调节融合权重以抑制错误绝对匹配。在含仿真火星地形和 Ingenuity 实拍图的数据集上,最长 1000m 轨迹 RMSE 为 0.237m,优于 ORB-SLAM2/3 的 0.594m/0.557m。

TD-NeRF: Novel Truncated Depth Prior for Joint Camera Pose and Neural Radiance Field Optimization Figure 1
arXiv preprint2024-05-11

TD-NeRF: Novel Truncated Depth Prior for Joint Camera Pose and Neural Radiance Field Optimization

Zhen Tan, Zongtan Zhou, Yangbing Ge, Zi Wang, Xieyuanli Chen, Dewen Hu

6D位姿估计相机位姿彩色深度三维重建

TD-NeRF针对NeRF在三维重建/SLAM中依赖精确相机位姿、SfM失败后难以继续的问题,将单目深度先验显式用于未知位姿下的位姿—辐射场联合优化。其核心是基于截断正态的深度引导射线采样、由粗到细的训练以及抗深度噪声的高斯帧间点约束。三数据集实验显示其位姿估计和深度几何优于既有联合优化方法。

AHPPEBot: Autonomous Robot for Tomato Harvesting based on Phenotyping and Pose Estimation Figure 1
arXiv preprint2024-05-11

AHPPEBot: Autonomous Robot for Tomato Harvesting based on Phenotyping and Pose Estimation

Xingxu Li, Nan Ma, Yiheng Han, Shun Yang, Siyi Zheng

6D位姿估计机器人操作

针对串番茄采摘中成熟度二分类不够细、果梗细且易与背景混淆、抓拉式采摘易损伤作物等问题,AHPPEBot将多任务YOLOv5与自适应DBScan用于果穗—单果关联和表型估计,并通过果梗7个语义关键点做位姿估计,引导低接触路径规划和专用切割末端执行器。在商业温室自主实验中,系统达到86.67%采摘成功率,平均成功采摘时间32.46秒。

CasCalib: Cascaded Calibration for Motion Capture from Sparse Unsynchronized Cameras Figure 1
arXiv preprint2024-05-10

CasCalib: Cascaded Calibration for Motion Capture from Sparse Unsynchronized Cameras

Huibert Kwakernaak, Pradeep Misra Faculty of Electrical Engineering, Mathematics, Computer Science, Enschede, Dayton, USA, James Tang, Shashwat Suri, Daniel Ajisafe, Bastian Wandt

Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Enschede, The Netherlands, Department of Electrical Engineering, Wright State University, Dayton, USA, The University of British Columbia Linköping University, Bielefeld University

6D位姿估计人体姿态

针对稀疏、多视角且未同步相机进行人体动捕时,传统棋盘格标定成本高、现有人体辅助方法又常假设同步或单人场景,CasCalib将内参、外参和时间偏移的高维联合标定分解为级联子问题,依次估计焦距/地面姿态、时间偏移、地面平面外参,并用ICP与BA细化。实验在多种多视角基准上验证了其可用于多人、部分可见场景的自动化动捕标定,并开源工具箱。

MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization Figure 1
arXiv preprint2024-05-10

MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization

Pengcheng Zhu, Yaoming Zhuang, Baoquan Chen, Li Li, Chengdong Wu, Zhanlin Liu

6D位姿估计相机位姿彩色深度高斯泼溅

MGS-SLAM针对单目高斯泼溅SLAM几何不准、跟踪弱且常依赖RGB-D深度的问题,将稀疏视觉里程计位姿与3D Gaussian Splatting联合优化,并用关键帧窗口的快速MVS先验深度监督建图;深度平滑损失和SDAR用于抑制深度估计误差、维持稀疏轨迹与稠密地图尺度一致。实验显示其相机位姿精度达到或超过现有方法,并在新视角合成与几何重建上优于既有单目方案。

Free-Moving Object Reconstruction and Pose Estimation with Virtual Camera Figure 1
arXiv preprint2024-05-09

Free-Moving Object Reconstruction and Pose Estimation with Virtual Camera

Haixin Shi, Yinlin Hu, Daniel Koguciuk, Juan-Ting Lin, Mathieu Salzmann, David Ferstl

EPFL, MagicLeap

6D位姿估计三维重建

本文面向单目 RGB 中自由运动物体的三维重建与 6D 位姿估计,动机是摆脱静态场景、手姿态或类别先验等限制。核心洞察是利用 2D 掩码构造始终指向物体中心的虚拟相机,显著缩小形状与位姿联合优化的搜索空间,再回到真实相机坐标系细化。实验在 HO3D 和头戴设备自采序列上优于多数基线,并接近依赖先验的方法。

Semi-Autonomous Laparoscopic Robot Docking with Learned Hand-Eye Information Fusion Figure 1
arXiv preprint2024-05-09

Semi-Autonomous Laparoscopic Robot Docking with Learned Hand-Eye Information Fusion

Huanyu Tian, Martin Huber, Christopher E. Mower, Zhe Han, Changsheng Li, Senior Member, IEEE, Xingguang Duan, and Christos Bergeles

6D位姿估计手部姿态机器人操作

针对腹腔镜术前 trocar 对接中遮挡、手眼标定误差与接触安全带来的不稳定问题,论文提出半自主共享控制框架,将商用相机的抗遮挡6D位姿估计与自监督训练的手眼信息融合网络结合,并配合优化控制。仿真实验/模型实验显示,相比对照组位置离散度由2.47降至1.23 mm,力离散度由1.15降至0.78 N,说明其主要提升在对接精度与力顺应稳定性。

NeuRSS: Enhancing AUV Localization and Bathymetric Mapping with Neural Rendering for Sidescan SLAM Figure 1
arXiv preprint2024-05-09

NeuRSS: Enhancing AUV Localization and Bathymetric Mapping with Neural Rendering for Sidescan SLAM

Yiping Xie, Jun Zhang, Nils Bore, John Folkesson

6D位姿估计相机位姿

针对水下无 GPS 时 AUV 死 reckoning 漂移会限制侧扫声呐测深、而 SSS SLAM 又受高程退化影响的问题,NeuRSS 将神经渲染得到的海底地形作为位姿图回环相对位姿优化的高程先验,并迭代更新定位与测深。两组实测船/AUV 数据表明,相比仅插值高度计先验,该方法在复杂地形下优化更稳健,并能提升轨迹与接近 MBES 的测深图质量。

Benchmarking Neural Radiance Fields for Autonomous Robots: An Overview Figure 1
arXiv preprint2024-05-09

Benchmarking Neural Radiance Fields for Autonomous Robots: An Overview

Yuhang Ming, Xingrui Yang, Weihan Wang, Zheng Chen, Jinglun Feng, Yifan Xing, Guofeng Zhang

6D位姿估计机器人操作数据集/基准

面向自主机器人在稀疏、不完整传感数据和复杂动态环境中感知、定位与决策易退化的问题,本文系统梳理并基准比较 NeRF 在重建、分割、6D/相机位姿估计、SLAM、规划导航和交互中的用法。核心洞察是将 NeRF 作为可微、连续的三维场景表示,可缓解数据不足并支撑联合优化;主要结果是归纳各类方法的优势与瓶颈,并指出 3DGS、LLM 与生成式模型是提升效率和语义决策的关键方向。

Adversary-Guided Motion Retargeting for Skeleton Anonymization Figure 1
arXiv preprint2024-05-08

Adversary-Guided Motion Retargeting for Skeleton Anonymization

Thomas Carr, Depeng Xu

University of North Carolina at Charlotte

6D位姿估计

针对VR/动作捕捉中骨架数据虽去除外观却仍泄露身高、肢长、步态等PII的问题,论文提出PMR:用自编码器将原始动作重定向到虚拟骨架,并通过运动/隐私嵌入分类器的协同与对抗训练分离动作信息和身份信息。实验显示其运动重定向质量接近现有方法,同时降低重识别、性别等隐私攻击效果。

FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models Figure 1
arXiv preprint2024-05-08

FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models

Jinglin Xu, Yijie Guo, Yuxin Peng School of Intelligence Science, Technology, 2000012936@stu.pku.edu.cn, pengyuxin@pku.edu.cn

Wangxuan Institute of Computer Technology, Peking University

6D位姿估计人体姿态

FinePOSE针对2D到3D人体姿态映射中的深度歧义、复杂关节关系与泛化不足,认为现有方法缺少文本和人体部件先验的细粒度约束。它在扩散去噪中引入部件感知提示学习、提示-姿态交互和时间步风格化,将动作类别、速度及头/躯干/四肢信息作为隐式监督。实验在Human3.6M、MPI-INF-3DHP上优于现有方法,并在EgoHumans多人体场景达到34.3mm MPJPE。

ProbRadarM3F: mmWave Radar based Human Skeletal Pose Estimation with Probability Map Guided Multi-Format Feature Fusion Figure 1
arXiv preprint2024-05-08

ProbRadarM3F: mmWave Radar based Human Skeletal Pose Estimation with Probability Map Guided Multi-Format Feature Fusion

BING ZHU, ZIXIN HE, WEIYI XIONG, GUANHUA DING, TAO HUANG, WEI XIANG

Beihang University, Beijing, China, James CookUniversity, Cairns, Australia

6D位姿估计

针对室内医疗/养老等场景中 RGB 相机受光照、遮挡和隐私限制的问题,本文探索用毫米波雷达做人体骨架姿态估计。核心做法不是只改网络,而是从原始雷达信号并行提取 FFT 热图特征与概率图引导的位置编码特征,并进行多帧、多格式融合,以补足传统点云/热图处理中被忽略的位置信息。在 HuPR 数据集上预测 14 个人体关键点,报告 AP 达 69.9%,表明概率位置特征对雷达姿态估计有实际增益。

GISR: Geometric Initialization and Silhouette-based Refinement for Single-View Robot Pose and Configuration Estimation Figure 1
arXiv preprint2024-05-08

GISR: Geometric Initialization and Silhouette-based Refinement for Single-View Robot Pose and Configuration Estimation

Ivan Bilić, Filip Marić, Fabio Bonsignorio, Ivan Petrović

6D位姿估计机器人操作

GISR面向单目RGB下同时估计机械臂相机—机器人6D位姿与关节配置,动机是替代/补充传统手眼标定和本体传感,适应在线、动态或传感失效场景。方法先用机器人运动学几何先验做初始化,再用渲染轮廓与分割轮廓进行少量迭代细化,以减少RGB外观和渲染域差。公开数据上其精度和速度优于同类联合估计方法,约40 ms运行,较既有稠密方法快约20倍,并可接近依赖真实关节读数的位姿估计方法。

Learning Distributional Demonstration Spaces for Task-Specific Cross-Pose Estimation Figure 1
arXiv preprint2024-05-07

Learning Distributional Demonstration Spaces for Task-Specific Cross-Pose Estimation

David Held

the Robotics Institute, Carnegie Mellon University. represents

6D位姿估计

本文针对相对放置任务中“多个正确位姿”会被单峰模型平均成无效解的问题,提出 TAX-PoseD:在保持 TAX-Pose 平移不变和关系推理归纳偏置的同时,用空间接地的 cVAE 将潜变量表示为物体点云上的类别分布,从而显式选择放置模式。实验显示其仅需约 10–20 个无标注多模态示教,就能在多挂钩杯子放置等任务中跨类别实例学习精确的 6D 相对位姿,并保持较快单次前向推理。

Bayesian Simultaneous Localization and Multi-Lane Tracking Using Onboard Sensors and a SD Map Figure 1
arXiv preprint2024-05-07

Bayesian Simultaneous Localization and Multi-Lane Tracking Using Onboard Sensors and a SD Map

Yuxuan Xia, Erik Stenborg, Junsheng Fu, Gustaf Hendeby Zenseact, Gothenburg, Linköping, Sweden Email: firstname.lastname@zenseact.com, firstname.lastname@liu.se

Department of Electrical Engineering, Linköping University, Linköping, Sweden

6D位姿估计

针对高精地图车道级建图成本高的问题,本文尝试仅用量产车常见的 GNSS、单目相机与先验 SD 地图生成车道几何。核心做法是将车辆 6D 定位与多车道线估计统一为贝叶斯 SLAMOT,并用 TPMBM 处理多扩展目标数据关联,以 B-spline 控制点递归表示车道线。高速实车实验显示估计车道线与卫星图车道标线总体对齐,但仍存在横向偏移,效果仍属初步验证。

Speak the Same Language: Global LiDAR Registration on BIM Using Pose Hough Transform Figure 1
arXiv preprint2024-05-07

Speak the Same Language: Global LiDAR Registration on BIM Using Pose Hough Transform

Zhijian Qiao, Haoming Huang, Chuhao Liu, Zehuan Yu, Shaojie Shen, Fumin Zhang, Huan Yin

6D位姿估计点云

针对机器人/施工中 LiDAR 实测点云与 BIM 设计模型坐标系不一致、人工配准成本高的问题,本文利用墙面与交角作为跨模态共享结构,构造三角描述子实现与 BIM 规模无关的检索,并用 Pose Hough Transform 分层投票生成多位姿候选,再以占据感知评分验证。作者在大型大学建筑、多次采集和两类 LiDAR 上验证了可自动全局对齐,并公开数据与代码。

Pose Priors from Language Models Figure 1
arXiv preprint2024-05-06

Pose Priors from Language Models

Shiry Ginosar 2, 3 end_POSTSUPERSCRIPT

6D位姿估计

针对接触场景中遮挡使3D/6D人体位姿估计难以仅靠2D关键点恢复的问题,论文提出ProsePose:从大多模态模型中提示生成结构化接触约束,并转化为优化损失来细化初始姿态,无需额外接触标注或动捕训练。实验显示其在双人交互和瑜伽自接触数据上优于无接触监督基线,但左右肢体辨别和粗粒度接触区域仍是主要限制。

Optimizing Hand Region Detection in MediaPipe Holistic Full-Body Pose Estimation to Improve Accuracy and Avoid Downstream Errors Figure 1
arXiv preprint2024-05-06

Optimizing Hand Region Detection in MediaPipe Holistic Full-Body Pose Estimation to Improve Accuracy and Avoid Downstream Errors

Amit Moryossef

Amit Moryossef, University of Zurich

6D位姿估计手部姿态人体姿态

该文针对 MediaPipe Holistic 在手掌非正对相机时手部 ROI 启发式裁剪失准、进而影响手语识别和后续关键点检测的问题,提出用更多上肢/手部关键点及 z 维信息训练轻量 MLP 预测 ROI 中心、尺度和角度。实验在 Panoptic Hand DB 上显示中心与尺度估计更好,IoU 整体提升且最差样例由 3% 提至 16%,但旋转预测未优于原启发式,最终更适合与原旋转规则混用。

Multi-hop graph transformer network for 3D human pose estimation Figure 1
arXiv preprint2024-05-05

Multi-hop graph transformer network for 3D human pose estimation

Zaedul Islam, Montreal, Canada

Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada

6D位姿估计人体姿态

针对视频中2D到3D人体姿态估计受遮挡、深度歧义影响,以及传统GCN偏局部、Transformer易忽略关节图结构的问题,论文提出MGT-Net,将多头自注意力与可学习邻接图卷积结合,并用解耦邻域的多跳GCN和空洞卷积扩大感受野、建模长程关节依赖。实验显示其在两个基准数据集上取得有竞争力的精度,同时保持较小模型规模。

Blending Distributed NeRFs with Tri-stage Robust Pose Optimization Figure 1
arXiv preprint2024-05-05

Blending Distributed NeRFs with Tri-stage Robust Pose Optimization

Baijun Ye, Caiyun Liu, Xiaoyu Ye, Yuantao Chen, Yuhai Wang, Zike Yan, Yongliang Shi, Hao Zhao, Guyue Zhou

Institute for AI Industry Research (AIR), Tsinghua University, Beijing Institute of Technology, Xi’an University of Architecture and Technology, University of Southern California. {\dagger}

6D位姿估计三维重建

面向大规模城市 NeRF 重建中分布式子模型坐标不一致、配准精度不足导致融合遮挡和伪影的问题,本文提出三阶段位姿优化:先用可 BA 的 Mip-NeRF 360 联合优化图像位姿与场景,再以 iMNeRF 和动态低通滤波做 Frame2Model 鲁棒配准,最后进行 Model2Model 精调。实验在真实与仿真数据上显示配准与融合质量优于现有方法。

WeightedPose: Generalizable Cross-Pose Estimation via Weighted SVD Figure 1
arXiv preprint2024-05-03

WeightedPose: Generalizable Cross-Pose Estimation via Weighted SVD

Xuxin Cheng, Heng Yu, Harry Zhang, Spring 2023

6D位姿估计

面向“把物体放到另一个物体相对位置”这类操作,论文指出端到端策略难以泛化到新构型和关节/自由物体混合场景。WeightedPose 将 Goal Flow 与 TAX-Pose 的位姿预测通过可学习权重和 Weighted SVD 统一求解跨物体 6D 关系。PartNet-Mobility 实验显示其在关节部件与自由物体上整体优于单独预训练基线,但模型仍偏概念验证,权重增益来源未充分说明。

Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation Figure 1
arXiv preprint2024-05-03

Probablistic Restoration with Adaptive Noise Sampling for 3D Human Pose Estimation

Xianzhou Zeng, Hao Qin, Ming Kong, Luyuan Chen, Qiang Zhu 4 @zju.edu.cn, chenly@bistu.edu.cn

Zhejiang University, Hangzhou, China, Hikvision Research Institute, Hangzhou, China, Beijing Information Science and Technology University, Beijing, China

6D位姿估计人体姿态

针对单目3D人体姿态中2D检测误差会被lifting放大、且多假设方法通常依赖昂贵生成模型的问题,PRPose将轻量单假设HPE扩展为多假设框架:用弱监督从单假设模型误差中学习关节级自适应噪声,并反向扰动2D输入以采样多种3D姿态。Human3.6M和MPI-INF-3DHP实验显示其精度接近GFPose等SOTA,同时推理速度提升超过100倍。

An Onboard Framework for Staircases Modeling Based on Point Clouds Figure 1
arXiv preprint2024-05-03

An Onboard Framework for Staircases Modeling Based on Point Clouds

Chun Qing, Rongxiang Zeng, Xuan Wu, Yongliang Shi, Gan Ma

6D位姿估计点云

面向腿足机器人在楼梯场景中需要可靠识别可通行踏面并获得几何导航参数的问题,本文提出基于点云的机载端到端框架,用 PointNet++ 做实例分割,并结合点云增强、CSCE 边界抑制损失和基于楼梯位姿的测量校正来估计踏面中心、法向、高度与深度。作者自建含不同光照和视角的数据集及评价指标,实验显示该方法较 VoxelSAC 等基线在精度与泛化上更好,但具体增益可能部分来自数据增强和自建数据分布。

ShadowNav: Autonomous Global Localization for Lunar Navigation in Darkness Figure 1
arXiv preprint2024-05-06

ShadowNav: Autonomous Global Localization for Lunar Navigation in Darkness

Deegan Atha 1 ^{ }, R. Michael Swan 1 ^{ }, Abhishek Cauligi 1 ^{ }, Anne Bettens 1, Edwin Goh 1 ^{ }, Dima Kogan 1 ^{ }, Larry Matthies 1 ^{ }, Masahiro Ono 1 ^{ }

Jet Propulsion Laboratory (JPL), California Institute of Technology (Caltech), Pasadena, CA, United States of America, University of Sydney, Camperdown NSW 2050, Australia

6D位姿估计

面向月球车夜间或永久阴影区长距离自主行驶中相对定位漂移、地面人工全局校正受通信限制的问题,ShadowNav利用车载双目相机和主动照明提取月坑前缘/坑缘作为地标,并以Q-Score匹配离线轨道地图中的已知月坑,再用粒子滤波更新6D全局位姿。论文在月面仿真和亚利桑那Cinder Lakes新月夜实测数据上评估感知、硬件配置与轨迹影响,结果表明该思路可间歇降低全局位姿不确定性,但具体相对增益和鲁棒边界仍需结合完整数值解读。

IntervenGen: Interventional Data Generation for Robust and Data-Efficient Robot Imitation Learning Figure 1
arXiv preprint2024-05-02

IntervenGen: Interventional Data Generation for Robust and Data-Efficient Robot Imitation Learning

Ryan Hoque, Ajay Mandlekar, Caelan Garrett, Ken Goldberg, Dieter Fox

UC Berkeley, NVIDIA

6D位姿估计机器人操作

针对模仿学习在部署时受物体6D位姿估计误差等分布偏移影响、交互式纠错采集成本高的问题,IntervenGen利用少量人工干预,通过将纠正轨迹变换到不同场景和错误分布中自动合成大量干预数据。实验覆盖4个仿真和1个真实环境的高精度操作任务,仅10次人工干预即可最高提升鲁棒性39倍,并优于更多人工干预的数据预算。

Behavior Imitation for Manipulator Control and Grasping with Deep Reinforcement Learning Figure 1
arXiv preprint2024-05-02

Behavior Imitation for Manipulator Control and Grasping with Deep Reinforcement Learning

Liu Qiyuan

6D位姿估计

该工作针对传统机器人动作模仿依赖大量 MoCap 专家数据、采集成本高的问题,将单目视频的 3D 人体姿态估计、人体到机械臂的形态重定向与深度强化学习结合,把模仿转化为关节角策略预测。系统在 PyBullet/KUKA iiwa 上由短视频生成参考运动并训练策略,可迁移到未见视频的手臂动作;但具体定量增益和抓取效果在给定文本中未充分说明。

Sports Analysis and VR Viewing System Based on Player Tracking and Pose Estimation with Multimodal and Multiview Sensors Figure 1
arXiv preprint2024-05-02

Sports Analysis and VR Viewing System Based on Player Tracking and Pose Estimation with Multimodal and Multiview Sensors

Wenxuan Guo 0009-0007-4823-1587, Zhiyu Pan 0009-0000-6721-4482, Ziheng Xi0009-0008-7007-8803, Alapati Tuerxun0009-0004-5513-4783, Jianjiang Feng 0000-0003-4971-6707, Jie Zhou0000-0001-7701-234X

6D位姿估计多视角

面向现有 VR/AR 观赛依赖大规模相机阵列、成本高且难实时的问题,论文构建了多视角 LiDAR+相机采集、多人跟踪、3D姿态估计与可驱动 avatar 渲染的一体化体育分析系统,并提出融合点云与图像的跟踪/姿态框架,在约1.1万帧真实篮球数据上验证了精度和鲁棒性;但道具建模与跟踪仍未覆盖。

CoViS-Net: A Cooperative Visual Spatial Foundation Model for Multi-Robot Applications Figure 1
arXiv preprint2024-05-02

CoViS-Net: A Cooperative Visual Spatial Foundation Model for Multi-Robot Applications

Jan Blumenkamp, Steven Morad, Jennifer Gielis, Amanda Prorok

Department of Computer Science and Technology, University of Cambridge, United Kingdom

6D位姿估计机器人操作

多机器人在室内外无 GNSS、无视野重叠时仍需实时相对位姿与局部空间理解,传统视觉匹配和显式检测受限明显。CoViS-Net用冻结 DINOv2 编码单目图像,在机器人间交换视觉嵌入,通过 Transformer 估计带偶然不确定性的相对位姿,并聚合生成局部 BEV。论文在仿真和真实编队控制中验证了无需既有网络基础设施、可机载实时运行,且在无相机重叠场景仍能给出可用于控制的粗略相对位姿。

HandSSCA: 3D Hand Mesh Reconstruction with State Space Channel Attention from RGB images Figure 1
arXiv preprint2024-05-04

HandSSCA: 3D Hand Mesh Reconstruction with State Space Channel Attention from RGB images

Zixun Jiao, Xihan Wang, Zhaoqiang Xia, Lianhe Shao, Xi’an, China, China corresponding author

Xi’an Polytechnic University, Xi’an, China, Northwestern Polytechnical University, Xi’an, China

6D位姿估计手部姿态三维重建

针对单张 RGB 手部三维网格重建中遮挡严重、依赖额外先验或 Transformer 注意力计算开销大的问题,HandS3C 将状态空间模型引入该任务,设计空间—通道并行扫描的 S3C 注意力以扩大有效感受野并补偿通道信息。实验在 FREIHAND、DEXYCB、HO3D 上报告达到 SOTA,同时参数量较小。

Radar-Based Localization For Autonomous Ground Vehicles In Suburban Neighborhoods Figure 1
arXiv preprint2024-05-01

Radar-Based Localization For Autonomous Ground Vehicles In Suburban Neighborhoods

Andrew J. Kramer Amazon, Boulder christoffer.heckman@colorado.edu

Amazon, LLC, University of Colorado, Boulder

6D位姿估计

面向郊区人行道等场景中 GPS 精度不足、视觉受天气光照影响、激光雷达易受几何歧义干扰的问题,论文提出基于低成本车规毫米波雷达的定位系统,结合雷达-惯性里程计、动态外点剔除、雷达航向约束,以及可用于重定位的雷达地图注册。实验显示其相对位姿与全局重定位精度、可靠性接近已有雷达定位结果,并优于同类激光雷达适配方法,同时可在低功耗嵌入式硬件上运行。

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging Figure 1
arXiv preprint2024-04-30

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging

Rayan Armani, Changlin Qian, Jiaxi Jiang, Christian Holz

Department of Computer Science, ETH Zürich

6D位姿估计人体姿态

针对稀疏 IMU 人体动捕易漂移、抖动且依赖专有姿态输入的问题,Ultra Inertial Poser 在6个可穿戴节点中加入无固定锚点的 UWB 互距测量,并用图神经网络融合原始惯性信号与传感器间距离来估计 SMPL 全身姿态和位移。作者用 AMASS 合成训练并发布 UIP-DB;相较 PIP/TIP,位置误差由13.62降至10.65 cm,抖动降低约97%。

UniFS: Universal Few-shot Instance Perception with Point Representations Figure 1
arXiv preprint2024-04-30

UniFS: Universal Few-shot Instance Perception with Point Representations

Sheng Jin 0000-0001-5736-7434, Ruijie Yao 0009-0007-4736-9453, Lumin Xu 0000-0003-2125-2760, Wentao Liu 0000-0001-6587-9878, Chen Qian 0000-0002-8761-5563 Ji Wu 0000-0001-6170-726X, Ping Luo 0000-0002-6685-7950

6D位姿估计

针对少样本实例感知长期依赖任务专用模型、标注成本高且难以统一检测/分割/姿态/计数的问题,UniFS将各类输出重写为由支持集点标注提示的动态点表示学习,并用SAPL建模中心点与邻域点的结构关系以提升鲁棒性。作者还整理COCO-UniFS统一基准;在尽量少任务假设和共享参数下,结果接近多种专门优化模型,但具体收益在多大程度来自联合数据与任务共享仍需进一步拆解。

Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training Figure 1
arXiv preprint2024-04-30

Quater-GCN: Enhancing 3D Human Pose Estimation with Orientation and Semi-supervised Training

Xingyu Song, Zhan Li, Shi Chen, Kazuyuki Demachi

The University of Tokyo

6D位姿估计人体姿态

该文针对单目 2D-to-3D 人体姿态提升中仅回归关节坐标、忽略骨骼朝向而易在遮挡或肢体交互时产生歧义的问题,提出 Quater-GCN:用有向 GCN 同时建模关节空间依赖与 2D 骨骼旋转,并回归 3D 骨骼四元数朝向;同时通过将预测朝向投影回 2D 旋转来利用无标注数据,缓解朝向真值稀缺。实验称其优于现有方法,但具体增益来源需结合消融判断。

XFeat: Accelerated Features for Lightweight Image Matching Figure 1
arXiv preprint2024-04-30

XFeat: Accelerated Features for Lightweight Image Matching

LORIA, Inria Microsoft @dcc.ufmg.br, renato.martins@u-bourgogne.fr, andrearaujo@google.com

Google Research, Université de Lorraine, LORIA, Inria Microsoft

6D位姿估计

面向移动机器人、AR 等算力受限场景中高分辨率图像匹配开销过大的问题,XFeat 重新设计轻量 CNN,将早期高分辨率层通道压到很小并随下采样快速增宽,配合简洁可学习关键点分支与基于粗描述子的半稠密匹配细化模块,同时支持稀疏和半稠密匹配。实验显示其在位姿估计、视觉定位和单应估计中保持接近或优于较大模型的精度,较现有轻量深度特征最高约快 5 倍,并可在普通笔记本 CPU 实时运行。

Self-Avatar Animation in Virtual Reality: Impact of Motion Signals Artifacts on the Full-Body Pose Reconstruction Figure 1
arXiv preprint2024-04-29

Self-Avatar Animation in Virtual Reality: Impact of Motion Signals Artifacts on the Full-Body Pose Reconstruction

Antoine Maiorca, Seyed Abolfazl Ghasemzadeh, Thierry Ravet, François Cresson, Thierry Dutoit, Christophe De Vleeschouwer

ISIA Lab, University of Mons

6D位姿估计人体姿态三维重建

面向消费级 VR 缺少下肢追踪导致自我化身全身动画存在姿态歧义的问题,本文不侧重提出新模型,而是系统评估外部 RGB(D) 三维关节位置引入后的信号缺陷影响,包括跨源延迟、帧率不一致、遮挡和位姿估计噪声,并用 AvatarPoser、HybridTrack 及 YOLOv8 重建坐标进行对比。结果显示现有重建方法对这些退化普遍敏感,速度误差尤其明显,提示实际系统中同步与观测质量可能比模型结构同样关键。

Mesh-based Photorealistic and Real-time 3D Mapping for Robust Visual Perception of Autonomous Underwater Vehicle Figure 1
arXiv preprint2024-04-29

Mesh-based Photorealistic and Real-time 3D Mapping for Robust Visual Perception of Autonomous Underwater Vehicle

Jungwoo Lee, Younggun Cho

6D位姿估计

面向水下 AUV 在雾化、低对比和算力受限条件下难以稳定定位并生成可检查裂缝等细节地图的问题,论文将 Transformer 水下图像增强 Joint-ID 接入 ORB-SLAM2 位姿估计,并用特征点采样、Delaunay 三角化、离群剔除与滑窗网格扩展实现轻量实时的照片级稠密 3D mesh 建图。实验在真实水下数据上做定性展示、在合成水下场景上做定量验证,显示定位与建图质量有所改善,但具体增益幅度文中未充分说明。

Reconstructing Satellites in 3D from Amateur Telescope Images Figure 1
arXiv preprint2024-04-29

Reconstructing Satellites in 3D from Amateur Telescope Images

Zhiming Chang, Boyang Liu, Yifei Xia, Youming Guo, Boxin Shi, He Sun

Processing and National Engineering Research Center of Visual Technology, School of Computer Science, Peking University, Beijing, China (

6D位姿估计航天器

面向低成本空间态势感知,论文针对地基业余望远镜图像中大气湍流、低信噪比、视角稀疏和位姿未知导致的卫星三维重建难题,提出结合混合图像预处理、受控 Gaussian Splatting 与 Branch-and-Bound 搜索的联合位姿估计/重建框架。方法在合成数据及天宫、ISS 实测观测上优于 NeRF 基线,并用 SSIM、PSNR、LPIPS、Chamfer 与消融验证各模块作用。

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs Figure 1
arXiv preprint2024-04-27

Hybrid 3D Human Pose Estimation with Monocular Video and Sparse IMUs

Yiming Bao, Xu Zhao, Dahong Qian, Member, IEEE, Senior Member

the School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China, the Department of Automation, Shanghai Jiao Tong University, Shanghai, China

6D位姿估计人体姿态

针对单目视频3D人体姿态易受深度歧义、遮挡和时序抖动影响的问题,论文提出RTOF,将稀疏IMU方向直接嵌入参数化骨架做运动学细化,并用视觉与惯性联合能量进行片段级在线优化以兼顾实时性。实验在Total Capture上将MPJPE由64.6mm降至33.7mm,无2D误差输入时达23.2mm,并提升姿态平滑性。

Localization Through Particle Filter Powered Neural Network Estimated Monocular Camera Poses Figure 1
arXiv preprint2024-04-26

Localization Through Particle Filter Powered Neural Network Estimated Monocular Camera Poses

PAGE 1, Yi Shen*a, Hao Liub, Xinxin Liuc, Wenjing Zhoua, Chang Zhoud, Yizhou Chene

aUniversity of Michigan, MI, USA;bNortheastern University, Shenyang, China; cUniversity of, Pennsylvania, PA, USA; dColumbia University, NY, USA; eCarnegie Mellon University, PA, USA

6D位姿估计相机位姿

针对单目相机成本低但缺乏深度、CNN 位姿估计分布不均导致轨迹平移误差的问题,论文在既有 Siamese/GoogleNet 定位框架后加入 SIR 粒子滤波,在 SE(3) 上传播均匀粒子并用 CNN 位姿更新权重。实验显示旋转精度并非稳定提升,但平移误差明显降低,轨迹也更平滑;不过控制输入由真值差分加噪构造,实际闭环增益来源仍需进一步说明。

SLAM for Indoor Mapping of Wide Area Construction Environments Figure 1
arXiv preprint2024-04-26

SLAM for Indoor Mapping of Wide Area Construction Environments

V. Ress, W. Zhang, D. Skuddis, N. Haala, U. Soergel

Institute for Photogrammetry and Geoinformatics, University of Stuttgart, Germany

6D位姿估计相机位姿

面向无 GNSS、弱纹理且光照复杂的大型厂房/施工现场数字化监测,论文用搭载四目立体相机与 3D LiDAR 的移动机器人比较视觉与激光 SLAM,并引入 3D Gaussian Splatting 生成可视化和深度图。结果显示 LiDAR 地图几何误差更低(均值约 4.1cm vs 视觉 7.4cm),视觉点云更密但噪声和半静态物体残影更明显;Gaussian Splatting 可改善细节深度与新视角渲染。

WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Users Figure 1
arXiv preprint2024-04-25

WheelPose: Data Synthesis Techniques to Improve Pose Estimation Performance on Wheelchair Users

William Huang, Sam Ghahremani, Siyou Pei, Yang Zhang

University of California, Los Angeles

6D位姿估计

WheelPose针对现有姿态估计模型在轮椅用户上因训练数据代表性不足而出现的检测与关键点错误,提出可配置的Unity合成数据流水线,将动捕/动作生成结果、轮椅与人物模型、背景和姿态随机化结合生成数据。人工评估显示合成图像具备较好真实感且多样性高于既有图像集;用其微调常见模型后,轮椅用户的人体检测和姿态估计性能提升,说明增益可能主要来自更覆盖该人群与遮挡形态的数据。

Transformer-Based Local Feature Matching for Multimodal Image Registration Figure 1
arXiv preprint2024-04-25

Transformer-Based Local Feature Matching for Multimodal Image Registration

Remi Delaunay, Ruisi Zhang, Filipe C. Pedrosa, Navid Feizi, Dianne Sacco, Rajni Patel, Jayender Jagadeesan

Harvard Medical School, MA, USA, Western University, ON, Canada, Canadian Surgical Technologies and Advanced Robotics, ON, Canada

6D位姿估计

针对超声视野小、噪声强且需外部跟踪器初始化的术中配准痛点,本文将 LoFTR 改造成 2D 超声到 3D CT 的跨模态稠密匹配框架,并加入可微位姿估计,使训练直接优化刚体位姿误差。在离体猪肾数据上,LoFTR-DWP 明显优于基线和 RANSAC 版本,67% 预测达到成功初始化;再接传统优化后中位误差降至 5.06°、4.95 mm。

DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimation Figure 1
Electronics Letters (ISSN: 00135194), jaar: 2024, volume: 60, nummer: 8, startpagina: ?2024-04-25

DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimation

Leandro Di Bella, Yangxintong Lyu, Adrian Munteanu

6D位姿估计

针对单目车辆6D位姿估计逐帧处理导致视频中姿态抖动、遮挡和远距离目标不稳定的问题,DeepKalPose在现有图像式估计器后加入深度学习卡尔曼滤波,采用前后向双向离线平滑和可学习运动模型刻画非线性车辆运动。在KITTI上相较D4LCN、Mono6D及模型式KF提升位姿精度与时序一致性,遮挡和远距离场景ARED明显下降,但在线应用受离线处理限制。

Efficient Solution of Point-Line Absolute Pose Figure 1
arXiv preprint2024-04-25

Efficient Solution of Point-Line Absolute Pose

Petr Hruby ETH Zürich, Marc Pollefeys ETH Zürich, Microsoft

ETH Zürich, University of Washington, ETH Zürich, Microsoft

6D位姿估计

面向视觉定位、SLAM/SfM中点线特征并存但混合最小位姿求解器偏重的问题,论文重新分析P2P1L与P1P2L的代数结构,将所需一元多项式次数分别由4降到2、由8降到4,并给出易实现求解器;合成与RANSAC实验显示其数值稳定,在同类方法上最高接近一个数量级加速。

COBRA -- COnfidence score Based on shape Regression Analysis for method-independent quality assessment of object pose estimation from single images Figure 1
arXiv preprint2024-04-25

COBRA -- COnfidence score Based on shape Regression Analysis for method-independent quality assessment of object pose estimation from single images

Computer Systems, Independent researcher

National Technical University of Athens Institute of Communication & Computer Systems, Independent researcher

6D位姿估计物体位姿

面向机器人抓取与跟踪中“位姿估计结果是否可信”的运行时需求,COBRA不依赖具体6D位姿网络,而是用高斯过程混合从稀疏表面点构建可解释的函数形状模板,并以单目图像反投影点在模板上的平均概率作为置信分数。实验表明该轻量模板能较准确刻画物体几何,所得分数与真实位姿质量保持一致,可作为方法无关的质量评估信号。

MegaParticles: Range-based 6-DoF Monte Carlo Localization with GPU-Accelerated Stein Particle Filter Figure 1
arXiv preprint2024-04-25

MegaParticles: Range-based 6-DoF Monte Carlo Localization with GPU-Accelerated Stein Particle Filter

Kenji Koide, Shuji Oishi, Masashi Yokozuka, Atsuhiko Banno

6D位姿估计

针对6DoF三维定位中无初值初始化、绑架后重定位和多峰歧义难以用传统扫描匹配或少粒子MCL处理的问题,本文将Stein粒子滤波大规模GPU化,结合近似Gauss-Newton SVGD、LSH邻域搜索和动态邻居粒子图传播后验。在单GPU上可实时评估百万粒子,室内重复结构和室外变化场景实验显示其能从均匀先验收敛,并对完整传感器遮挡后的重定位保持鲁棒。

3D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement Figure 1
arXiv preprint2024-04-24

3D Human Pose Estimation with Occlusions: Introducing BlendMimic3D Dataset and GCN Refinement

Filipa Lino, Carlos Santiago, Robotics, LARSyS, Instituto Superior Técnico, Portugal @tecnico.ulisboa.pt, manuel@isr.tecnico.ulisboa.pt

Institute for Systems and Robotics, LARSyS, Instituto Superior Técnico, Portugal

6D位姿估计人体姿态数据集/基准

针对单目 3D 人体姿态估计在遮挡场景中数据稀缺、关键点歧义大的问题,论文构建了 Blender 合成的 BlendMimic3D,覆盖自遮挡、物体遮挡和出框遮挡,并提出可插拔的时空 GCN 姿态精炼模块,无需重训 VideoPose3D、PoseFormerV2、D3DP 等主干。实验显示该模块在遮挡姿态上有明显改进,非遮挡场景性能基本保持。

SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation Figure 1
arXiv preprint2024-04-23

SMPLer: Taming Transformers for Monocular 3D Human Shape and Pose Estimation

Xiangyu Xu, Lijuan Liu, Shuicheng Yan

6D位姿估计

针对单目3D人体形状与姿态估计中Transformer全注意力随高分辨率特征长度二次增长、难以利用细粒度信息的问题,SMPLer将注意力解耦为目标-特征与目标-目标交互,并用SMPL参数化目标替代密集顶点表示,进一步加入多尺度与关节感知注意力。在Human3.6M上MPJPE达45.2mm,较Mesh Graphormer误差降低超过10%,参数量不足其三分之一。

Domain adaptive pose estimation via multi-level alignment Figure 1
icme20242024-04-23

Domain adaptive pose estimation via multi-level alignment

Yugan Chen, Lin Zhao, Yalong Xu, Honglei Zu, Xiaoqi An, Guangyu Li

Nanjing University of Science and Technology

6D位姿估计

该文针对合成有标注数据到真实无标注数据的姿态估计迁移问题,指出仅做图像级或姿态级单层对齐难以充分弥合域差。方法在 mean-teacher 框架下联合图像风格迁移、带梯度反转的特征对抗对齐,以及信息最大化自监督的姿态级约束。实验在人和动物跨域姿态估计上优于既有方法,SURREAL→LSP 达 84.4%,较 SOTA 高 2.4%,狗和羊任务最高分别提升 3.1% 与 1.4%。

Semi-supervised 2D Human Pose Estimation via Adaptive Keypoint Masking Figure 1
arXiv preprint2024-04-23

Semi-supervised 2D Human Pose Estimation via Adaptive Keypoint Masking

Kexin Meng

Beijing University of Chemical Technology

6D位姿估计人体姿态

针对半监督2D人体姿态估计中标注昂贵、固定关键点遮挡未区分样本与关节难度的问题,论文在教师-学生框架中用关键点后验估计姿态学习难度,动态调整遮挡数量,并加入图像/特征级 Mixup 的双分支强增强以提升鲁棒性。COCO 仅1K标注和 MPII 设置下分别较已有半监督方法提升约5.2%和0.3%,但后者增益较小。

UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cues Figure 1
arXiv preprint2024-04-23

UPose3D: Uncertainty-Aware 3D Human Pose Estimation with Cross-View and Temporal Cues

Vandad Davoodnia 0000-0002-2167-2119, Saeed Ghorbani 0000-0002-3227-9013, Marc-André Carbonneau 0000-0002-0677-415X, Alexandre Messier, Ali Etemad 0000-0001-7128-0220

6D位姿估计人体姿态

UPose3D针对多视角3D人体姿态在遮挡、噪声和相机数量变化下依赖精确2D检测及3D标注的问题,提出不确定性感知的姿态编译器:将各视角关键点投影为参考视角点云,用点云Transformer融合跨视角信息,并结合时序编码与合成多视角运动数据训练。实验在Human3.6m、RICH、HUMBI、CMU Panoptic上显示其在OOD设置优于既有方法,InD下接近3D监督方法,并在仅2D监督方法中领先。

DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimation Figure 1
arXiv preprint2024-04-22

DHRNet: A Dual-Path Hierarchical Relation Network for Multi-Person Pose Estimation

Yonghao Dang, Jianqin Yin, Liyuan Liu, Pengxiang Ding, Yuan Sun, Yanzhu Hu

6D位姿估计

针对多人姿态估计中遮挡、拥挤场景下仅建模实例关系或关节关系不足的问题,DHRNet提出CNN单阶段框架,用双路径交互模块以“实例到关节”和“关节到实例”两种互补顺序联合建模跨人和跨关节关系,并通过自适应融合与姿态解码强化关键点定位。在COCO、CrowdPose和OCHuman上取得新的SOTA,说明互补关系建模对复杂多人场景有效。

CT-NeRF: Incremental Optimizing Neural Radiance Field and Poses with Complex Trajectory Figure 1
arXiv preprint2024-04-23

CT-NeRF: Incremental Optimizing Neural Radiance Field and Poses with Complex Trajectory

Yunlong Ran, Yanxu Li, Qi Ye, Yuchi Huo, Zechun Bai, Jiahao sun, Jiming chen

Zhejiang University, Shandong University

6D位姿估计三维重建

CT-NeRF针对NeRF依赖精确相机位姿、在大旋转等复杂轨迹下联合优化易陷入局部最优的问题,提出仅用RGB序列的增量式位姿与场景重建框架;其关键是在局部-全局BA中加入邻接帧位姿图,并用学习到的像素对应产生重投影几何距离约束,补足单纯光度损失的弱点。在NeRFBuster和Free-Dataset上,该方法在新视角合成质量和位姿估计精度上优于现有方法。

Resampling-free Particle Filters in High-dimensions Figure 1
arXiv preprint2024-04-21

Resampling-free Particle Filters in High-dimensions

Akhilan Boopathy, Aneesh Muppidi, Peggy Yang, Abhiram Iyer, William Yue, Ila Fiete

MIT

6D位姿估计

高维机器人状态估计中,传统粒子滤波的重采样会加剧粒子贫化,使后验覆盖不足。本文提出无重采样粒子滤波,通过粒子流直接跟踪后验密度,并给出维度无关的近似/收敛分析。实验在高维合成定位和视频驱动的6D位姿估计上验证有效性,但运行复杂度为O(n²T),大粒子数场景仍可能受限。

Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds Figure 1
arXiv preprint2024-04-18

Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds

Oliver Lemke, Zuria Bauer, René Zurbrügg, Marc Pollefeys, Francis Engelmann, Hermann Blum

Seed Awards funded by the ETH Zurich Foundation

6D位姿估计未知物体点云机器人操作

面向家庭等人类环境中“按自然语言找物并操作”的需求,Spot-Compose 将预扫描点云、OpenMask3D 开放词汇实例分割、AnyGrasp 抓取估计、导航位姿联合优化与抽屉运动轴估计模块化接入 Spot SDK,可处理未知物体取放和抽屉开启。真实实验中动态取物成功率为 51%,抽屉开启为 82%;限制主要是 3D 分割和多视角抓取推理延迟较高。

Gait Recognition from Highly Compressed Videos Figure 1
arXiv preprint2024-04-18

Gait Recognition from Highly Compressed Videos

Andrei Niculae, Andy Catruna, Adrian Cosma, Daniel Rosner, Technology Politehnica Bucharest

National University of Science and Technology Politehnica Bucharest

6D位姿估计人体姿态

针对监控视频强压缩、低分辨率导致姿态估计失准并拖累步态识别的问题,论文不直接微调HRNet,而是在其前端加入任务适配的伪影校正模型,并用高质量视频自动生成的姿态标签训练。实验显示该两阶段方案在压缩视频上提升姿态AP与步态识别准确率,同时基本保留未退化视频性能,优于直接微调策略。

Mushroom Segmentation and 3D Pose Estimation from Point Clouds using Fully Convolutional Geometric Features and Implicit Pose Encoding Figure 1
arXiv preprint2024-04-17

Mushroom Segmentation and 3D Pose Estimation from Point Clouds using Fully Convolutional Geometric Features and Implicit Pose Encoding

George Retsinas, Niki Efthymiou, Petros Maragos School of Electrical, Computer Engineering, Greece @central.ntua.gr, maragos@cs.ntua.gr

School of Electrical and Computer Engineering, National Technical University of Athens, Greece

6D位姿估计点云

面向蘑菇自动采摘中真实点云3D标注稀缺、遮挡和姿态估计困难的问题,论文用合成蘑菇场景生成可监督数据,并在FCGF式稀疏3D卷积骨干上预测逐点“隐式位姿编码”,再通过聚类完成实例分割与6D位姿恢复。方法在合成测试集上验证有效,并给出少量真实多视角深度点云的定性结果;真实场景量化泛化能力文中未充分说明。

GeoReF: Geometric Alignment Across Shape Variation for Category-level Object Pose Refinement Figure 1
arXiv preprint2024-04-17

GeoReF: Geometric Alignment Across Shape Variation for Category-level Object Pose Refinement

Linfang Zheng, Tze Ho Elden Tse, Chen Wang, Yinghan Sun, Hua Chen, Ales Leonardis, Wei Zhang

Intelligent Manufacturing, Southern University of Science and Technology, China, Department of Computer Science, the University of Hong Kong, China, School of Computer Science, University of Birmingham, UK

6D位姿估计物体位姿类别级位姿

GeoReF面向类别级6D位姿细化中同类物体形状差异大、观测点云与类别形状先验不一致的问题。方法在几何特征提取中引入HS-layer与可学习仿射对齐,并用跨点云变换更早融合观测与先验,同时将先验用于平移和尺寸误差预测。实验在两个类别级数据集上优于现有方法,REAL275上5°5cm较SPD提升39.1%,10°2cm较CATRE提升10.5%。

CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation Figure 1
arXiv preprint2024-04-17

CorrNet+: Sign Language Recognition and Translation via Spatial-Temporal Correlation

Lianyu Hu, Wei Feng, Liqing Gao, Zekang Liu, Liang Wan

6D位姿估计

针对手语理解中常见的逐帧特征提取忽略跨帧手部、面部轨迹的问题,CorrNet+用相关性模块建模局部时空匹配、识别模块动态突出信息区域,并加入时间注意力评估关键帧贡献,无需额外姿态估计或热图监督。其在CSLR与SLT多个基准上达到新SOTA,相比CorrNet提升精度且计算量约减半,但与仓库“6D位姿”分类关联不强。

HumMUSS: Human Motion Understanding using State Space Models Figure 1
arXiv preprint2024-04-16

HumMUSS: Human Motion Understanding using State Space Models

Arnab Mondal Mila, Apple arnab.mondal@mila.quebec, Stefano Alletto Apple salletto@apple.com, Denis Tome Apple d_tome@apple.com

6D位姿估计

针对 Transformer 在长视频与实时逐帧人体运动理解中速度、显存和帧率泛化受限的问题,HumMUSS 用无注意力的时空状态空间模型替代自注意力,通过交替的空间/时间 Gated Diagonal SSM 块建模关键点序列,并利用连续时间特性适配动态帧率。实验显示其在 3D 姿态估计、人体网格恢复和动作识别上接近或达到 Transformer 方法精度,因果实时版本在保持精度的同时实现更低内存和数倍更快推理。

Invariant Kalman Filtering with Noise-Free Pseudo-Measurements Figure 1
arXiv preprint2024-04-16

Invariant Kalman Filtering with Noise-Free Pseudo-Measurements

Sven Goffin, Silvère Bonnabel, Olivier Brüls, Pierre Sacré

6D位姿估计

针对机械系统中IMU位姿估计常伴随刚性连杆等确定性等式约束、传统EKF投影处理缺乏一致性的问题,论文将约束建模为无噪声伪量测,并推导在量测噪声趋零和协方差秩亏时仍可用的卡尔曼增益,再嵌入IEKF/Lie群框架以保持约束子空间内的不确定性。吊车吊钩扩展位姿仿真中,该方法较EKF和常规IEKF收敛更快、方差更小,但文中也指出大残差线性化时仍可能发散。

The Unreasonable Effectiveness of Pre-Trained Features for Camera Pose Refinement Figure 1
arXiv preprint2024-04-16

The Unreasonable Effectiveness of Pre-Trained Features for Camera Pose Refinement

Gabriele Trivigno, Carlo Masone, Barbara Caputo, Robotics, Cybernetics, torsten.sattler@cvut.cz

Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague

6D位姿估计相机位姿

本文质疑相机位姿精修是否必须为每个场景训练专用特征或隐式表示,核心洞察是渲染-比较框架只需可靠衡量真实图像与合成视图的相似性。作者用通用预训练密集特征作为代价函数,结合可渲染场景表示与粒子滤波进行6DoF位姿搜索,无需微调或可微优化管线。实验显示 MCLoc 在室内、室外及大规模场景中优于现代位姿回归器,并与或超过多种逐场景训练的隐式场精修方法,同时可作为匹配式定位的前后处理提升结果。

GaitPoint+: A Gait Recognition Network Incorporating Point Cloud Analysis and Recycling Figure 1
arXiv preprint2024-04-16

GaitPoint+: A Gait Recognition Network Incorporating Point Cloud Analysis and Recycling

Huantao Ren, Jiajing Chen, Senem Velipasalar

6D位姿估计人体姿态点云

针对步态识别中轮廓易受服饰/携物影响、骨架又存在姿态估计误差且二者融合不足的问题,GaitPoint+将骨架关键点序列建模为3D点云,用轻量PointNet式模块提取骨架特征并与CNN轮廓特征融合;其关键洞察是传统max-pooling丢弃了不少有用关节点特征,因此引入仅训练阶段使用的Recycling Max-Pooling回收信息。CASIA-B实验显示,该模块可稳定提升三种轮廓基线,且在背包、厚衣等外观变化场景增益更明显。

LWIRPOSE: A novel LWIR Thermal Image Dataset and Benchmark Figure 1
arXiv preprint2024-04-16

LWIRPOSE: A novel LWIR Thermal Image Dataset and Benchmark

Avinash Upadhyay

6D位姿估计数据集/基准

针对热红外人体姿态估计缺少大规模、高质量标注数据,LWIRPOSE构建了含2400余张LWIR图像及近配对RGB图像的数据集,覆盖7名演员、12类日常活动、多服装与遮挡场景,并以17个关键点人工校正标注。论文还将HRNet等RGB姿态方法迁移/微调到热成像上建立基准,结果表明该数据可支撑低光、遮挡等场景下的2D姿态研究,但具体性能增益幅度文中未充分说明。

LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives Figure 1
arXiv preprint2024-04-15

LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives

Jiadi Cui, Junming Cao, Fuqiang Zhao, Zhipeng He, Yifan Chen, Yuhui Zhong, Lan Xu, Yujiao Shi, Yingliang Zhang, Jingyi Yu

ShanghaiTech University, Shanghai, Stereye Intelligent Technology Co.,Ltd, Shanghai Advanced Research Institute, Chinese Academy of Sciences, University of Chinese Academy of Sciences, NeuDim Digital Technology (Shanghai) Co.,Ltd, DGene Digital Technology Co., Ltd

6D位姿估计点云高斯泼溅

针对地下车库低纹理、重复结构、反光/透明物体导致 SfM 与纯视觉 3DGS 易失效的问题,LetsGo 用自研 Polar 采集 IMU-LiDAR-鱼眼数据,将校准 LiDAR 点云、深度正则与多分辨率高斯 LOD 表示结合,减少漂浮伪影并支持轻量端实时渲染。作者构建 8 个大规模车库 GarageWorld,并在该数据集及 ScanNet++、KITTI-360 上报告了更好的渲染质量与资源效率。

In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition Figure 1
arXiv preprint2024-04-14

In My Perspective, In My Hands: Accurate Egocentric 2D Hand Pose and Action Recognition

Wiktor Mucha, Martin Kampel Computer Vision Lab, TU Wien, Favoritenstr. 9/193-1, 1040 Vienna, Austria

Computer Vision Lab, TU Wien, Favoritenstr. 9/193-1, Vienna, Austria

6D位姿估计手部姿态

针对第一视角动作识别依赖3D手姿态、需深度估计或不便传感器的问题,论文转向单目RGB可获得的2D手部骨架,提出单手EffHandNet和面向双手—物体交互的EffHandEgoNet,并结合YOLOv7物体框与Transformer做动作分类。在H2O与FPHA上分别达到91.32%和94.43%准确率,推理更快且超过多种3D方法。

DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detector Figure 1
arXiv preprint2024-04-13

DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detector

Johan Edstedt, Georg Bökman

Linköping University, Chalmers University of Technology, The Chinese University of Hong Kong, Texas A&M University

6D位姿估计

本文针对 DeDoDe 关键点检测器在多视图匹配/相对位姿估计中存在的关键点聚集、旋转敏感和训练目标与下游性能不一致等问题做系统分析。核心改动是在训练目标分布上加入 NMS、增强 90°旋转与翻转,并用 RoMa 匹配评估两视图位姿,发现长训练反而损害下游效果,因此将训练缩短到约 20 分钟。DeDoDe v2 在 MegaDepth-1500 和 IMC2022 上提升位姿估计,IMC2022 mAA 从 75.9 提至 78.3。

3D Human Scan With A Moving Event Camera Figure 1
arXiv preprint2024-04-16

3D Human Scan With A Moving Event Camera

Kai Kohyama 0009-0005-4090-8819 kaikohyama@keio.jp, Yoshimitsu Aoki 0000-0001-7361-0027 aoki@elec.keio.ac.jp

Keio University, Yoshimitsu Aoki \orcidlink

6D位姿估计事件相机

针对传统帧相机在高速运动、低照度和高动态范围场景中易受模糊与曝光限制的问题,论文提出仅使用移动事件相机进行静态人体扫描:通过事件轮廓体素雕刻、射线衰减保留细节,再拟合 SMPL/SKEL 等统计人体模型恢复姿态与网格。实验显示其在关节和人体网格精度上优于多种帧式方法,并在帧方法受运动模糊影响的场景中更稳健。

Separated Attention: An Improved Cycle GAN Based Under Water Image Enhancement Method Figure 1
arXiv preprint2024-04-11

Separated Attention: An Improved Cycle GAN Based Under Water Image Enhancement Method

PAGE 1, Tashmoy Ghosh

School of Electronics Engineering, Vellore Institute of Technology, Chennai

6D位姿估计

面向AUV水下视觉中低对比、偏色和散射导致的检测、跟踪与6D位姿等下游感知退化,论文在CycleGAN中引入基于深度图的分离注意力损失,分别约束前景/背景以增强对比并保持颜色与纹理。在EUPV数据集上,作者报告定性、定量和用户研究均优于若干传统/生成式增强方法,并展示对目标检测和显著性预测有帮助;但实时稳定性与对位姿估计的直接增益文中未充分说明。

GLID: Pre-training a Generalist Encoder-Decoder Vision Model Figure 1
arXiv preprint2024-04-11

GLID: Pre-training a Generalist Encoder-Decoder Vision Model

Jihao Liu 1, 2 ⁣ * 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 * end_FLOATSUPERSCRIPT, Yu Liu 2, 3 2 3 ^ start_FLOATSUPERSCRIPT 2, 3 end_FLOATSUPERSCRIPT, Hongsheng Li 1, 4 1 3 4 ^ start_FLOATSUPERSCRIPT 1

{}^{5} start_FLOATSUPERSCRIPT 5 end_FLOATSUPERSCRIPT Institute for AI Industry Research (AIR), Tsinghua University

6D位姿估计

GLID针对视觉预训练常只迁移编码器、下游仍需从零训练复杂任务解码器的问题,将预训练和检测、分割、姿态、深度等任务统一成“query-to-answer”形式,联合预训练通用编码器-解码器,微调时仅替换顶层线性头以缩小架构落差。实验显示其在6类视觉任务上可匹配或超过Mask2Former、DETR、ViTPose、BinsFormer等专用模型,并提升数据效率与收敛速度。

Measuring proximity to standard planes during fetal brain ultrasound scanning Figure 1
arXiv preprint2024-04-10

Measuring proximity to standard planes during fetal brain ultrasound scanning

Chiara Di Vece, Antonio Cirigliano, Meala Le Lous, Raffaele Napolitano, Anna L. David, Donald Peebles, Pierre Jannin, Francisco Vasconcelos, Danail Stoyanov

6D位姿估计

针对胎儿脑超声标准切面获取依赖操作者经验、6D位姿输出难以直接用于导航的问题,论文提出半监督脑部分割/分类与位姿回归结合的无传感器流程,用目标TV标准切面距离作为可解释的接近度信号。实验显示SS-Seg+Class在标注/未标注数据上mIoU达0.9482/0.8272,掩膜提升位姿回归,并在真实扫描视频中与专家切面质量评估呈一定一致性,但样本和体数据规模仍有限。

MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints Figure 1
arXiv preprint2024-04-10

MoCap-to-Visual Domain Adaptation for Efficient Human Mesh Estimation from 2D Keypoints

Bedirhan Uguz 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ozhan Suat 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Batuhan Karagoz 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Emre Akbas 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, Ankara, Turkey @metu.edu.tr

Middle East Technical University, Ankara, Turkey

6D位姿估计仿真到现实

针对图像-3D人体网格配对标注稀缺、MoCap数据又缺少视觉噪声的问题,论文提出Key2Mesh:先用MoCap生成2D关键点到SMPL网格的训练对,再通过对抗域适应、重投影约束和特征正则,将模型适配到真实图像关键点而无需目标域3D标签。在H3.6M和3DPW上,其PA-MPJPE优于同类无配对方法,3DPW的MPJPE/PVE也更好,并因单次前向推理比LGD快至少12倍、最高约33倍。

Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences Figure 1
arXiv preprint2024-04-09

Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondences

2 1 2 ^ start_FLOATSUPERSCRIPT 1

6D位姿估计相机位姿

该文针对两图相对位姿估计只能得到无尺度平移、AR 等应用又需要米制尺度的问题,提出 MicKey:直接从单张图预测相机坐标系下的稀疏 3D 关键点、描述子与置信度,通过3D匹配和可微Kabsch/NG-DSAC用相对位姿弱监督端到端训练,无需深度、重建或重叠标注。在 Map-Free Relocalisation 上达到领先表现,并在 ScanNet 上与强监督方法相当或更好。

Incremental Joint Learning of Depth, Pose and Implicit Scene Representation on Monocular Camera in Large-scale Scenes Figure 1
arXiv preprint2024-04-09

Incremental Joint Learning of Depth, Pose and Implicit Scene Representation on Monocular Camera in Large-scale Scenes

Tianchen Deng, Nailin Wang, Chongdi Wang, Shenghai Yuan, Jingchuan Wang, Hesheng Wang, Danwei Wang, Weidong Chen

of Automation, Shanghai Jiao Tong University, and Key Laboratory of

6D位姿估计彩色深度

面向机器人在长走廊等大规模场景中仅用单目相机重建时深度尺度不准、位姿漂移和单一 NeRF 容量不足的问题,论文提出增量式联合学习框架:以 ViT 估深、特征度量 BA 跟踪位姿,并用多个局部三平面辐射场表示场景。实验覆盖公开与自采数据,显示其在深度、位姿和大场景重建上优于相关方法,但具体增益在各模块间的归因仍需结合消融判断。

Learning 3D-Aware GANs from Unposed Images with Template Feature Field Figure 1
arXiv preprint2024-04-08

Learning 3D-Aware GANs from Unposed Images with Template Feature Field

Xinya Chen, Hanlei Guo, Yanrui Bin, Shangzhan Zhang, Yuanbo Yang, Yue Wang, Yujun Shen, Yiyi Liao

6D位姿估计

该文针对3D-aware GAN依赖已知相机位姿、在真实无位姿图像上易出现视角与物体姿态纠缠的问题,提出TeFF:在生成辐射场外共享密度学习语义模板特征场,并用DINO等2D语义特征在线估计训练图像位姿,结合离散视角匹配与相位相关加速尺度和面内旋转求解。实验显示其在汽车、飞机、大象等复杂姿态分布数据上比已有无位姿方法恢复更完整几何并提升定性、定量生成效果。

Learning a Category-level Object Pose Estimator without Pose Annotations Figure 1
arXiv preprint2024-04-08

Learning a Category-level Object Pose Estimator without Pose Annotations

Fengrui Tian 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Yaoyao Liu 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Yueqi Duan 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Shaoyi Du 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, @jhu.edu kortylew@cs.uni-freiburg.de, duanyueqi@tsinghua.edu.cn, dushaoyi@xjtu.edu.cn

{}^{2} start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Johns Hopkins University, {}^{3} start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT Tsinghua University, {}^{4} start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT University of Freiburg, {}^{5} start_FLOATSUPERSCRIPT 5 end_FLOATSUPERSCRIPT Max Planck Institute for Informatics

6D位姿估计物体位姿类别级位姿

针对类别级 6D/3D 物体位姿估计依赖大量人工位姿标注的问题,本文用 Zero-1-to-3 等扩散模型从单张未标注图像生成受控视角图像,并通过对比位姿学习得到的图像编码器过滤伪姿态噪声与生成伪影,再联合多个实例神经网格学习类别级判别性。在 PASCAL3D+ 和 KITTI 上,该方法可用单样本定义位姿,并在少样本类别级位姿估计中明显优于已有方法。

DepthMOT: Depth Cues Lead to a Strong Multi-Object Tracker Figure 1
arXiv preprint2024-04-08

DepthMOT: Depth Cues Lead to a Strong Multi-Object Tracker

Jiapeng Wu, Yichen Liu

6D位姿估计物体位姿彩色深度

针对拥挤遮挡中2D框高度重叠、无人机视频中相机非线性运动易造成ID切换的问题,DepthMOT将FairMOT与自监督单目深度估计结合:用深度分支为目标引入前后层次信息,并用相邻帧估计的相机6-DoF补偿Kalman运动预测误差。实验在VisDrone-MOT和UAVDT上优于对比方法,但具体增益中深度与位姿补偿各自贡献仍需结合消融判断。

Two Hands Are Better Than One: Resolving Hand to Hand Intersections via Occupancy Networks Figure 1
arXiv preprint2024-04-08

Two Hands Are Better Than One: Resolving Hand to Hand Intersections via Occupancy Networks

Maksym Ivashechkin, Oscar Mendez, Richard Bowden CVSSP, Guildford, United Kingdom @surrey.ac.uk

CVSSP, University of Surrey, Guildford, United Kingdom

6D位姿估计手部姿态

针对双手交互姿态估计中遮挡和噪声常导致手指/手掌相互穿模的问题,论文用条件 occupancy network 建模连续手部体积,并设计可微交叉损失约束两只动态手的物理占据关系,同时提出更轻量、闭合且便于骨架驱动的手网格参数化来训练占据模型。该损失可接入多种3D手姿态估计器,在 InterHand2.6M、Re:InterHand 和 SMILE 上减少手手相交,并降低或改善关节位置误差。

STITCH: Augmented Dexterity for Suture Throws Including Thread Coordination and Handoffs Figure 1
arXiv preprint2024-04-08

STITCH: Augmented Dexterity for Suture Throws Including Thread Coordination and Handoffs

Kush Hari 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Hansoul Kim 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Will Panitch 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Kishore Srinivas 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Vincent Schorp 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Karthik Dharmarajan 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Shreya Ganti 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Tara Sadjadpour 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ken Goldberg 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计手部姿态

面向手术缝合中全自动可靠性不足、但可由机器人辅助完成子任务的需求,STITCH将增强灵巧性用于连续缝合,结合双目视觉的6D缝针位姿估计、交互式位姿校正、穿线/扫线/收紧/交接等运动原语及失败恢复。物理实验15次中,无人工干预平均完成2.93针,有人工监督介入时平均4.47针,显示视觉闭环对连续缝合稳定性有实际贡献。

ToolEENet: Tool Affordance 6D Pose Estimation Figure 1
arXiv preprint2024-04-05

ToolEENet: Tool Affordance 6D Pose Estimation

Yunlong Wang, Lei Zhang, Yuyang Tu, Hui Zhang, Kaixin Bai, Zhaopeng Chen, Jianwei Zhang

6D位姿估计

该文针对灵巧手持工具时手部遮挡严重、整工具位姿又难以表达实际接触部位的问题,将估计目标从物体中心转向工具端执行器。核心做法是构建带端执行器 affordance 分割与使用相关 6D 位姿标注的合成 TOOLEE 数据集,并用 RGB-D 分割提取局部点云,再以扩散式类别级位姿估计和对称性感知表示处理多解与对称轴问题。实验显示该框架在其数据集上优于基线,尤其对称场景更稳定,但真实机器人任务验证仍较有限。

SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation Figure 1
CVPR 20242024-04-04

SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation

Sichen Chen, Yingyi Zhang, Siming Huang, Ran Yi, Ke Fan, Ruixin Zhang, Peixian Chen, Jun Wang, Shouhong Ding, Lizhuang Ma

Shanghai Jiao Tong University, Tencent Youtu Lab, Tencent WeChat Pay Lab33, MoE Key Lab of Artificial Intelligence, Shanghai Jiao Tong University

6D位姿估计

SDPose面向小型Transformer人体姿态估计在边缘部署中易欠拟合、而大模型计算和存储开销过高的问题,提出多循环Transformer以重复利用同一层增加“潜在深度”,再通过循环间同空间token自蒸馏把多次前向知识压缩到单次推理中。其在MSCOCO上以4.4M参数/1.8GFLOPs达到69.7% mAP,S-V2以6.2M参数/4.7GFLOPs达到73.5% mAP。

Multi Positive Contrastive Learning with Pose-Consistent Generated Images Figure 1
arXiv preprint2024-04-04

Multi Positive Contrastive Learning with Pose-Consistent Generated Images

Sho Inayoshi, Aji Resindra Widya, Satoshi Ozaki, Junji Otsuka, Takeshi Ohashi

6D位姿估计

针对生成图像预训练在分类有效、但迁移到人体姿态估计等结构化任务不足的问题,论文提出 GenPoCCL:用可控扩散模型生成“同姿态、不同外观”的多人图像,并将同一姿态条件下的样本作为多正样本进行对比学习,配合 [POSE] token 强化人体结构表征。实验在 2D 姿态、行人 ReID、文本行人检索和属性识别上优于 StableRep,且仅使用其不足 1% 的生成数据。

HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud Figure 1
Pattern Recognition2024-04-04

HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud

Wencan Cheng, Hao Tang, Luc Van Gool, Jong Hwan Ko

Department of Artificial Intelligence, Sungkyunkwan University, College of Information and Communication Engineering, Sungkyunkwan University

6D位姿估计手部姿态点云

针对传统回归/检测式3D手姿态估计难以处理自遮挡、手物遮挡等不确定性的问题,HandDiff将手部关键点估计建模为以深度图与点云为条件的扩散生成过程,并用逐关节条件、局部细节特征和运动学对应图层解决关节置换与精确定位。其在ICVL、MSRA、NYU和DexYCB上均取得领先或有竞争力的误差,DexYCB达到8.06 mm。

Fusing Multi-sensor Input with State Information on TinyML Brains for Autonomous Nano-drones Figure 1
arXiv preprint2024-04-03

Fusing Multi-sensor Input with State Information on TinyML Brains for Autonomous Nano-drones

Luca Crupi, Elia Cereda, Daniele Palossi

6D位姿估计

针对纳米无人机传感器低分辨率、算力极弱导致外部目标位姿感知受限的问题,论文在TinyML CNN中将灰度图、8×8深度图与机体姿态(roll/pitch)融合,并比较输入、中层、后期等融合方式。模型仅用仿真训练、在真实Crazyflie数据上测试,相比不含状态的基线,距离预测R²最高提升约0.10、横向位移提升约0.02,而MAC仅增加约0.11%。

Semi-Supervised Unconstrained Head Pose Estimation in the Wild Figure 1
arXiv preprint2024-04-03

Semi-Supervised Unconstrained Head Pose Estimation in the Wild

Huayi Zhou, Fei Jiang, Jin Yuan, Yong Rui, Hongtao Lu, Kui Jia

6D位姿估计

针对野外头部姿态数据要么合成/受控、要么标注少且昂贵的问题,本文提出半监督 SemiUHPE,用未标注头部图像缓解全监督依赖。核心在于放弃依赖关键点的仿射对齐,采用保持长宽比的头部裁剪,并结合动态熵伪标签过滤与两类面向头部的强增强。实验显示其在前向与全范围基准上均优于对比方法,并可迁移到通用物体旋转回归和 3D 头部重建。

3D Congealing: 3D-Aware Image Alignment in the Wild Figure 1
arXiv preprint2024-04-02

3D Congealing: 3D-Aware Image Alignment in the Wild

Yunzhi Zhang, Zizhang Li, Amit Raj, Andreas Engelhardt, Yuanzhen Li, Tingbo Hou, Jiajun Wu, Varun Jampani

Amit Raj

6D位姿估计

这篇论文针对无标注网络图片中同类或语义相近物体难以在未知相机、光照和形状差异下建立统一 3D 对齐的问题,提出 3D Congealing:联合优化规范 3D 表示、每张图的位姿和 2D-3D 坐标映射,并融合文本到图像生成先验与 DINO/扩散语义特征以减弱外观差异影响。实验显示其在复杂光照真实数据上的 6D 位姿估计显著优于基线,并可支持图像编辑和网络图像对齐。

SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation Figure 1
arXiv preprint2024-04-02

SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation

Vinkle Srivastav, Keqi Chen, CNRS, INSERM, ICube, UMR7357, Strasbourg, France IHU Strasbourg, France srivastav@unistra.fr, keqi.chen@unistra.fr, npadoy@unistra.fr

University of Strasbourg, CNRS, INSERM, ICube, UMR7357, Strasbourg, France

6D位姿估计多视角

针对多视角多人 3D 姿态估计依赖昂贵 3D 标注、优化法精度不足的问题,SelfPose3d 将 VoxelPose 式学习框架改为自监督:用合成 3D root 与投影热图学习定位,再把瓶颈 3D 姿态可微投影为多视角 2D 关节/热图,并以跨仿射一致性和自适应注意力抑制伪 2D 标签噪声。在 Panoptic、Shelf、Campus 上结果接近全监督方法,且优于传统优化式方案。

Marrying NeRF with Feature Matching for One-step Pose Estimation Figure 1
arXiv preprint2024-04-01

Marrying NeRF with Feature Matching for One-step Pose Estimation

Intelligent Manufacturing, Engineering, congyang81@gmail.com, renyu0414@gmail.com

State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, University of Chinese Academy of Sciences, College of Automation Science and Engineering, South China University of Technology

6D位姿估计三维重建

这篇论文针对 NeRF 位姿估计推理需反复优化、易陷局部最小且难以实时用于机器人操作的问题,将特征匹配与 NeRF 渲染深度结合,把目标图与初始视图的 2D 匹配转为 2D-3D 对应并用 PnP 一步求解位姿;同时用 3D 一致性剔除不可靠 NeRF 点,并以匹配点采样缓解遮挡。实验显示其精度优于已有方法,推理提速约 90 倍,达到 6 FPS。

Graph-Based vs. Error State Kalman Filter-Based Fusion Of 5G And Inertial Data For MAV Indoor Pose Estimation Figure 1
arXiv preprint2024-03-31

Graph-Based vs. Error State Kalman Filter-Based Fusion Of 5G And Inertial Data For MAV Indoor Pose Estimation

PAGE 1, Meisam Kabiri1, Claudio Cimarelli1, Hriday Bavle1

Interdisciplinary Center for Security Reliability and Trust (SnT), University of Luxembourg, Luxembourg, Faculty of Science, Technology, and Medicine (FSTM), Department of, Engineering, University of Luxembourg, Luxembourg

6D位姿估计

针对室内 MAV 在 GNSS 失效、纯惯导易漂移且视觉/LiDAR 受成本与环境限制的问题,论文将 5G NR ToA 与 IMU 融合,分别构建 ESKF 与基于因子图的 PGO,并在 EuRoC 上加入高真实感 5G ToA 仿真以比较基站数量和布局影响。结果显示 LOS 条件下 PGO 表现更优,5 个基站全轨迹约 15 cm 精度,ESKF 最高约 34 cm,且两者运行时间均满足实时性。

OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos Figure 1
arXiv preprint2024-03-31

OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos

Dongyoung Choi, Hyeonjoong Jang, Min H. Kim

KAIST

6D位姿估计

该文针对随手拍摄的长时360°视频中行人、拍摄者等动态物体导致NeRF新视角合成出现鬼影的问题,提出OmniLocalRF:在局部辐射场框架中利用全向相机跨远帧仍有重叠观测的特性,进行双向优化,并用多分辨率神经特征平面自动预测运动掩码,同时估计相机位姿、移除并补全动态遮挡。实验显示其在复杂真实360°场景的定量和视觉质量上优于已有方法,且不依赖手工掩码或额外位姿估计。

KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimation Figure 1
arXiv preprint2024-04-02

KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimation

Jihua Peng, Yanghong Zhou, tracy.mok@polyu.edu.hk

The Hong Kong Polytechnic University Laboratory for Artificial Intelligence in Design

6D位姿估计人体姿态

针对现有 Transformer 进行 3D 人体姿态估计时,Q/K/V 主要由线性映射生成、易忽略人体结构与跨帧运动先验的问题,KTPFormer 在 MHSA 前加入轻量可插拔的 KPA 与 TPA,分别用运动学拓扑和关节轨迹拓扑引导空间、时间相关建模。实验在 Human3.6M、MPI-INF-3DHP 和 HumanEva 上优于多种 SOTA,并可提升其他 Transformer/扩散式骨干且计算开销很小。

FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model Figure 1
arXiv preprint2024-03-29

FetalDiffusion: Pose-Controllable 3D Fetal MRI Synthesis with Conditional Diffusion Model

Molin Zhang, Polina Golland, Patricia Ellen Grant, Elfar Adalsteinsson

6D位姿估计

针对胎儿 MRI 中大幅、不可预测运动导致真实标注数据稀缺、姿态估计泛化不足的问题,FetalDiffusion 用由 15 个骨架关键点和肢体区域构成的 3D 条件掩码,通过交叉注意力驱动扩散模型生成可控姿态的 3D 胎儿 MRI,并引入姿态估计网络的辅助姿态级损失约束。实验显示合成图像在已见和未见姿态上较逼真,加入合成数据后低数据场景下 PCK 提升 15.4%,平均误差降低 50.2%。

Latent Embedding Clustering for Occlusion Robust Head Pose Estimation Figure 1
arXiv preprint2024-03-29

Latent Embedding Clustering for Occlusion Robust Head Pose Estimation

José Celestino, Manuel Marques, Robotics, Instituto Superior Técnico, Lisboa, Portugal

Institute for Systems and Robotics, Instituto Superior Técnico, Lisboa, Portugal

6D位姿估计

针对真实场景中遮挡导致头部姿态估计不稳定的问题,本文将每个欧拉角的回归/分类预测与无监督潜空间聚类联合优化,用少量聚类中心替代逐样本潜变量监督,降低标注嵌入需求并放宽成对遮挡增强限制。在 BIWI、AFLW2000 和 Pandora 等基准上,方法在遮挡样本上有明显提升,整体达到与现有方法竞争的性能。

A Unified Framework for Human-centric Point Cloud Video Understanding Figure 1
arXiv preprint2024-03-29

A Unified Framework for Human-centric Point Cloud Video Understanding

Yiteng Xu, Kecheng Ye, Xiao Han, Yiming Ren, Xinge Zhu

ShanghaiTech University, The Chinese University of Hong Kong

6D位姿估计点云

针对人中心点云视频标注昂贵、现有通用骨干忽略人体结构与运动先验且跨任务泛化弱的问题,论文提出 UniPVU-Human:先用人体部位分割与运动流预训练获取先验,再通过语义引导的时空掩码自学习和全局/部件/点级层次特征微调服务不同下游任务。实验在 LiDAR 人体动作识别与 3D 姿态估计数据集上达到 SOTA,并显示少标注场景下降更小。

Video-Based Human Pose Regression via Decoupled Space-Time Aggregation Figure 1
arXiv preprint2024-04-01

Video-Based Human Pose Regression via Decoupled Space-Time Aggregation

Jijie He, China

Zhejiang Gongshang University, China

6D位姿估计人体姿态

针对视频人体姿态中热图方法计算与存储开销大、单帧回归又缺少时序建模的问题,论文提出 DSTA:为每个关节学习专属 token,并将相邻关节的空间依赖与单关节跨帧轨迹解耦聚合,配合 joint-wise local-awareness attention 降低全局时空注意力开销。在 PoseTrack2017 上相较单帧回归方法提升 8.9 mAP,并达到或超过多帧热图方法,HRNet-W48 下以 0.02 GFLOPs head 获得 83.4 mAP。

Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation Figure 1
CVPR20242024-03-28

Instance-Adaptive and Geometric-Aware Keypoint Learning for Category-Level 6D Object Pose Estimation

Xiao Lin, Wenfei Yang, Yuan Gao, Tianzhu Zhang

University of Science and Technology of China, Jianghuai Advance Technology Center, Hefei, 230000, China

6D位姿估计物体位姿类别级位姿

该文针对类别级 6D 位姿中未见实例形变大、密集对应易忽略局部/全局几何而泛化不足的问题,提出 AG-Pose:用实例自适应关键点检测为不同形状选择稀疏代表点,并通过几何感知特征聚合编码邻域结构与关键点间关系,建立更稳健的关键点级对应。在 CAMERA25 和 REAL275 上,无需类别形状先验即显著超过已有方法。

Object Pose Estimation via the Aggregation of Diffusion Features Figure 1
CVPR20242024-03-27

Object Pose Estimation via the Aggregation of Diffusion Features

Tianfu Wang, Guosheng Hu, Hongguang Wang

State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences, Institutes for Robotics and Intelligent Manufacturing, University of Chinese Academy of Sciences, Beijing, 100049, China

6D位姿估计物体位姿

针对现有图像特征在未见物体上泛化不足导致6D位姿估计精度下降的问题,本文将Stable Diffusion等扩散模型的多时间步、多粒度特征引入模板匹配式位姿估计,并设计三种聚合网络学习更适合位姿判别的表示。在LM、O-LM、T-LESS上优于已有方法,未见LM达97.9%、未见O-LM达85.9%,显著缩小可见/未见物体差距。

RoboKeyGen: Robot Pose and Joint Angles Estimation via Diffusion-based 3D Keypoint Generation Figure 1
arXiv preprint2024-03-27

RoboKeyGen: Robot Pose and Joint Angles Estimation via Diffusion-based 3D Keypoint Generation

Yang Tian, Jiyao Zhang, Guowei Huang, Bin Wang, Ping Wang, Jiangmiao Pang, Hao Dong

Guowei Huang and Bin Wang are with Huawei

6D位姿估计机器人操作

针对未知关节角时机器人位姿与关节角联合估计维度高、现有 render&compare 慢且关键点法跨相机泛化弱的问题,RoboKeyGen 将任务拆为 2D 关键点检测与 2D-to-3D 提升,并用条件扩散模型生成 3D 关键点、以 NCCS 归一化相机内参差异。实验显示其相较 RoboPose 取得更高精度与更快推理,并在跨相机测试中更稳健。

Mathematical Foundation and Corrections for Full Range Head Pose Estimation Figure 1
arXiv preprint2024-03-26

Mathematical Foundation and Corrections for Full Range Head Pose Estimation

PAGE 1, Huei-Chung

Santa Clara University

6D位姿估计

这篇论文针对头部姿态估计中坐标系、欧拉角顺序和绘制例程定义混乱的问题,系统追溯300W-LP、3DDFA_v2、6D-RepNet、WHENet等代码与标注约定。核心贡献是给出坐标系推断、姿态转换、2D增强下旋转矩阵变换和正确绘制公式,并建议采用SciPy/Wikipedia右手系以减少全范围角度歧义。主要结果是澄清并修正多处既有实现不一致,但它更偏数学与工程校准,文中未充分说明对下游精度的直接增益。

EgoPoseFormer: A Simple Baseline for Egocentric 3D Human Pose Estimation Figure 1
arXiv preprint2024-03-26

EgoPoseFormer: A Simple Baseline for Egocentric 3D Human Pose Estimation

Chenhongyi Yang, Anastasia Tkach, Shreyas Hampali, Linguang Zhang, Elliot J. Crowley, Cem Keskin

6D位姿估计人体姿态

本文面向头戴相机自遮挡与视野受限导致的第一视角人体关节不可见问题,提出两阶段 EgoPoseFormer:先用全局多视图特征经轻量 MLP 生成粗姿态,再以 DETR 式查询和 Deformable Stereo Attention 融合双目细粒度特征细化 3D 关节。其在 UnrealEgo 上将 MPJPE 降低 27.4mm,且参数和 FLOPs 远低于前作;扩展到单目 SceneEgo 也取得 25.5mm 改进。

A Survey on 3D Egocentric Human Pose Estimation Figure 1
arXiv preprint2024-03-26

A Survey on 3D Egocentric Human Pose Estimation

Md Mushfiqur Azam

The University of Texas at San Antonio

6D位姿估计人体姿态综述

面向XR、人机交互和穿戴式感知中第一视角全身3D姿态难以受遮挡、视角变化、深度缺失和数据稀缺影响的问题,本文梳理了该方向首次较系统的综述框架:汇总9类常用数据集,将约35种方法按骨架关节估计与人体形状/网格恢复划分,并比较回归、热图及SMPL类方案的优缺点。主要结果是给出评测指标与代表性数据集上的SOTA对照,指出真实场景泛化、遮挡鲁棒性和高质量野外标注仍是关键瓶颈。

GTA-HDR: A Large-Scale Synthetic Dataset for HDR Image Reconstruction Figure 1
arXiv preprint2024-03-26

GTA-HDR: A Large-Scale Synthetic Dataset for HDR Image Reconstruction

Hrishav Bakul Barua, Kalin Stefanov, KokSheik Wong, Abhinav Dhall, Ganesh Krishnasamy

6D位姿估计仿真到现实数据集/基准三维重建

真实 HDR 采集成本高且现有数据集规模、分辨率和场景多样性不足,限制了从 LDR 重建 HDR 的学习方法。GTA-HDR 利用 GTA-V 构建约 4 万张成对 LDR/HDR 合成图像,覆盖多时间、天气和场景,并提供采集与评测流程。实验显示,与真实/合成数据联合训练可提升现有 HDR 重建的定量与视觉质量,并对 3D 人体姿态估计和分割任务有正向迁移;但其与 6D 位姿估计的直接关系文中未充分说明。

DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions Figure 1
SIGGRAPH Asia Conference Papers, Article 145, 20242024-03-26

DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions

Sammy Christen, Shreyas Hampali, Fadime Sener, Edoardo Remelli, Tomas Hodan, Eric Sauser, Shugao Ma, Bugra Tekin

ETH, Meta

6D位姿估计手部姿态

面向机器人训练、VR 操作和合成数据中细粒度手-物交互难以同时满足几何、语义与时间合理性的问题,DiffH2O 将文本驱动的手物运动生成拆成“抓取—交互”两个扩散阶段,并用抓取引导与子序列补全把目标抓姿接入后续动作,同时加入物体几何距离表征和 GRAB 细粒度文本标注。实验显示其在未见物体、未见文本提示及感知评测上优于 IMoS 等基线,但仍存在物理伪影和推理较慢等限制。

System Calibration of a Field Phenotyping Robot with Multiple High-Precision Profile Laser Scanners Figure 1
arXiv preprint2024-03-26

System Calibration of a Field Phenotyping Robot with Multiple High-Precision Profile Laser Scanners

Felix Esser, Gereon Tombrink, André Cornelißen, Lasse Klingbeil, Heiner Kuhlmann

6D位姿估计机器人操作

面向田间高通量表型中高精度作物三维点云重建,论文针对近距离、小视场双工业轮廓激光扫描仪难以套用常规激光雷达标定的问题,提出以点云 omnivariance 为目标的多扫描仪系统标定,并用因子图融合全站仪棱镜、IMU 与 GNSS 航向提升标定期间位姿精度。实验显示,引入地理参考 TLS 点云后 M3C2 距离 RMSE 从初值约 7.1 cm 降至 0.8 cm,同时指出垂直平移需参考点云约束,剩余系统误差可能来自机器人运动中的非刚性形变。

Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos Figure 1
arXiv preprint2024-03-25

Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos

Remy Sabathier, Niloy J. Mitra, David Novotny

Remy Sabathier1,2, Niloy J. Mitra2, and David Novotny1, Meta, University College London

6D位姿估计

本文面向随手拍单目狗视频中非刚性运动、视角不完整和外观细节复杂导致的动物3D重建困难。核心做法是在SMAL模板上引入CSE密集表面对应,替代稀疏关键点监督,并结合SfM相机分解运动平滑约束,再用可随姿态变形的隐式双层网格纹理联合优化形状、姿态与外观。在CoP3D和APTv2上,其位姿估计与纹理/外观重建优于RAC、BARC和BITE等基线。

Characterisation of the Intel RealSense D415 Stereo Depth Camera for Motion-Corrected CT Perfusion Imaging Figure 1
arXiv preprint2024-03-25

Characterisation of the Intel RealSense D415 Stereo Depth Camera for Motion-Corrected CT Perfusion Imaging

PAGE 1, Authors

1. School of Biomedical Engineering, Faculty of Engineering and Computer Science, University of Sydney, Sydney, Australia, 2. School of Biomedical Engineering & Imaging Sciences, King's College London, UK, 3. Sydney School of Medicine and Health, University of Sydney, Sydney, Australia, 4. Brain and Mind Centre, University of Sydney, Sydney, Australia, 5. Department of Medical Physics, Westmead Hospital, Sydney, Australia, 6. Department of Radiology, Westmead Hospital, Sydney, Australia, 7. Medical Imaging Group, School of Medicine, Western Sydney University, Sydney, 8. Department of Aged Care & Stroke, Westmead Hospital, Sydney, Australia

6D位姿估计彩色深度多视角

针对脑 CT 灌注成像中头动会同时造成帧间与帧内误差、传统逐帧配准难以处理连续运动的问题,本文系统评估低成本无标记 Intel RealSense D415 作为 6DoF 外部跟踪器的可行性。其核心价值不在新算法,而在热漂移、静动态机器人真值和临床 CT 内人体跟踪的完整表征;单相机静态误差约≤1.24 mm/0.68°,动态头模 RMSE≤1.40 mm/0.24°,临床志愿者约≤2.72 mm/0.55°,精度有潜力但仍略逊于脑 CT 分辨率,需多相机进一步降低误差。

Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects Figure 1
arXiv preprint2024-03-25

Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects

Zicong Fan, Takehiko Ohkawa, Linlin Yang, Nie Lin, Zhishan Zhou, Shihao Zhou, Jiajun Liang, Zhong Gao, Xuanyang Zhang, Xue Zhang, Fei Li, Zheng Liu, Feng Lu, Karim Knaebel, Bastian Leibe, Jeongwan On, Seungryul Baek, Aditya Prakash, Saurabh Gupta, Kun He, Yoichi Sato, Otmar Hilliges, Hyung Jin Chang, Angela Yao

6D位姿估计手部姿态数据集/基准

面向机器人抓取、AR/VR等需要第一视角理解手物交互的场景,本文构建并分析HANDS23基准,基于AssemblyHands和ARCTIC评估单视角手姿态与手-物一致运动重建。核心洞察是第一视角畸变校正、大容量Transformer建模复杂交互、多视角自适应融合能显著提升表现;同时结果显示快速手部运动、窄视野物体重建和双手-物体紧密接触仍是现有方法的主要失效来源。

A Geometric Perspective on Fusing Gaussian Distributions on Lie Groups Figure 1
arXiv preprint2024-03-25

A Geometric Perspective on Fusing Gaussian Distributions on Lie Groups

PAGE 1, PREPRINT⋆

Systems Theory and Robotics Group, School of Engineering, Australian National University

6D位姿估计高斯泼溅

针对机器人位姿估计、VIO 等李群状态估计中多个参考点上的集中高斯难以直接融合的问题,本文从几何坐标变换角度统一到同一指数坐标系,再做欧式高斯融合;核心创新是比较精确/近似雅可比、BCH、平行移动,并提出带曲率修正的平行移动近似。SO(3)仿真显示其精度接近优化式 SOTA,但计算开销显著更低。

ASDF: Assembly State Detection Utilizing Late Fusion by Integrating 6D Pose Estimation Figure 1
arXiv preprint2024-03-25

ASDF: Assembly State Detection Utilizing Late Fusion by Integrating 6D Pose Estimation

Hannah Schieber, Shiyu Li, Niklas Corell, Philipp Beckerle, Julian Kreimeier, Daniel Roth, Health TUM School of Computation, Information, Technology Clinic for Orthopedics, Munich, Germany, ‖ ^{ } start_FLOATSUPERSCRIPT, ‖ end_FLOATSUPERSCRIPT, ^{ } start_FLOATSUPERSCRIPT, end_FLOATSUPERSCRIPT, Chair of Autonomous Systems, Germany § § ^{ } start_FLOATSUPERSCRIPT § end_FLOATSUPERSCRIPT

Technical University of Munich, Human-Centered Computing and Extended Reality Lab, TUM School of Medicine and Health, TUM School of Computation, Information and Technology, TUM University Hospital, Department Artificial Intelligence in Biomedical Engineering

6D位姿估计

面向医疗和工业装配中的AR原位指导,论文关注动态遮挡、外观变化下仅做6D位姿或2D状态检测难以可靠判断装配进度的问题。ASDF基于YOLOv8融合RGB-D信息,在Pose2State中以后期融合把网络状态预测与6D位姿知识相互校正,并提供含位姿与状态标注的合成装配数据集。实验显示该模块提升装配状态检测,同时反过来增强6D位姿鲁棒性,在ASDF与GBOT数据集上优于纯深度学习、混合及跟踪式基线。

KITchen: A Real-World Benchmark and Dataset for 6D Object Pose Estimation in Kitchen Environments Figure 1
arXiv preprint2024-03-24

KITchen: A Real-World Benchmark and Dataset for 6D Object Pose Estimation in Kitchen Environments

Abdelrahman Younes, Tamim Asfour

6D位姿估计物体位姿数据集/基准

现有6D位姿数据集多限于桌面、固定外部相机,难以反映移动机器人在厨房中依靠自我视角抓取高架、冰箱、洗碗机等物体的困难。KITchen的核心贡献是用ARMAR-6在两个真实厨房采集约20.5万张RGBD图像,覆盖111个厨房物体,并通过半自动流程生成2D框、分割掩码和6D位姿标注;主要结果是发布数据集、标注管线和要求至少5 FPS的基准/竞赛,但文中未充分说明具体算法性能增益。

Diffusion Model is a Good Pose Estimator from 3D RF-Vision Figure 1
arXiv preprint2024-03-24

Diffusion Model is a Good Pose Estimator from 3D RF-Vision

Junqiao Fan 0000-0002-8465-5447, Jianfei Yang 0000-0002-8075-0439, Yuecong Xu 0000-0002-4292-7379, Lihua Xie 0000-0002-7137-4136

6D位姿估计

针对毫米波雷达点云稀疏、噪声大且易漏检导致的人体姿态漂移问题,论文提出 mmDiff,将 3D RF-vision 姿态估计建模为条件扩散去噪过程,并用全局/局部雷达上下文、肢体长度约束和历史运动一致性提供条件引导。实验在 mmBody、mm-Fi 等公开数据集上显著优于既有 LSTM/Transformer 方法,同时改善骨架结构稳定性和时序抖动。

InterFusion: Text-Driven Generation of 3D Human-Object Interaction Figure 1
arXiv preprint2024-03-22

InterFusion: Text-Driven Generation of 3D Human-Object Interaction

Sisi Dai, Wenhao Li, Haowen Sun, Haibin Huang

6D位姿估计

针对文本到3D在人-物交互中易出现关系错误、纹理模糊且缺少成对交互数据的问题,InterFusion将由文本匹配得到的3D人体姿态作为几何先验,先构建交互描述到姿态的代码本,再通过人体与物体局部优化及整场景全局优化生成HOI。实验显示其在3D交互生成质量和语义一致性上优于现有方法。

Augmented Reality Warnings in Roadway Work Zones: Evaluating the Effect of Modality on Worker Reaction Times Figure 1
arXiv preprint2024-03-22

Augmented Reality Warnings in Roadway Work Zones: Evaluating the Effect of Modality on Worker Reaction Times

Sepehr Sabeti, Fatemeh Banani Ardecani, Omidreza Shoghli

6D位姿估计

面向道路施工区车辆侵入风险,本文研究AR警示在嘈杂、高负荷场景中能否比传统提示更快触发工人反应。其核心是构建真实户外AR原型与VR仿真,并用Wizard-of-Oz同步实验,结合SRT与实时姿态估计的视觉反应时指标评估多模态警示。五组实验显示,不同模态组合会显著影响反应时间,VR与真实场景存在差异但可用于对照分析,基于姿态的测量结果与SRT一致,具备实际部署潜力。

Gesture-Controlled Aerial Robot Formation for Human-Swarm Interaction in Safety Monitoring Applications Figure 1
arXiv preprint2024-03-22

Gesture-Controlled Aerial Robot Formation for Human-Swarm Interaction in Safety Monitoring Applications

PAGE 1

6D位姿估计机器人操作航天器

面向高空/电力设施维护中工人安全监测视角不足、且不便使用额外通信设备的问题,论文提出手势驱动的多无人机人-群交互编队:领机在机载端完成工人检测跟踪、位置估计与手势识别,僚机按相对工人位置维持可调视角,并结合避障与互避的预测控制。三机仿真和户外模拟场景实验表明系统能根据工人/远程操作者指令较快调整编队并保持监测,但规模扩展性仍文中未充分说明。

WSCLoc: Weakly-Supervised Sparse-View Camera Relocalization Figure 1
arXiv preprint2024-03-22

WSCLoc: Weakly-Supervised Sparse-View Camera Relocalization

Jialu Wang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Kaichen Zhou 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Andrew Markham 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Niki Trigoni 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

University of Oxford

6D位姿估计相机位姿

WSCLoc针对弱监督相机重定位在稀疏视角下因缺少精确位姿标签、尺度漂移和运动模糊而性能下降的问题,提出两阶段框架:先用带时间编码与sim(3)尺度约束的WFT-NeRF生成初始位姿标签,再将WFT-NeRF与WFT-Pose联合优化,并引入随机视角合成和帧间几何约束。室内外公开数据集实验显示,其在稀疏视角下达到优于现有弱监督方法、接近强监督SOTA的6D位姿精度。

DITTO: Demonstration Imitation by Trajectory Transformation Figure 1
arXiv preprint2024-03-22

DITTO: Demonstration Imitation by Trajectory Transformation

Nick Heppert, Max Argus, Tim Welschehold, Thomas Brox, Abhinav Valada

6D位姿估计

DITTO面向低成本、非专家可提供的单次人类RGB-D示教,缓解遥操作/动觉示教门槛与人机形态差异。其关键是放弃末端动作复制,转为以物体6D位姿轨迹表示任务:离线分割并估计被操作物体相对参照物的运动,在线重检测物体后将轨迹变形到新场景,再结合抓取预测和运动规划执行。论文在10类任务及真实机器人上做消融与测试,显示该模块化流程可覆盖取放和关节物体操作,但性能仍受分割、重检测和抓取误差限制。

VURF: A General-purpose Reasoning and Self-refinement Framework for Video Understanding Figure 1
arXiv preprint2024-03-21

VURF: A General-purpose Reasoning and Self-refinement Framework for Video Understanding

Sweden

ETH Zurich, University of Central Florida, Khalifa University, UAE, Mohamed Bin Zayed University of AI, UAE, Australian National University, Australia, Linköping University, Sweden

6D位姿估计

针对现有视频模型多为单任务、难以支撑复杂视频推理的问题,VURF用LLM将用户查询分解为可执行的视觉程序,并以即插即用方式调用现成视频/视觉模型;其关键在于用上下文示例约束程序生成,再通过GPT-3.5反馈和自 refinement 修正不支持函数与示例偏差。实验覆盖视频问答、动作预期、姿态估计和多视频问答,显示该自修正视觉编程框架能提升视频任务表现,但具体增益幅度与来源需结合完整表格判断。

Visibility-Aware Keypoint Localization for 6DoF Object Pose Estimation Figure 1
arXiv preprint2024-03-21

Visibility-Aware Keypoint Localization for 6DoF Object Pose Estimation

Ruyi Lian, Yuewei Lin, Longin Jan Latecki, Haibin Ling

6D位姿估计物体位姿

针对关键点式6D位姿估计中被遮挡或自遮挡关键点定位不可靠、会污染3D-2D对应的问题,VAPO不再强行定位所有点,而是从物体级标注自动生成可见性标签,并用PPR得到连续的重要性评分,优先选择可见性相关的关键点;方法还能兼容有/无CAD模型设置,并在Linemod、Linemod-Occlusion和YCB-V上取得领先精度与较好速度。

Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Dataset Figure 1
arXiv preprint2024-03-23

Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Dataset

Andrea Avogaro 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Andrea Toaiari 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Federico Cunico 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Xiangmin Xu 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Haralambos Dafas 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Alessandro Vinciarelli 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Emma Li 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Marco Cristani 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计人体姿态机器人操作数据集/基准

面向近距离人机协作中机器人需理解人体动作与避免碰撞的需求,HARPER从四足机器人Spot的低视角采集人机交互数据,并用同步OptiTrack提供亚毫米级3D骨架真值,突出处理遮挡/截断人体观测。数据覆盖17名参与者、15类动作及多种接触场景,并给出3D姿态估计、姿态预测和碰撞预测的可复现实验基准。

Evaluation and Deployment of LiDAR-based Place Recognition in Dense Forests Figure 1
arXiv preprint2024-03-21

Evaluation and Deployment of LiDAR-based Place Recognition in Dense Forests

Haedam Oh, Nived Chebrolu, Matias Mattamala, Leonard Freißmuth, Maurice Fallon

6D位姿估计点云

针对城市道路上验证较多的 LiDAR 场所识别在密林中缺少结构线索、遮挡和视角差异大的问题,本文比较 ScanContext、STD、Logg3dNet、EgoNN,并将表现最好的 Logg3dNet 接入带多级验证的 6DoF 位姿估计/SLAM流程。其在三国森林数据上支持在线 SLAM、多任务地图融合和重定位,5 m 基线内正确回环候选约 80%,10 m 内约 60%。

Zero123-6D: Zero-shot Novel View Synthesis for RGB Category-level 6D Pose Estimation Figure 1
arXiv preprint2024-03-21

Zero123-6D: Zero-shot Novel View Synthesis for RGB Category-level 6D Pose Estimation

Francesco Di Felice, Alberto Remus, Stefano Gasperini, Benjamin Busam, Lionel Ott, Federico Tombari, Roland Siegwart, Carlo Alberto Avizzano

Department of Excellence in Robotics & AI, Mechanical Intelligence Institute, Scuola Superiore Sant’Anna, Pisa, Italy (, TUM School of Computation, Information and Technology, Technical University of Munich, Germany, Department of Mechanical and Process Engineering, Autonomous Systems Lab, ETH Zurich, Switzerland, Google Zurich, Switzerland

6D位姿估计类别级位姿

该文针对类别级6D位姿估计依赖CAD、完整扫描或深度信息、难以泛化到未见实例的问题,提出Zero123-6D:用预训练扩散新视角合成扩充稀疏参考视图,再结合基础模型特征匹配与在线优化,并加入几何差异细化以处理类内形变。在CO3D实验中,仅用单目RGB即优于相关零样本方法,降低了数据与传感器要求。

Meta-Point Learning and Refining for Category-Agnostic Pose Estimation Figure 1
arXiv preprint2024-03-20

Meta-Point Learning and Refining for Category-Agnostic Pose Estimation

Economics, ustcnewly@sjtu.edu.cn

Jiangxi University of Finance and Economics, Shanghai Jiao Tong University

6D位姿估计类别级位姿

针对类别无关位姿估计中仅依赖少量支持关键点局部特征、在遮挡或模糊时信息不足的问题,本文提出先用可学习 meta-embeddings 从查询图像中无支持地产生类别无关“meta-points”,再依据支持关键点进行二分匹配分配与 Transformer 细化,并配合渐进可变形点解码器和松弛回归损失。在 MP-100 上实验显示该框架能学到有意义的潜在关键点,并优于已有 CAPE 方法。

Advancing 6D Pose Estimation in Augmented Reality -- Overcoming Projection Ambiguity with Uncontrolled Imagery Figure 1
arXiv preprint2024-03-20

Advancing 6D Pose Estimation in Augmented Reality -- Overcoming Projection Ambiguity with Uncontrolled Imagery

PAGE 1, Mayura Manawadu, Sieun Park, Soon-Yong Park

School of Electronic and Electrical Engineering, Kyungpook National University

6D位姿估计

面向 AR 中常见的无控制 RGB 图像缺少焦距等元数据、导致虚实叠加尺度和深度不准的问题,本文在 FocalPose 的 neural render-and-compare 框架上,将 z 轴平移与焦距联合估计解耦:固定 tz、重标注真值并按比例重缩放焦距,配合改写的更新规则和损失来降低投影歧义。实验声称 6D 位姿精度明显提升、利于制造和机器人视觉,但片段中未充分说明具体数据集、指标和增益幅度,增益来源可能部分来自 scaling / data 处理。

DOR3D-Net: Dense Ordinal Regression Network for 3D Hand Pose Estimation Figure 1
arXiv preprint2024-03-20

DOR3D-Net: Dense Ordinal Regression Network for 3D Hand Pose Estimation

Yamin Mao 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Zhihua Liu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Weiming Li 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, SoonYong Cho 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Qiang Wang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Xiaoshuai Hao 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT

6D位姿估计手部姿态

本文针对深度图三维手部姿态估计中密集 offset 回归易受大范围数值噪声和离群点影响的问题,将关节定位改写为密集序回归:把连续偏移分解为带顺序约束的二分类空间关系,并在局部聚合概率结果,同时联合序回归与关节损失端到端训练。实验在 ICVL、MSRA、NYU、HANDS2017 上较现有方法取得明显精度提升。

ManiPose: A Comprehensive Benchmark for Pose-aware Object Manipulation in Robotics Figure 1
arXiv preprint2024-03-20

ManiPose: A Comprehensive Benchmark for Pose-aware Object Manipulation in Robotics

Qiaojun Yu, Ce Hao, Junbo Wang, Wenhai Liu, Liu Liu, Yao Mu, Yang You, Hengxu Yan, Cewu Lu

6D位姿估计机器人操作数据集/基准

ManiPose针对日常机器人操作中物体6D位姿会改变抓取点、目标姿态和运动策略的问题,构建了面向位姿感知操作的仿真任务、统一且偏操作语义的2936个刚体与100个关节物体位姿标注数据集,并给出结合LLM推理的抓取与规划基线。实验显示统一标注提升位姿估计泛化,基线在仿真POM任务和真实机器人迁移中取得可用成功率。

MULAN-WC: Multi-Robot Localization Uncertainty-aware Active NeRF with Wireless Coordination Figure 1
arXiv preprint2024-03-20

MULAN-WC: Multi-Robot Localization Uncertainty-aware Active NeRF with Wireless Coordination

Weiying Wang1, Victor Cai2, Stephanie Gil1

John A. Paulson School of Engineering and Applied Sciences, Harvard University

6D位姿估计机器人操作三维重建

面向多机器人在无GNSS/动捕环境中协同采集并重建场景时,相机相对位姿难获取且主动视角选择受定位误差影响的问题,MULAN-WC用无线AoA与测距估计机器人间位姿,并将无线定位不确定性写入NeRF训练损失和下一最佳视角评估。合成、真实与硬件实验显示,其重建质量接近使用真值位姿,并能通过不确定性感知的主动采样持续提升渲染质量。

FaceXFormer: A Unified Transformer for Facial Analysis Figure 1
arXiv preprint2024-03-19

FaceXFormer: A Unified Transformer for Facial Analysis

Kartik Narayan, Vibashan VS : 1, Rama Chellappa

6D位姿估计

面部解析、关键点与头部位姿等任务长期依赖专用模型,部署复杂且难以实时集成。FaceXFormer将十类面部分析统一为Transformer编码器-解码器框架,用可学习任务token表示不同任务,并以FaceX轻量解码器的双向交叉注意力联合建模人脸与任务token。实验显示其在多基准上达到SOTA或有竞争力表现,同时以33.21 FPS运行,较既有多任务模型提速约69.44%。

WHAC: World-grounded Humans and Cameras Figure 1
arXiv preprint2024-03-19

WHAC: World-grounded Humans and Cameras

Wanqi Yin, 2 ^ start_FLOATSUPERSCRIPT, 2 end_FLOATSUPERSCRIPT, Zhongang Cai, 4 1 3 4 ^ start_FLOATSUPERSCRIPT, 4 end_FLOATSUPERSCRIPT, Ruisi Wang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Fanzhou Wang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Chen Wei 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Haiyi Mei 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Weiye Xiao 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Zhitao Yang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Qingping Sun 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Atsushi Yamashita 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Ziwei Liu 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Lei Yang 1, 4 1 4 ^ start_FLOATSUPERSCRIPT 1, 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT S-Lab

{}^{1} start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT SenseTime Research, {}^{2} start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT The University of Tokyo, {}^{3} start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT S-Lab, Nanyang Technological University, {}^{4} start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT Shanghai AI Laboratory

6D位姿估计

WHAC 面向单目视频中相机与人体同时运动时世界坐标系尺度不确定的问题,利用相机坐标系 SMPL-X 估计可提供人体绝对深度、人体运动可提供速度/尺度线索的洞察,结合 EHPS、VO 与 MotionVelocimeter 以回归方式联合恢复人体和相机轨迹,并引入带精确标注的合成集 WHAC-A-Mole。实验显示其在标准基准和新基准上优于现有方法,且比优化式方案更高效。

Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimation Figure 1
arXiv preprint2024-03-19

Diffusion-Driven Self-Supervised Learning for Shape Reconstruction and Pose Estimation

Jingtao Sun, Yaonan Wang, Mingtao Feng, Chao Ding, Mike Zheng Shou, Ajmal Saeed Mian

6D位姿估计三维重建

面向类别级6D位姿中标注、CAD模型和合成数据依赖过强且难处理多目标与形状重建的问题,本文提出仅利用形状先验的扩散驱动自监督框架。其核心是Prior-Aware Pyramid 3D Point Transformer,同时建模SE(3)等变位姿特征与尺度不变形状表示,并用预训练到细化的扩散范式关联先验和观测以缓解类内差异。在四个公开数据集和自建集上,该方法超过现有自监督类别级基线,并接近或超过部分全监督方法。

IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model Figure 1
arXiv preprint2024-03-19

IFFNeRF: Initialisation Free and Fast 6DoF pose estimation from a single image and a NeRF model

Matteo Bortolon 1, 3 1 2 3 ^ start_FLOATSUPERSCRIPT 1, 3 end_FLOATSUPERSCRIPT, Theodore Tsesmelis 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Stuart James 1, 4 1 4 ^ start_FLOATSUPERSCRIPT 1, 4 end_FLOATSUPERSCRIPT, Fabio Poiesi 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT

6D位姿估计三维重建

针对 NeRF 用于单图 6DoF 重定位时常依赖近似初始位姿且优化耗时的问题,IFFNeRF从 NeRF 中用 Metropolis-Hastings 采样表面点并投射候选射线,通过学习的图像—射线注意力建立对应,最终以最小二乘闭式估计相机位姿。实验在合成与真实物体上相对 iNeRF 将角度和位移误差分别降低 80.1% 与 67.3%,并在消费级硬件达到 34fps。

In-Hand Following of Deformable Linear Objects Using Dexterous Fingers with Tactile Sensing Figure 1
arXiv preprint2024-03-19

In-Hand Following of Deformable Linear Objects Using Dexterous Fingers with Tactile Sensing

Mingrui Yu, Boyuan Liang, Xiang Zhang, Xinghao Zhu, Lingfeng Sun, Changhao Wang, Shiji Song, Xiang Li, Masayoshi Tomizuka

6D位姿估计手部姿态

针对线缆、绳索等可变形线状物在手内滑动跟随时“既要滑动又要夹持”的矛盾,论文用带 GelSight 触觉的通用灵巧手替代一自由度平行夹爪。核心在于将臂手笛卡尔控制、混合位置/力控制、触觉接触分割与三维线姿估计结合,并据此设计跟随动作。真实实验显示其相比平行夹爪在鲁棒性、泛化性和效率上更好。

Self-learning Canonical Space for Multi-view 3D Human Pose Estimation Figure 1
arXiv preprint2024-03-19

Self-learning Canonical Space for Multi-view 3D Human Pose Estimation

Xiaoben Li, Mancheng Meng, Ziyan Wu, Terrence Chen, Fan Yang, Dinggang Shen

6D位姿估计人体姿态多视角

针对多视角3D人体姿态估计中相机位姿、3D姿态和几何约束标注难获取且信息异构的问题,论文提出全自监督CMANet,在SMPL参数化的规范空间中级联建模视内与视间信息:先用高置信2D关键点监督单视角初始化,再冻结视内模块并通过多视角重投影联合优化相机与姿态。实验显示该两阶段聚合策略优于已有方法,但具体收益对2D检测器质量的依赖仍需关注。

Human Mesh Recovery from Arbitrary Multi-view Images Figure 1
arXiv preprint2024-03-20

Human Mesh Recovery from Arbitrary Multi-view Images

Xiaoben Li, Mancheng Meng, Ziyan Wu, Terrence Chen, Fan Yang, Dinggang Shen

6D位姿估计多视角

本文针对多视角人体网格恢复中相机姿态和视角数量都不固定的问题,指出将相机估计与人体形状/姿态回归耦合会限制模型灵活性。U-HMR以分治思路解耦相机与人体:共享MLP并行估计各视角相机,带SMPL查询token的Transformer解码器融合任意数量视角特征。其在Human3.6M、MPI-INF-3DHP和TotalCapture上验证了对可变视角、未见视角的适应性,且头部计算开销较小。

XPose: eXplainable Human Pose Estimation Figure 1
arXiv preprint2024-03-19

XPose: eXplainable Human Pose Estimation

Luyu Qiu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Jianing Li 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Lei Wen 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Chi Su 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Fei Hao 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, tensor.li@polyu.edu.hk, lwen@connect.ust.hk, chisu, ffaye.hao, jason-c.zhang@polyu.edu.hk, leichen@cse.ust.hk

{}^{2} start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Hong Kong Polytechnic University

6D位姿估计人体姿态

XPose针对多人姿态估计中模型只追求精度、缺少关键点决策解释的问题,引入按人体结构和关键点依赖聚类的Group Shapley Value,以组内细粒度、组间粗粒度方式降低Shapley计算成本并分析关键点贡献;基于该洞察提出GKR训练增强,保留强相关关键点、移除单点以提升遮挡推理能力,在HRNet、HigherHRNet、PolarPose等方法和COCO遮挡子集上均带来优于随机擦除的增益。

HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data Figure 1
arXiv preprint2024-03-18

HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data

Mengqi Zhang 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Yang Fu 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Zheng Ding 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Sifei Liu 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Zhuowen Tu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT NVIDIA

6D位姿估计手部姿态

针对带精确3D标注的手-物交互数据采集成本高、规模和物体多样性受限的问题,HOIDiffusion将抓取生成与条件扩散结合:先由物体网格生成手部3D抓取,再把法线、分割和2D手关键点作为几何条件,并用文本控制外观。实验显示其生成的交互更符合几何与物理约束,可泛化到不同风格提示,且合成数据用于训练6D物体位姿估计时能提升感知指标。

Normalized Validity Scores for DNNs in Regression based Eye Feature Extraction Figure 1
arXiv preprint2024-03-18

Normalized Validity Scores for DNNs in Regression based Eye Feature Extraction

72076 wolfgang.fuhl@uni-tuebingen.de

University Tübingen

6D位姿估计

针对眼部特征/姿态相关任务中回归式 landmark 检测只能给位置、难以判断单点可靠性的问题,本文改进已有 validity loss:将每个 landmark 的误差估计按目标形状尺度归一化,并加入 margin 抑制接近真值时的微小梯度。实验在瞳孔、虹膜和眼睑 landmark 任务上显示,该扩展在多种 CNN 架构中均优于原始未归一化损失,并提升异常点剔除后的整体形状估计精度。

LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Models Figure 1
arXiv preprint2024-03-18

LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Models

Yang Yang, Wen Wang, Liang Peng, Chaotian Song, Yao Chen, Hengjia Li, Xiaolong Yang, Qinglin Lu, Deng Cai, Boxi Wu, Tencent Inc

State Key Lab of CAD&CG, Zhejiang University, Fabu Inc, The School of Software Technology, Zhejiang University, Tencent Inc

6D位姿估计

该文针对多 LoRA 概念定制中常见的概念消失与属性混淆问题,提出无需训练融合权重的 LoRA-Composer。其核心是在给定文本与布局框时,通过区域感知的 cross-attention 注入、self-attention 概念隔离和 latent 重初始化,让不同主体在指定区域内保持可见且特征独立。实验显示其在少用或不用姿态、边缘等图像条件时优于 Mix-of-Show 等基线,但任务本身更偏可控图像生成,与 6D 位姿估计关联较弱。

GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objects Figure 1
arXiv preprint2024-03-18

GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objects

Sungphill Moon, Hyeontae Son, Dongcheol Hur, Sangwook Kim NAVER LABS @naverlabs.com

NAVER LABS

6D位姿估计未知物体

GenFlow针对新物体6D位姿估计中“可扩展但不够准”的问题,认为关键在于更直接利用目标CAD形状与投影几何。方法在渲染图和观测图之间递归预测光流与置信度,通过可微PnP和形状约束迭代细化位姿,并用级联多尺度相关实现由粗到细优化。在BOP 2023未见物体RGB与RGB-D基准中均取得第一,对已见物体也无需微调达到接近SOTA表现。

A Dual-Augmentor Framework for Domain Generalization in 3D Human Pose Estimation Figure 1
CVPR 20242024-03-17

A Dual-Augmentor Framework for Domain Generalization in 3D Human Pose Estimation

Qucheng Peng, Ce Zheng, Chen Chen

Center for Research in Computer Vision, University of Central Florida

6D位姿估计人体姿态

针对实验室采集的3D人体姿态数据难以泛化到未知场景的问题,论文指出单一对抗式增强器既难兼顾近源与远源目标域,又会被判别器限制多样性。方法引入弱/强双姿态增强器,并用差异化生成判别与元优化在训练中模拟域偏移。多数据集实验显示其较现有3D HPE域泛化方法取得显著提升。

Robotic Task Success Evaluation Under Multi-modal Non-Parametric Object Pose Uncertainty Figure 1
arXiv preprint2024-03-16

Robotic Task Success Evaluation Under Multi-modal Non-Parametric Object Pose Uncertainty

Lakshadeep Naik 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Aljaz Kramberger 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Norbert Krüger 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT

{}^{2} start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Danish Institute for Advanced Studies (DIAS), Odense M, Denmark

6D位姿估计物体位姿机器人操作

针对6D物体位姿不确定会导致抓取、移动操作失败,但部分误差又可被任务容忍的问题,论文将“估计误差分布”和“任务可接受误差空间”都建模为多模态非参数分布:离线用动力学仿真预计算可接受误差,在线与位姿误差分布积分得到成功概率。在两个移动操作任务中,相比最佳基线,抓取成功率由75%升至91%,IK可行性由90%升至96%,失败率也更低。

DPPE: Dense Pose Estimation in a Plenoxels Environment using Gradient Approximation Figure 1
arXiv preprint2024-03-16

DPPE: Dense Pose Estimation in a Plenoxels Environment using Gradient Approximation

Christopher Kolios 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Yeganeh Bahoo 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Sajad Saeedi 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

Toronto Metropolitan University, Toronto, Canada

6D位姿估计

DPPE针对传统 NeRF 位姿估计训练和渲染过慢、难以密集重渲染的问题,将单目 RGB 6D 相机位姿恢复放到 Plenoxels 体素辐射场中。核心做法是利用 Plenoxels 的快速渲染,对 6 个自由度用中心差分近似位姿梯度,并通过重渲染光度误差迭代优化。实验表明该方法可在标准场景中有效收敛,并分析了图像射线采样比例与网格分辨率对精度和运行时间的权衡。

CLOSURE: Fast Quantification of Pose Uncertainty Sets Figure 1
arXiv preprint2024-03-15

CLOSURE: Fast Quantification of Pose Uncertainty Sets

Yihuai Gao12, Yukai Tang13, Han Qi4, Heng Yang4

Stanford University, Princeton University, Harvard University, Author Names Omitted for Anonymous Review. Paper-ID [192]

6D位姿估计

针对学习关键点或位姿假设中的非高斯、有界噪声,论文希望为6D位姿估计给出可实时使用的严格不确定性界。核心洞察是将非凸PURSE解释为约束动力系统可行集或多个测地球交集,并用GPU并行随机游走采样边界,再以miniball近似最小包围测地球。实验在LM-O、3DMatch、LM上达到91%–97%紧度比,平均低于0.3秒,较GRCC快23.6–833倍。

ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Image Figure 1
arXiv preprint2024-03-14

ThermoHands: A Benchmark for 3D Hand Pose Estimation from Egocentric Thermal Image

Fangqiang Ding, Yunzhou Zhu, Xiangyu Wen, Gaowen Liu, Chris Xiaoxuan Lu

University of Edinburgh, Georgia Institute of Technology, Cisco Research, University College London

6D位姿估计手部姿态数据集/基准

面向XR、人机交互等第一视角手势感知,论文针对RGB受光照/手套遮挡影响、主动NIR易受阳光和设备干扰的问题,提出首个热成像3D手部姿态基准ThermoHands,采集28人多光谱多视角交互数据并用自动MANO优化标注,同时给出双Transformer基线TherFormer。实验显示标注约1cm精度,热成像在弱光、强光和戴手套等恶劣场景下较RGB/NIR/深度更稳健,TherFormer取得领先表现。

BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects Figure 1
arXiv preprint2024-03-14

BOP Challenge 2023 on Detection, Segmentation and Pose Estimation of Seen and Unseen Rigid Objects

Tomas Hodan 1, Martin Sundermeyer 2

Yann Labbé, Meta, Google, Tsinghua University, Heidelberg University

6D位姿估计数据集/基准

面向机器人操作中可扩展的刚体感知需求,BOP 2023 将既有的已见物体检测、分割与6D定位扩展到未见物体,要求方法仅凭3D模型在5分钟单GPU内完成 onboarding,更贴近无真实标注图像的部署场景。报告统一评测协议、数据与默认检测/分割设置,显示未见物体最佳方法 GenFlow 已达到2020年已见物体最佳水平但速度较慢;已见物体 GPose 相比2022年 GDRNPP 精度小幅提升、运行时间降低约43%。

Scalable Autonomous Drone Flight in the Forest with Visual-Inertial SLAM and Dense Submaps Built without LiDAR Figure 1
arXiv preprint2024-03-14

Scalable Autonomous Drone Flight in the Forest with Visual-Inertial SLAM and Dense Submaps Built without LiDAR

Sebastián Barbas Laina, Simon Boche, Sotiris Papatheodorou, Dimos Tzoumanikas, Simon Schaefer, Hanzhi Chen, Stefan Leutenegger

Mobile Robotics Lab, Department of Mechanical and Process Engineering, ETH Zurich. E-mail addresses, Munich Institute of Robotics and Machine Intelligence (MIRMI), Munich Center for Machine Learning (MCML)

6D位姿估计相机位姿点云

面向森林等GPS受限、杂乱且大尺度场景中无人机通常依赖LiDAR的问题,本文构建仅用被动双目/IMU的全机载自主飞行系统,将VI-SLAM闭环位姿与体素占据子地图结合用于可扩展规划,并提出轨迹锚定/弹性变形以应对闭环带来的位姿跳变。仿真与真实林地下最高3 m/s飞行未发生碰撞,并显示SLAM闭环可改善在线地图完整性与精度。

Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting Figure 1
arXiv preprint2024-03-14

Improving Real-Time Omnidirectional 3D Multi-Person Human Pose Estimation with People Matching and Unsupervised 2D-3D Lifting

Pawel Knap, Peter Hardy, Alberto Tamajo, Hwasup Lim, Hansung Kim

University of Southampton, Korean Institute of Science and Technology

6D位姿估计人体姿态

针对单目3D人体姿态难以获得全局深度、且多人体与遮挡场景实时性不足的问题,本文将360°全景相机与毫米波雷达结合,利用OpenPose、无监督LInKs 2D-3D lifting、相机/雷达标定和改进的图像-雷达人员匹配来消解尺度与深度歧义。实验显示匹配精度较前作提升4.63%,雷达定位误差降低,RTX 3060笔记本上约7–8 fps,人数增加时时间复杂度近似不变,但遮挡、范围和雷达盲区仍有限制。

LM2D: Lyrics- and Music-Driven Dance Synthesis Figure 1
arXiv preprint2024-03-14

LM2D: Lyrics- and Music-Driven Dance Synthesis

Wenjie Yin 1 ⁣ ∗ 1 ∗ ^ start_FLOATSUPERSCRIPT 1 ∗ end_FLOATSUPERSCRIPT, Xuejiao Zhao 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Yi Yu 3 ⁣ † 3 † ^ start_FLOATSUPERSCRIPT 3 † end_FLOATSUPERSCRIPT, Hang Yin 4 4 ^ start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT, Danica Kragic 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计

针对现有舞蹈生成多只依赖音乐、难以利用歌词语义且扩散采样较慢的问题,LM2D将音乐与歌词作为多模态条件,引入扩散模型和一致性蒸馏,实现单步生成3D舞蹈动作,并用姿态估计构建含歌词、音乐和动作的数据集。实验和舞者/编舞者评测显示,其生成动作更真实多样,且与节奏和歌词语义匹配更好。

SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios Figure 1
arXiv preprint2024-03-14

SD-Net: Symmetric-Aware Keypoint Prediction and Domain Adaptation for 6D Pose Estimation In Bin-picking Scenarios

Ding-Tao Huang 1, } start_FLOATSUPERSCRIPT 1, end_FLOATSUPERSCRIPT, En-Te Lin 1, Lipeng Chen 2, } start_FLOATSUPERSCRIPT 2, Li-Fu Liu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Long Zeng 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT

{}^{2} start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Tencent Robotics X, Shenzhen, China

6D位姿估计机器人操作仿真到现实

面向料箱抓取中的6D位姿估计,SD-Net针对对称物体关键点歧义和合成到真实域差距两类瓶颈,采用考虑对称类别与等价关键点的3D关键点选择/过滤,并结合点级回归、Hough投票和基于半Chamfer距离伪标签的师生自训练域适应。实验在Siléane上达到96% AP,在Parametric上较已有方法高约8%,但具体增益在各模块间的分解仍需结合消融判断。

MOTPose: Multi-object 6D Pose Estimation for Dynamic Video Sequences using Attention-based Temporal Fusion Figure 1
arXiv preprint2024-03-14

MOTPose: Multi-object 6D Pose Estimation for Dynamic Video Sequences using Attention-based Temporal Fusion

Arul Selvam Periyasamy, Sven Behnke

the Autonomous Intelligent Systems group

6D位姿估计物体位姿

面向杂乱动态抓取场景中遮挡导致单帧 RGB 6D 位姿估计不稳的问题,MOTPose 将多目标检测与位姿估计表述为集合预测,并用跨注意力时间融合模块在多帧间聚合对象嵌入和对象级输出,同时保持单阶段推理。实验在 SynPick 与 YCB-Video 上显示其位姿精度和检测精度优于单帧基线,并在保持较轻、更快的同时取得有竞争力结果。

Data Augmentation in Human-Centric Vision Figure 1
arXiv preprint2024-03-13

Data Augmentation in Human-Centric Vision

PAGE 1, Wentao Jiang1, Yige Zhang1, Shaozhong Zheng1, Si Liu1, Shuicheng Yan2

Beihang University, Xueyuan Road No.37, Beijing, 100191, China

6D位姿估计

针对以人为中心视觉中数据稀缺、标注昂贵和过拟合问题,本文系统梳理行人重识别、人体解析、姿态估计、行人检测的数据增强。核心洞察是按数据扰动与数据生成建立 taxonomy,并进一步区分图像级/人体级扰动、图形引擎/生成模型/重组式生成,强调人体结构先验对增强设计的影响。主要结果是形成较完整的文献地图、方法优缺点和开放问题;文中未充分说明统一实验增益,结论更偏综述性。

PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections Figure 1
arXiv preprint2024-03-15

PRAGO: Differentiable Multi-View Pose Optimization From Objectness Detections

Matteo Taiana, Matteo Toso, Stuart James, Alessio Del Bue Pattern Analysis, Computer Vision (PAVIS, Istituto Italiano di Tecnologia (IIT) Genoa, Italy @iit.it

6D位姿估计多视角

PRAGO面向小规模、稀疏多视角场景中SfM初始相机位姿不稳的问题,利用目标检测提供的语义一致性来细化成对相对位姿,而不是过早剔除边或相机。其将目标性位姿精炼与可微旋转平均结合,通过迭代建图和边权重更新恢复绝对旋转,再配合平移平均得到位姿。在7-Scenes稀疏子场景上,相比非可微求解器旋转误差相对改善约21%,平移表现相近。

NeRF-Supervised Feature Point Detection and Description Figure 1
arXiv preprint2024-03-13

NeRF-Supervised Feature Point Detection and Description

Ali Youssef

Department of Computer Science, University College London, Hawkes Institute, University College London

6D位姿估计三维重建

针对用单应变换训练特征点检测/描述器难以覆盖真实多视角、非平面几何的问题,论文用 NeRF 重建室内外场景并渲染带深度和相机参数的多视图数据,通过透视重投影监督改造 SuperPoint、SiLK。仅用 10 个场景、1 万张合成图,模型在 ScanNet、YFCC100M、MegaDepth 相对位姿估计上优于原基线,点云配准相近,HPatches 单应估计略低,显示收益主要来自更真实的投影监督而非数据规模。

Q-SLAM: Quadric Representations for Monocular SLAM Figure 1
arXiv preprint2024-03-12

Q-SLAM: Quadric Representations for Monocular SLAM

Chensheng Peng, Chenfeng Xu : 1, Yue Wang, Mingyu Ding, Heng Yang, Masayoshi Tomizuka, Kurt Keutzer, Marco Pavone, Wei Zhan, UC Berkeley, NVIDIA

UC Berkeley, NVIDIA

6D位姿估计相机位姿

面向单目 SLAM 中 RGB 估深噪声大、NeRF/高斯体表示计算与存储负担重的问题,Q-SLAM 将刚性场景近似分解为少量二次曲面,用二次曲面校正深度并在曲面附近采样,同时引入 quadric-ray transformer 聚合跨曲面信息、以语义作隐式监督。实验显示其优于依赖预测深度的基线,并在合成与真实数据上接近使用真实深度的方法。

MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlation Figure 1
arXiv preprint2024-03-12

MRC-Net: 6-DoF Pose Estimation with MultiScale Residual Correlation

Yuelong Li Amazon Inc. yuell@amazon.com, Yafei Mao : 1 Amazon Inc. yafeimao@amazon.com, Raja Bala Amazon Inc. rajabl@amazon.com

Amazon Inc

6D位姿估计

针对单目 RGB 6D 位姿中纯回归易受初始化影响、纯分类存在量化误差且对称物体标签歧义的问题,MRC-Net 将粗位姿分类与类内残差回归串联,并用渲染结果与输入图像的多尺度残差相关层显式传递局部/全局对应关系,同时用软标签缓解对称性。其在 T-LESS、LM-O、YCB-V、ITODD 等 BOP 数据集上超过现有 RGB 方法,平均召回提升约 2.4%,且无需迭代细化或复杂后处理。

Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimation Figure 1
arXiv preprint2024-03-12

Uncertainty Quantification with Deep Ensembles for 6D Object Pose Estimation

Kira Wursthorn, Markus Hillemann, Markus Ulrich

Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology (KIT), Germany

6D位姿估计物体位姿

面向人机协作、工业检测等高风险场景,论文关注多阶段6D位姿估计不仅要准还要知道“不确定”。作者将Deep Ensembles适配到SurfEmb的2D-3D对应网络,并提出回归不确定性校准指标UCS。实验显示T-LESS上网络集成本身校准良好,但PnP、位姿细化和表示方式会削弱整体不确定性质量,位置分量尤其影响校准。

Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving Figure 1
arXiv preprint2024-03-12

Adaptive Fusion of Single-View and Multi-View Depth for Autonomous Driving

JunDa Cheng 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT 1 Equal contribution, Kaixuan Wang 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Xiaozhi Chen 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Shijie Wang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Technology, yvanwy@outlook.com

6D位姿估计彩色深度多视角

面向自动驾驶中位姿噪声、低纹理和动态物体会使多视角深度失效的问题,论文提出 AFNet:用单目与多视角双分支分别预测深度和置信度,并通过基于重投影/纹理一致性的自适应融合逐像素选择可靠结果。作者还构建噪声位姿鲁棒性评测;在 KITTI、DDAD 上达到 SOTA,并在噪声位姿和动态区域优于现有多视角及融合方法。

Category-Agnostic Pose Estimation for Point Clouds Figure 1
arXiv preprint2024-03-12

Category-Agnostic Pose Estimation for Point Clouds

Bowen Liu

6D位姿估计类别级位姿点云

针对类别级/实例级6D位姿方法依赖已知类别与类内对齐、难以处理新类别物体的问题,论文从点云几何出发,提出无需类别信息的端到端流程:先用半自动标注学习旋转不变的 patch 特征,再结合 PointMLP 做粗姿态分类与局部回归。实验在 CAMERA25 与 ModelNet40 上验证了该特征可支持跨类别姿态估计,在未见类别上也有可用表现,但整体并非 SOTA,增益主要来自几何先验的泛化能力。

Monocular Microscope to CT Registration using Pose Estimation of the Incus for Augmented Reality Cochlear Implant Surgery Figure 1
arXiv preprint2024-03-12

Monocular Microscope to CT Registration using Pose Estimation of the Incus for Augmented Reality Cochlear Implant Surgery

Yike Zhang, Eduardo Davalos, Dingjie Su, Ange Lou, Jack H. Noble

Dept. of Computer Science, Vanderbilt University, Dept. of Electrical and Computer Engineering, Vanderbilt University

6D位姿估计医学/手术

面向人工耳蜗手术中AR导航依赖外部光学跟踪、成本和流程复杂的问题,论文提出仅用单目手术显微镜视频与术前CT直接配准:对术中可见且CT中可定位的砧骨局部建立2D-3D表面坐标映射,并用轻量网络预测映射后通过PnP估计位姿。12例手术视频/CT上的初步结果显示平均旋转误差小于25°,平移误差在x、y轴小于2/3 mm,z轴约0.55%。

Real-Time Simulated Avatar from Head-Mounted Sensors Figure 1
arXiv preprint2024-03-11

Real-Time Simulated Avatar from Head-Mounted Sensors

Zhengyi Luo, Jinkun Cao, Rawal Khirodkar, Alexander Winkler, Jing Huang, Kris Kitani, Weipeng Xu

Reality Labs Research, Meta, Carnegie Mellon University

6D位姿估计

该文面向商用 AR/VR 头显视角下身体常被遮挡、仅靠头部 6D 位姿又缺少手脚细节的问题,提出 SimXR:将头显位姿与相机图像直接映射为物理人形控制信号,并通过预训练运动模仿器蒸馏避免中间姿态表示。作者构建 Quest 2 配置的大规模合成数据和真实测试集,显示模型可实时驱动虚拟人,在真实采集与前向 AR 相机上优于仅头显或传统自我中心姿态方案,但手脚不可见时仍会误判或滞后。

Transformer-based Fusion of 2D-pose and Spatio-temporal Embeddings for Distracted Driver Action Recognition Figure 1
arXiv preprint2024-03-11

Transformer-based Fusion of 2D-pose and Spatio-temporal Embeddings for Distracted Driver Action Recognition

Erkut Akdag, Zeqi Zhu, Egor Bondarev, Peter H. N. De With

VCA Group, Department of Electrical Engineering, Eindhoven University of Technology

6D位姿估计

该文面向ADAS中分心驾驶行为的长视频分类与时间定位难题,核心做法是将驾驶员脸、手、身体的2D姿态特征作为Transformer的“POSEition”位置嵌入,并以视频时空特征作为编码器主输入进行多模态融合,再汇合多摄像头帧级概率做后处理以抑制误检。在2023 NVIDIA AI City Challenge Track3 A2测试集上取得0.5079的overlap score;但相对单模态或不同融合策略的实际增益幅度需结合消融解读。

Platypose: Calibrated Zero-Shot Multi-Hypothesis 3D Human Motion Estimation Figure 1
arXiv preprint2024-03-10

Platypose: Calibrated Zero-Shot Multi-Hypothesis 3D Human Motion Estimation

PAGE 1, Paweł A. Pierzchlewicz1, Caio O. da Silva2, R. James Cotton3, Fabian H. Sinz1

Department of Computer Science, G¨ottingen University, G¨ottingen, Germany, Shirley Ryan AbilityLab, Chicago, IL, USA Department of Physical Medicine and Rehabilitation, Northwestern University, Evanston, IL, USA, Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA, Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine, Houston, TX, USA

6D位姿估计

单目 2D 到 3D 人体运动存在深度、遮挡和关键点噪声歧义,单一序列或逐帧多假设难以表达时序不确定性。Platypose 将仅用 3D 运动预训练的扩散模型通过 energy guidance 零样本约束到 2D 观测,直接生成时序一致的多条 3D 运动假设,并将采样压到 8 步。实验显示其在多假设运动估计上优于基线,在 Human3.6M、MPI-INF-3DHP、3DPW 静态姿态上校准性达 SOTA、关节误差具竞争力,且可自然扩展到多相机场景。

Exploiting polar symmetry in designing equivariant observers for vision-based motion estimation Figure 1
arXiv preprint2024-03-11

Exploiting polar symmetry in designing equivariant observers for vision-based motion estimation

Tarek Bouazza I3S, CNRS, France bouazza@i3s.unice.fr, Robert Mahony Systems Theory, Australia Robert.Mahony@anu.edu.au, Tarek Hamel I3S, Université Côte d’Azur, Insitut Universitaire de France Sophia Antipolis, France thamel@i3s.unice.fr

Systems Theory and Robotics Group, Australian National University

6D位姿估计

面向视觉里程计/6D位姿中由本质矩阵只能得到平移方向、尺度需额外恢复的问题,本文把极线约束作为伪测量,并在相机位姿上引入 SO(3)×SOT(3) 的极坐标对称性,使测量与含速度输入的运动学满足等变结构,从而构造连续时间等变观测器。主要结果是给出显式持久激励条件,证明全位姿尤其尺度分量的可观性与稳定性,并用仿真验证滤波性能。

Real-Time Planning Under Uncertainty for AUVs Using Virtual Maps Figure 1
arXiv preprint2024-03-07

Real-Time Planning Under Uncertainty for AUVs Using Virtual Maps

Ivana Collado-Gonzalez, John McConnell, Jinkun Wang, Paul Szenher, Brendan Englot

6D位姿估计

针对水下 AUV 在无 GPS、特征稀疏环境中 SLAM 易漂移且在线 belief propagation 代价高的问题,论文把先验探索得到的 SLAM 图和占据地图转成带高斯不确定性的 virtual map,并作为代价图用于滚动时域规划,在到达目标与重访低不确定区域间折中。仿真显示其定位误差和不确定性显著低于最短路,接近完整 belief propagation,但计算更适合大尺度实时规划。

That's My Point: Compact Object-centric LiDAR Pose Estimation for Large-scale Outdoor Localisation Figure 1
arXiv preprint2024-03-07

That's My Point: Compact Object-centric LiDAR Pose Estimation for Large-scale Outdoor Localisation

Georgi Pramatarov, Matthew Gadd, Paul Newman

Mobile Robotics Group (MRG), University of Oxford

6D位姿估计点云

面向大规模室外定位中 LiDAR 地图存储和传输成本过高的问题,本文将每帧扫描压缩为“物体质心三维坐标+语义类别”的极简对象表示,并用融合几何自/交相关与语义监督的匹配网络恢复对象对应,再经加权 SVD、RANSAC/ICP 求位姿。在 KITTI 及 KITTI-KITTI360 长期跨数据集实验中,平均每帧约 1.33 kB,精度接近主流方法,KITTI 上约 0.1 m、0.5°误差。

Disentangled Diffusion-Based 3D Human Pose Estimation with Hierarchical Spatial and Temporal Denoiser Figure 1
arXiv preprint2024-03-07

Disentangled Diffusion-Based 3D Human Pose Estimation with Hierarchical Spatial and Temporal Denoiser

Qingyuan Cai, Xuecai Hu, Saihui Hou, Li Yao, Yongzhen Huang : 2

6D位姿估计人体姿态

本文针对单目 3D 人体姿态估计中扩散模型难以显式利用人体骨架先验、解耦骨长/骨向又易产生层级误差累积的问题,提出 DDHPose:在前向扩散中分别扰动骨长与骨向,并用解耦损失约束;反向去噪引入层级空间/时间 Transformer,强化父节点与相邻层级关节的信息交互。在 Human3.6M 和 MPI-INF-3DHP 上,相比解耦式、非解耦式和概率方法分别提升 10.0%、2.0% 和 1.3%。

Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation Figure 1
arXiv preprint2024-03-09

Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation

Ruicong Liu, Takehiko Ohkawa, Mingfang Zhang, Tokyo, Japan @iis.u-tokyo.ac.jp

The University of Tokyo, Tokyo, Japan

6D位姿估计手部姿态

针对自我中心单目手部3D姿态估计视野受限、深度歧义,以及传统多视角方法依赖昂贵标注和固定相机参数的问题,S2DHand将预训练单视图估计器无监督适配到任意双视图。其核心是利用跨视图一致性与相机坐标变换不变性生成伪标签,并通过注意力融合和旋转引导细化提升可靠性;实验显示在同数据集与跨数据集、任意相机对上均有明显改进,并优于已有适配方法。

FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimation Figure 1
arXiv preprint2024-03-05

FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimation

Chris Rockwell 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Nilesh Kulkarni 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Justin Johnson 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计相机位姿

针对传统对应点求解位姿精度高但在大视角/少重叠下脆弱且无法恢复尺度、端到端回归更稳但不够精确的问题,FAR用Transformer在学习位姿与RANSAC/五点求解器之间自适应加权,并用学习先验引导采样和评分。在Matterport3D、InteriorNet、StreetLearn和Map-free Relocalization上通常达到或匹配SOTA,且可适配不同特征与匹配器。

NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors Figure 1
arXiv preprint2024-03-05

NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors

Germany, Tübingen AI Center, Saarland Informatics Campus, Germany Imperial College London

University of Tübingen, Germany 2 Tübingen AI Center, Germany, Max Planck Institute for Informatics, Saarland Informatics Campus, Germany, Imperial College London, United Kingdom

6D位姿估计

针对关节姿态先验难以准确刻画真实可行姿态空间的问题,NRDF将姿态表示为乘积四元数流形上神经黎曼距离场的零水平集,并通过可控测地距离分布采样和自适应黎曼梯度投影,使优化过程始终满足旋转流形约束。实验显示其在人/手/动物姿态生成、图像姿态估计和逆运动学中优于VPoser、GAN-S、GFPose、Pose-NDF等先验。

Improved LiDAR Odometry and Mapping using Deep Semantic Segmentation and Novel Outliers Detection Figure 1
arXiv preprint2024-03-05

Improved LiDAR Odometry and Mapping using Deep Semantic Segmentation and Novel Outliers Detection

1 Introduction

6D位姿估计相机位姿点云

面向高速车辆/移动机器人中相邻 LiDAR 扫描位姿间隔大、LOAM 式最近邻匹配易产生错误对应的问题,论文将深度点云语义分割融入点到线/面匹配与语义建图,并指出同类不同物体会带来新的语义外点,因而设计显式外点检测剔除。KITTI 实验显示,语义约束结合外点拒绝可在高速或大位姿间隔场景提升里程计与建图鲁棒性。

Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps Figure 1
arXiv preprint2024-03-05

Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps

Timothy Chen, Ola Shorinwa, Joseph Bruno, Aiden Swann, Javier Yu, Weijia Zeng, Keiko Nagami, Philip Dames, Mac Schwager

Stanford University, Stanford, CA 94305, USA, University of California San Diego, San Diego, CA 92093, USA, Temple University, Philadelphia, PA 19122, USA, {brunoj6

6D位姿估计机器人操作三维重建高斯泼溅

针对 NeRF 等隐式地图难以支撑实时安全规划、传统点云又易丢失几何细节的问题,Splat-Nav 将高斯泼溅的椭球几何用于机器人导航:Splat-Plan 构造可证明安全的多面体走廊并生成 Bézier 轨迹,Splat-Loc 仅用单目 RGB 在同一 GSplat 地图中递归定位。仿真中其安全性优于点云规划,硬件飞行中达到与动捕/VIO 相近的安全和速度,且无需手动坐标系对齐,重规划超过 2Hz、定位约 25Hz。

PowerSkel: A Device-Free Framework Using CSI Signal for Human Skeleton Estimation in Power Station Figure 1
arXiv preprint2024-03-04

PowerSkel: A Device-Free Framework Using CSI Signal for Human Skeleton Estimation in Power Station

Cunyi Yin, Xiren Miao, Jing Chen, Hao Jiang, Jianfei Yang, Yunjiao Zhou, Min Wu, Zhenghua Chen

6D位姿估计

面向变电站巡检中可穿戴不便、摄像头受光照与盲区限制的问题,PowerSkel用自研ESP32 CSI传感器构建无线互感网络,并以稀疏自适应滤波抑制电力场景干扰;CKDformer结合协同知识蒸馏、卷积与自注意力,将CSI映射到人体关键点。真实电站实验达到PCK@50 96.27%,暗光下仍可进行骨架可视化。

A Simple Baseline for Efficient Hand Mesh Reconstruction Figure 1
arXiv preprint2024-03-04

A Simple Baseline for Efficient Hand Mesh Reconstruction

Zhishan Zhou, Shihao Zhou, Zhi Lv, Minqiang Zou, Yao Tang

Jiiov Technology

6D位姿估计手部姿态三维重建

针对现有手部网格重建方法模块复杂、实时性受限的问题,论文将解码器拆为 token generator 与 mesh regressor,并通过消融指出关键不在复杂设计,而在采样有判别性的代表点以及分阶段将稀疏关键点上采样为稠密网格。基于此构建的简洁基线在 FreiHAND、DexYCB 上达到约 5.5–6.1mm 的 PA-MPJPE/PA-MPVPE,并可实现 33–70 FPS。

MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Images Figure 1
arXiv preprint2024-03-03

MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Images

XYZ Robotics, 3dwe.ai

Technical University of Munich, Munich Center for Machine Learning, XYZ Robotics

6D位姿估计未知物体点云彩色深度

面向真实机器人中频繁出现的新物体,已有6D位姿方法往往需按物体/类别重训或依赖耗时渲染匹配,扩展性差。MatchU将问题建模为RGB-D与CAD点云的“融合-描述-匹配”,用旋转不变3D描述子泛化到未知物体并隐式处理对称性,再通过Latent Fusion Attention和RGB引导的粗匹配损失缓解纯几何歧义。实验显示其在未知物体基准上较现有方法同时提升精度与速度,且无需昂贵重训或渲染。

Single-image camera calibration with model-free distortion correction Figure 1
arXiv preprint2024-03-02

Single-image camera calibration with model-free distortion correction

PAGE 1, Katia Genovese

School of Engineering, University of Basilicata, Potenza, ITALY

6D位姿估计

针对 Zhang 多姿态标定在图像边缘畸变校正不足、内参可能被预设畸变模型带偏的问题,本文用覆盖全传感器的单张平面散斑图结合 DIC 建立密集对应,先估主点再分离求焦距与外参,最终得到无模型全场畸变图。合成噪声实验与 Zhang 法对比显示其计量可行性,真实实验表明单图方案能暴露多图平均会掩盖的成像细节。

Grid-based Fast and Structural Visual Odometry Figure 1
arXiv preprint2024-03-02

Grid-based Fast and Structural Visual Odometry

Zhang Zhihe

6D位姿估计相机位姿

针对特征法视觉里程计中线特征提取慢、分布不均且在位姿优化中利用不足的问题,GFS-VO面向RGB-D相机引入网格化点线联合框架:用EDLine与线连接加速并稳定线段,设计线特征均匀化策略,并通过基于BFS的平面法向提取估计曼哈顿轴,为局部地图与当前帧提供结构约束。实验显示其相较已有方法在运行时间和位姿精度上均有明显提升。

Optimal Robot Formations: Balancing Range-Based Observability and User-Defined Configurations Figure 1
arXiv preprint2024-03-01

Optimal Robot Formations: Balancing Range-Based Observability and User-Defined Configurations

Syed Shabbir Ahmed, Mohammed Ayman Shalaby, Jerome Le Ny, James Richard Forbes

Syed Shabbir Ahmed, Mohammed Ayman Shalaby, Jerome Le Ny, and James Richard Forbes

6D位姿估计机器人操作

针对多机器人UWB测距定位中“靠得近才可观、分得开才覆盖快”的矛盾,论文提出可定制的编队代价函数,把用户指定的相邻距离/方向、相机视野重叠、可观性与避碰统一优化。仿真和三架真实四旋翼实验表明,相比纯定位最优的聚集编队,所生成的高覆盖编队显著缩短覆盖时间,同时相对位姿与地标估计精度接近聚集编队,并避免直线编队的发散问题。

TEXterity -- Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity Figure 1
arXiv preprint2024-03-04

TEXterity -- Tactile Extrinsic deXterity: Simultaneous Tactile Estimation and Control for Extrinsic Dexterity

Parag Patre 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Alberto Rodriguez 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计

针对手内操作中物体被遮挡、接触动力学难建模而难以精确重抓的问题,TEXterity 将机器人本体感知与图像触觉结合,在外部表面辅助滑动的“外在灵巧”场景中同步做位姿估计与闭环控制:先用离散网格跟踪多义触觉观测下的可能位姿序列,再用连续估计-控制器细化并生成动作。实验显示其在多目标配置和多种物体上可自主规划并执行,位姿中位误差约 2–3 mm,优于单次估计方法,并能完成高公差插入与家用物体重构型。

Graph Convolutional Neural Networks for Automated Echocardiography View Recognition: A Holistic Approach Figure 1
arXiv preprint2024-03-01

Graph Convolutional Neural Networks for Automated Echocardiography View Recognition: A Holistic Approach

PAGE 1, Sarina Thomas1, Cristiana Tiago2, Børge Solli Andreassen1, Svein Arne Aase2

GE Research, Niskayuna, New York, USA

6D位姿估计

针对传统超声心动图视图识别只给类别、难以判断测量所需结构是否完整可见的问题,本文将视图识别转为2D图像到3D心脏网格的位姿回归:用GCN预测四腔室网格在超声切面的3D位置,并用扩散模型从3D网格生成带标注的合成超声以缓解3D标注缺乏。实验显示合成数据上视图识别和结构检测效果较好,仅用合成数据训练后在临床图像上也有一定潜力,但存在明显域差距,临床增益仍未充分验证。

Deep Learning for 3D Human Pose Estimation and Mesh Recovery: A Survey Figure 1
arXiv preprint2024-02-29

Deep Learning for 3D Human Pose Estimation and Mesh Recovery: A Survey

Yang Liu, Changzhen Qiu, Zhiyong Zhang

School of Electronics and Communication Engineering, Sun Yat-sen University, Shenzhen, Guangdong, China

6D位姿估计人体姿态综述

面向机器人、人机交互和自动驾驶中对人体三维状态理解的需求,本文系统梳理近五年基于深度学习的3D人体姿态估计与网格恢复。其主要洞察是将单人/多人姿态、显式人体模型与隐式表示统一到同一分类框架,并强调隐式渲染对衣物、表情等细节重建的作用;主要结果是汇总200余篇工作、公开数据集对比和未来挑战,但不提出新的算法增益。

Attention-Propagation Network for Egocentric Heatmap to 3D Pose Lifting Figure 1
arXiv preprint2024-02-28

Attention-Propagation Network for Egocentric Heatmap to 3D Pose Lifting

South Korea taeho.kang@hcs.snu.ac.kr, South Korea youngkilee@snu.ac.kr

Seoul National University, South Korea

6D位姿估计

面向头戴双目自视角中的严重自遮挡与肢体出视野问题,EgoTAP重新审视从关节热图到3D姿态的 lifting 环节:用Grid ViT按热图网格保留关节对应关系并建模远距离依赖,再用基于骨架层级的传播网络从可见关节推断模糊末端关节。在UnrealEgo与EgoCap上优于EgoGlass、UnrealEgo、Ego3DPose,UnrealEgo的MPJPE降低23.9%、PA-MPJPE降低17.7%。

Location-guided Head Pose Estimation for Fisheye Image Figure 1
arXiv preprint2024-02-28

Location-guided Head Pose Estimation for Fisheye Image

PAGE 1, Bing Li, Dong Zhang, Cheng Huang, Yun Xian, Ming Li, Senior Member, IEEE, Dah-Jye Lee, Senior

6D位姿估计

针对鱼眼/超广角图像边缘畸变使常规头部姿态估计失效、两阶段校正又依赖相机标定的问题,本文提出位置引导的端到端CNN,通过头部位置与欧拉角多任务学习让网络感知局部畸变,直接在鱼眼图上估计姿态。作者构建BIWI、300W-LP、AFLW2000的鱼眼畸变版本并补充真实鱼眼测试,结果显示相较一阶段和校正后两阶段方法均降低平均角度误差。

NToP: NeRF-Powered Large-scale Dataset Generation for 2D and 3D Human Pose Estimation in Top-View Fisheye Images Figure 1
arXiv preprint2024-02-28

NToP: NeRF-Powered Large-scale Dataset Generation for 2D and 3D Human Pose Estimation in Top-View Fisheye Images

Jingrui Yu, Dipankar Nandi, Roman Seidel, Gangolf Hirtz

6D位姿估计人体姿态数据集/基准三维重建

针对顶视鱼眼场景中2D/3D人体姿态数据稀缺、真实采集和标注成本高的问题,NToP提出用人体 NeRF 从既有侧视数据集渲染顶视全向图像,并同步生成关键点、相机参数和分割掩码,形成57万余张半合成数据。作者用 ViTPose 与 HybrIK-Transformer 在现有顶视基准和新建 OmniLab 上验证,微调后优于既有合成数据;但效果可能主要来自更大规模、更逼真的数据,渲染伪影与计算成本仍是限制。

Six-Point Method for Multi-Camera Systems with Reduced Solution Space Figure 1
arXiv preprint2024-02-28

Six-Point Method for Multi-Camera Systems with Reduced Solution Space

Banglei Guan 0000-0003-2123-0182, Ji Zhao 0000-0002-0150-4601, Laurent Kneip 0000-0001-6727-6608

College of Aerospace Science and Engineering, National University, of Defense Technology, China, Mobile Perception Lab, ShanghaiTech University, China

6D位姿估计多视角

面向多相机/广义相机在SLAM、自动驾驶中需用含外点匹配鲁棒估计完整6DoF相对位姿的问题,论文围绕六点最小求解器重构方程:解耦旋转与平移,用隐藏变量消去平移,并发现同相机匹配子集带来的射线束约束以缩小解空间、提升数值稳定性;还枚举了5953类六点配置。合成与真实实验显示,相比既有六点方法,其求解精度和效率更好。

HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields Figure 1
arXiv preprint2024-02-26

HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields

Switzerland [first name].[surname]@epfl.ch

6D位姿估计物体位姿手部姿态

该文针对单目手物交互中遮挡导致手部与物体6D/3D姿态难以联合估计的问题,提出 HOISDF:不再只依赖局部点云或网格等显式中间表示,而是学习手和物体的全局SDF,并用其进行查询点采样、特征增强和跨目标交互建模来约束姿态回归。实验在 DexYCB 与 HO3Dv2 上达到当时最优结果,说明全局隐式形状场对遮挡场景有实际增益。

DRSI-Net: Dual-Residual Spatial Interaction Network for Multi-Person Pose Estimation Figure 1
arXiv preprint2024-02-26

DRSI-Net: Dual-Residual Spatial Interaction Network for Multi-Person Pose Estimation

PAGE 1, Shang Wua, Bin Wanga

a School of Communication and Information Engineering, Shanghai University, Shanghai, China

6D位姿估计

针对多人姿态估计在遮挡、多尺度和复杂姿态下易出现关键点特征错位、而 Transformer 自注意力代价较高的问题,DRSI-Net采用锚点式框架,引入递归残差门控卷积、DRSI/C3DR模块和带通道/空间双注意力的ASI-PAN,以轻量方式实现高阶空间交互和多尺度特征精炼。文中在COCO上报告其精度与复杂度优于多种现有方法。

GEA: Reconstructing Expressive 3D Gaussian Avatar from Monocular Video Figure 1
arXiv preprint2024-02-26

GEA: Reconstructing Expressive 3D Gaussian Avatar from Monocular Video

Xinqi Liu, Chenming Wu, Jialun Liu, Xing Liu, Jinbo Wu, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang

6D位姿估计高斯泼溅

该文面向单目视频低成本构建可驱动、照片级人体高斯头像,针对现有3DGS头像依赖粗糙全身姿态、手脚错位以及高斯点分布不均导致新姿态伪影的问题,提出结合法线与轮廓的姿态细化,并用表面引导重初始化将高斯点重新约束到人体表面附近。实验显示其在新视角合成质量上达到当时SOTA,并支持身体与手部的细粒度驱动。

DreamUp3D: Object-Centric Generative Models for Single-View 3D Scene Understanding and Real-to-Sim Transfer Figure 1
arXiv preprint2024-02-26

DreamUp3D: Object-Centric Generative Models for Single-View 3D Scene Understanding and Real-to-Sim Transfer

Yizhe Wu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Jack Collins 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ingmar Posner 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计

面向机器人单视角RGB-D下的实时3D场景理解,DreamUp3D将对象中心生成模型与生成式辐射场结合,在自监督端到端框架中同时完成物体分割、形状补全/重建、对象潜表示和逐物体6D位姿估计;其形状蒸馏复用GRAF预测以降低反复NeRF查询开销,并缓解遮挡。实验在真实场景的重建、物体匹配和位姿估计中相对NeRF、CLIP特征、ObSuRF、ObPose取得显著优势。

XAI-based gait analysis of patients walking with Knee-Ankle-Foot orthosis using video cameras Figure 1
arXiv preprint2024-02-25

XAI-based gait analysis of patients walking with Knee-Ankle-Foot orthosis using video cameras

PAGE 1, Arnav Mishra1, Aditi Shetkar 2, Ganesh M. Bapat3, Rajdeep Ojha4, Tanmay Tulsidas

Dept. of Physical Medicine and Rehabilitation, Christian Medical College Vellore

6D位姿估计人体姿态医学/手术

针对传统视频步态分析依赖固定拍摄距离/静态相机且黑箱输出难被临床信任的问题,论文提出面向KAFO患者的可解释流程:先用超分辨率与2D姿态估计处理手持视频,再提取步幅、步长、单支撑时间、步频和速度等7个生物力学特征训练MLP,并解释各特征对“锁膝/半屈曲”分类的贡献。其在自建含动捕解释真值的数据集上平均准确率约94%,解释结果也与动捕统计显著性验证相符。

VOLoc: Visual Place Recognition by Querying Compressed Lidar Map Figure 1
arXiv preprint2024-02-25

VOLoc: Visual Place Recognition by Querying Compressed Lidar Map

Xudong Cai, Yongcai Wang, Zhe Huang, Yu Shao, Deying Li

6D位姿估计点云

面向城市级激光雷达地图因存储需压缩、而相机查询又存在图像—点云模态差异的问题,VOLoc用“几何相似性”替代外观匹配:离线以可逆的GPC保几何压缩地图,在线由VO和点云优化恢复局部查询点云,并用注意力聚合描述子在压缩空间检索。KITTI实验显示其精度可接近甚至优于部分Lidar-to-Lidar地点识别方法,但方法依赖图像序列,单帧适用性仍未解决。

CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledge Figure 1
arXiv preprint2024-02-24

CLIPose: Category-Level Object Pose Estimation with Pre-trained Vision-Language Knowledge

Xiao Lin, Minghao Zhu, Ronghao Dang, Guangliang Zhou, Shaolong Shu, Feng Lin, Chengju Liu, Qijun Chen † † ^ start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT

6D位姿估计物体位姿类别级位姿

CLIPose针对类别级6D位姿估计中过度依赖有限3D点云学习类别先验的问题,引入CLIP的图文预训练知识,将点云、图像块与带类别/位姿描述的文本在特征空间做多模态对比对齐,并用prompt tuning让图像编码器更关注位姿参数。该方法减少手工形状先验依赖,在REAL275和CAMERA25上达到SOTA或竞争结果,推理约40FPS。

Optimized Deployment of Deep Neural Networks for Visual Pose Estimation on Nano-drones Figure 1
arXiv preprint2024-02-23

Optimized Deployment of Deep Neural Networks for Visual Pose Estimation on Nano-drones

Matteo Risso, Francesco Daghero, Beatrice Alessandra Motetti, Daniele Jahier Pagliari, Enrico Macii, Massimo Poncino, Alessio Burrello

6D位姿估计

面向纳米无人机机载算力和存储极受限、难以运行视觉位姿估计网络的问题,论文将两阶段可微 NAS 串联:先在 MobileNet 类块间做层类型选择,再用 PIT 做通道级裁剪,并配合 GAP8/PULP 上 PW+DW 融合卷积内核减少中间访存。实验在人到纳米机位姿估计上相较既有方法最高降低 13.78% MAE,或在同等误差下将推理延迟最多降至 1/3.22。

Cameras as Rays: Pose Estimation via Ray Diffusion Figure 1
arXiv preprint2024-02-22

Cameras as Rays: Pose Estimation via Ray Diffusion

Jason Y. Zhang, Amy Lin, Moneish Kumar, Tzu-Hsuan Yang, Deva Ramanan

Carnegie Mellon University

6D位姿估计

针对稀疏视角下 SfM 难以稳定求解、直接回归全局外参又难利用局部对应的问题,本文将相机表示为图像 patch 对应的射线束,用集合 Transformer 预测射线,并进一步在射线空间做去噪扩散以表达多模态不确定性;由射线最小二乘恢复相机参数。在 CO3D 上回归版已超过既有方法,扩散版继续提升,并能泛化到未见类别和野外采集。

S^2Former-OR: Single-Stage Bimodal Transformer for Scene Graph Generation in OR Figure 1
arXiv preprint2024-02-22

S^2Former-OR: Single-Stage Bimodal Transformer for Scene Graph Generation in OR

Jialun Pei, Diandian Guo, Jingyang Zhang, Manxi Lin, Yueming Jin, Pheng-Ann Heng

Engineering, National University of Singapore, Singapore.(e-mail

6D位姿估计

针对手术室场景图生成依赖姿态估计、目标检测等多阶段流程导致信息割裂和部署成本高的问题,S²Former-OR改为单阶段双模态Transformer,融合多视角2D语义与3D点云几何,并用关系敏感解码器直接预测实体对关系。在4D-OR上相较现有OR-SGG方法Precision提升约3个百分点,同时参数减少24.2M。

VLPose: Bridging the Domain Gap in Pose Estimation with Language-Vision Tuning Figure 1
arXiv preprint2024-02-22

VLPose: Bridging the Domain Gap in Pose Estimation with Language-Vision Tuning

Appendix A Appendix

The Chinese University of Hong Kong1

6D位姿估计仿真到现实

这篇论文关注自然人像与绘画、雕塑等人工场景之间的姿态估计域差,指出直接微调会损害原自然域性能。VLPose冻结视觉主干并引入视觉提示,用文本编码域信息,通过视觉-语言关系匹配器和双分支 extractor-injector 解码器把图文关系注入热图预测。在 HumanArt 与 MSCOCO 上相对已有调参策略分别提升 2.26% 和 3.74%,但任务实际是人体姿态估计而非6D物体位姿。

Secure Navigation using Landmark-based Localization in a GPS-denied Environment Figure 1
arXiv preprint2024-02-22

Secure Navigation using Landmark-based Localization in a GPS-denied Environment

Ganesh Sapkota, Sanjay Madria

Department of Computer Science, Missouri University of Science and Technology

6D位姿估计

针对战场等 GPS 受干扰/欺骗场景中移动单元难以可靠导航的问题,论文提出 LanBLoc 地标定位与扩展卡尔曼滤波结合的框架,用可识别地标、预定义危险图和安全轨迹凸包包含测试来估计状态并约束下一步机动。仿真中该方法在安全轨迹估计上长度误差为 6.51%,ADE 为 2.97 m、FDE 为 3.27 m,但真实场景泛化与地标识别鲁棒性文中未充分说明。

SecurePose: Automated Face Blurring and Human Movement Kinematics Extraction from Videos Recorded in Clinical Settings Figure 1
arXiv preprint2024-02-21

SecurePose: Automated Face Blurring and Human Movement Kinematics Extraction from Videos Recorded in Clinical Settings

PAGE 1, Rishabh Bajpai, Bhooma Aravamuthan

6D位姿估计人体姿态

临床运动障碍视频既有共享与隐私风险,又需要保留可量化运动学信息。SecurePose将视频标准化、OpenPose全身关键点提取、个体追踪与患者识别结合,在运动学提取后自动进行人脸模糊,避免先匿名化干扰姿态分析。其在116名脑瘫儿童门诊步态视频上优于6种自动人脸检测方法,接近人工模糊准确性且处理时间减少91.08%,可用性也获研究者评分支持。

High-throughput Visual Nano-drone to Nano-drone Relative Localization using Onboard Fully Convolutional Networks Figure 1
arXiv preprint2024-02-21

High-throughput Visual Nano-drone to Nano-drone Relative Localization using Onboard Fully Convolutional Networks

Luca Crupi, Alessandro Giusti, Daniele Palossi

6D位姿估计

面向纳米无人机集群中受载荷、功耗和算力限制的机间相对定位问题,论文用低分辨率灰度相机和GAP8板载SoC,设计可端到端部署的轻量FCNN,同时预测图像坐标、深度及LED状态相关图。在约3万张真实图像和实机闭环测试中,该方法相较既有纳米机视觉方案提升R²表现,板载达到39 Hz、101 mW,并将平均跟踪误差降低37%,可持续飞完整块约4分钟电池。

EffLoc: Lightweight Vision Transformer for Efficient 6-DOF Camera Relocalization Figure 1
arXiv preprint2024-02-21

EffLoc: Lightweight Vision Transformer for Efficient 6-DOF Camera Relocalization

Zhendong Xiao 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Changhao Chen 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Shan Yang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计相机位姿

针对传统匹配式定位存储/计算开销大、CNN 回归在复杂户外场景鲁棒性不足的问题,EffLoc 将轻量化 ViT 用于单图 6DoF 相机重定位,结合重叠 patch、层次化低内存自注意力与顺序分组注意力,并重配 QKV 比例以减少冗余计算。实验显示其在精度—效率权衡上优于 AtLoc、MapNet 等,较 AtLoc FLOPs 降低 86.8%、内存降低 49.7%。

DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimation Figure 1
arXiv preprint2024-02-20

DiffusionNOCS: Managing Symmetry and Uncertainty in Sim2Real Multi-Modal Category-level Pose Estimation

Takuya Ikeda, 1 1 ^ start_FLOATSUPERSCRIPT, 1 end_FLOATSUPERSCRIPT, Sergey Zakharov, 2 2 ^ start_FLOATSUPERSCRIPT, 2 end_FLOATSUPERSCRIPT, Tianyi Ko 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Robert Lee 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Katherine Liu 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Rares Ambrus 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Koichi Nishiwaki 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计类别级位姿仿真到现实

面向类别级 6D 位姿在对称物体、遮挡和仅用合成数据迁移到真实场景时的多解与泛化难题,DiffusionNOCS 将位姿估计转化为扩散式稠密 canonical map 生成,并融合 RGB、法线与 DINOv2 语义特征以输出多假设对应关系。实验显示其仅用合成数据训练,在 NOCS 与新零样本泛化基准上平均超过多种合成/真实训练基线。

Landmark-based Localization using Stereo Vision and Deep Learning in GPS-Denied Battlefield Environment Figure 1
arXiv preprint2024-02-19

Landmark-based Localization using Stereo Vision and Deep Learning in GPS-Denied Battlefield Environment

Ganesh Sapkota, Sanjay Madria

Department of Computer Science, Missouri University of Science and Technology

6D位姿估计多视角

面向战场等 GPS 受拒且无线锚点难部署的定位场景,论文将已知地标作为被动锚点,用标定双目相机估深、YOLOv8s 识别地标,再经最小二乘三边定位与 L-BFGS-B 优化求未知节点位置。实测中地标检测 mAP@0.5 为 0.957,定位 RMSE 优于多种 DV-Hop,并接近或超过若干 VO/SLAM 基线。

Boosting Semi-Supervised 2D Human Pose Estimation by Revisiting Data Augmentation and Consistency Training Figure 1
arXiv preprint2024-02-18

Boosting Semi-Supervised 2D Human Pose Estimation by Revisiting Data Augmentation and Consistency Training

Huayi Zhou, Mukun Luo, Fei Jiang, Yue Ding, Hongtao Lu, Kui Jia

6D位姿估计人体姿态

针对2D人体姿态估计依赖大量关键点标注的问题,论文重新审视半监督一致性训练中的数据增强难度与训练结构:通过独立训练来排序增强、利用不同增强的协同组合构造更强的easy-hard样本,并用单网络多路径预测替代多网络堆叠。实验显示该设计在人体、鱼眼俯视和手部姿态基准上优于既有半监督方法,同时减少训练时间和参数。

Enhancing Surgical Performance in Cardiothoracic Surgery with Innovations from Computer Vision and Artificial Intelligence: A Narrative Review Figure 1
arXiv preprint2024-02-17

Enhancing Surgical Performance in Cardiothoracic Surgery with Innovations from Computer Vision and Artificial Intelligence: A Narrative Review

PAGE 1, Merryn D. Constable, 1 Hubert P. H. Shum, Stephen Clark3

Department of Psychology, Northumbria University, Newcastle-upon-Tyne, UK, Department of Computer Science, Durham University, Durham, UK, Department of Applied Sciences, Northumbria University, Newcastle-upon-Tyne, UK, College Lane

6D位姿估计医学/手术

针对心胸外科开放手术缺少机器人系统内置数据、难以客观评估技术与团队协作的问题,本文综述将无标记姿态估计、运动学指标和AI技能分类引入常规手术视频分析。核心洞察是手部/器械轨迹、速度、平滑度、空闲时间等可关联专业水平,并可用于培训反馈和结局研究;已有机器学习技能分类通常报告超过80%准确率,但多来自腹腔镜/机器人场景,开放心胸手术的真实增益、数据偏差与遮挡鲁棒性仍文中未充分说明。

Dense Matchers for Dense Tracking Figure 1
arXiv preprint2024-02-17

Dense Matchers for Dense Tracking

PAGE 1, 27th Computer Vision Winter Workshop

CMP Visual Recognition Group, Faculty of Electrical Engineering, Czech Technical University in Prague

6D位姿估计

本文关注视频中跨长时间、宽基线的稠密点跟踪问题,动机是传统光流多局限于相邻帧,难以支撑重建、位姿估计等任务。作者将 DKM、RoMa 等稠密匹配器接入 MFT 的多尺度时间间隔光流链框架,并分析其匹配准但遮挡预测弱的特点,进一步组合 RAFT-MFT 与 RoMa-MFT。实验表明,MFT 化后优于直接首帧匹配和逐帧串联,组合跟踪器超过原始 MFT,并在位置精度上可与更复杂的非因果方法竞争。

Occlusion Resilient 3D Human Pose Estimation Figure 1
arXiv preprint2024-02-16

Occlusion Resilient 3D Human Pose Estimation

EPFL, Optimization Lab

{}^{1} start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Computer Vision Lab, EPFL, Switzerland, {}^{2} start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Machine Learning and Optimization Lab, EPFL, Switzerland, {}^{3} start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT Samsung AI Center Toronto

6D位姿估计人体姿态

针对单目视频中人体关节被遮挡导致3D姿态估计不稳的问题,本文将跨帧人体表示为空间-时间图,并在图卷积细化网络训练中用结构化二值掩码模拟持续遮挡,使模型学习在节点/边缺失时仍恢复姿态。实验在 Human3.6M、MPI-INF-3DHP 和 SportCenter 上优于多种基线与单目序列SOTA,尤其在半监督场景表现突出,但仍受预训练2D检测器误差限制。

3D Diffuser Actor: Policy Diffusion with 3D Scene Representations Figure 1
arXiv preprint2024-02-16

3D Diffuser Actor: Policy Diffusion with 3D Scene Representations

Tsung-Wei Ke, Nikolaos Gkanatsios

Carnegie Mellon University

6D位姿估计

针对机器人示教中动作多模态与2D策略几何泛化不足的问题,论文将扩散式动作分布学习与3D场景表征结合,提出3D去噪Transformer,在同一3D空间内用token化场景、语言和本体状态通过相对位置注意力生成末端6D位姿轨迹。实验显示其在RLBench多/单视角分别较SOTA提升18.1/13.1个百分点,在CALVIN相对提升9%,并可用少量真实示教完成多任务操作。

Lester: rotoscope animation through video object segmentation and tracking Figure 1
arXiv preprint2024-02-15

Lester: rotoscope animation through video object segmentation and tracking

PAGE 1, Ruben Tous1

Department of Computer Architecture, Universitat Polit`ecnica de

6D位姿估计

该文面向传统转描动画逐帧制作成本高、扩散式视频风格迁移时序不稳的问题,将复古2D动画生成重新表述为视频对象分割与跟踪:用 SAM 为人物外观部件生成掩码,DeAOT 跨帧传播,再经 Douglas-Peucker 简化轮廓并叠加调色、阴影、像素化等效果。实验显示其在多姿态、动态镜头、半身画面和复杂背景下具有较好的时间一致性,但评价以主观展示为主,量化对比有限。

Foul prediction with estimated poses from soccer broadcast video Figure 1
arXiv preprint2024-02-15

Foul prediction with estimated poses from soccer broadcast video

Jiale Fang, Calvin Yeung

6D位姿估计

针对足球转播中球员尺度小、遮挡多且犯规预测少用姿态信息的问题,论文构建带犯规标签、bbox 与估计姿态的数据集,并提出 FutureFoul,将视频、框位置/裁剪图像和姿态序列通过 CNN+RNN 融合进行提前预测。消融实验显示完整模型优于去除模块的版本,RNN、bbox/图像与姿态均有辅助作用;但数据标注、跟踪丢失和姿态重叠仍限制可靠性。

IMUOptimize: A Data-Driven Approach to Optimal IMU Placement for Human Pose Estimation with Transformer Architecture Figure 1
arXiv preprint2024-02-14

IMUOptimize: A Data-Driven Approach to Optimal IMU Placement for Human Pose Estimation with Transformer Architecture

Varun Ramani, Hossein Khayami, Yang Bai, Nakul Garg, Nirupam Roy

University of Maryland, College Park

6D位姿估计人体姿态

针对视觉姿态估计易受遮挡、光照影响且稀疏 IMU 布置常依赖经验选择的问题,论文用特征消融等解释方法从 24 个候选关节中数据驱动挑选传感器位置,并以仅编码器 Transformer 替代 LSTM/biRNN建模时序。结果显示,优化后的 6 IMU 配置在 TotalCapture 上优于 DIP-IMU,Transformer 误差略低于 LSTM且训练约快 5 倍;但最优位置随数据集和模型变化,提示布置需按场景定制。

Are Semi-Dense Detector-Free Methods Good at Matching Local Features? Figure 1
arXiv preprint2024-02-13

Are Semi-Dense Detector-Free Methods Good at Matching Local Features?

Matthieu Vilain, Rémi Giraud, Hugo Germain, Guillaume Bourmaud Univ. Bordeaux, CNRS, Bordeaux INP, IMS, UMR 5218, F-33400 Talence, France @u-bordeaux.fr

6D位姿估计

本文关注半稠密无检测器匹配方法是否真的擅长局部特征对应,因为其常被位姿指标间接评价。作者提出结构化注意力匹配架构 SAM,并与 6 种 SDF 方法在 MegaDepth、HPatches、ETH3D 上比较,发现整体匹配精度高并不必然带来更好位姿;限制到纹理区域后,SAM 常优于 SDF,说明纹理区域精确对应与位姿/单应估计更强相关。

Gaussian-Sum Filter for Range-based 3D Relative Pose Estimation in the Presence of Ambiguities Figure 1
arXiv preprint2024-02-13

Gaussian-Sum Filter for Range-based 3D Relative Pose Estimation in the Presence of Ambiguities

Syed S. Ahmed, Mohammed A. Shalaby, Charles C. Cossette, Jerome Le Ny, James R. Forbes

Control Technology and Applications, August

6D位姿估计相机位姿高斯泼溅

面向无基础设施多机器人协作中仅靠UWB测距估计3D相对6D位姿的问题,论文针对两标签配置会产生有限离散歧义、EKF易陷局部模态的痛点,先用几何与最小二乘枚举歧义位姿并构成GMM,再以最少高斯分量初始化GSF跟踪真模态。仿真和实验证明其精度优于EKF、接近粒子滤波,同时计算快数个量级且一致性较好。

Learning to Produce Semi-dense Correspondences for Visual Localization Figure 1
arXiv preprint2024-02-13

Learning to Produce Semi-dense Correspondences for Visual Localization

Khang Truong Giang, Sungho Jo : School of Computing, KAIST, Daejeon, Seoul

School of Computing, KAIST, Daejeon, Republic of Korea, College of AI Convergence, Dongguk University, Seoul, Republic of Korea

6D位姿估计相机位姿

本文针对夜间、恶劣天气和季节变化下视觉定位依赖稀疏且预定义3D点、难以利用未观测密集匹配的问题,提出DeViLoc:用Point Inference Network结合几何与视觉线索把半稠密2D-2D匹配回归为2D-3D对应,并通过置信度聚合剔除外点。实验显示其在困难场景和稀疏/噪声3D模型下优于现有方法,在大规模定位基准上也具竞争力,但运行效率随匹配对增加而受限。

Extending 3D body pose estimation for robotic-assistive therapies of autistic children Figure 1
arXiv preprint2024-02-12

Extending 3D body pose estimation for robotic-assistive therapies of autistic children

Laura Santos, Bernardo Carvalho, Catarina Barata, José Santos-Victor

6D位姿估计人体姿态机器人操作

面向自闭症儿童机器人辅助治疗中需非接触、抗遮挡地获取儿童姿态的问题,论文将成人为主的3D人体建模/重建方法适配到儿童场景,并用线性回归微调关键输入以校正儿童3D网格。受控实验误差低于0.3 m,优于所比较方法;真实治疗场景中精度接近Kinect,但能在更多遮挡帧中恢复3D姿态。

GBOT: Graph-Based 3D Object Tracking for Augmented Reality-Assisted Assembly Guidance Figure 1
arXiv preprint2024-02-12

GBOT: Graph-Based 3D Object Tracking for Augmented Reality-Assisted Assembly Guidance

PAGE 1, Shiyu Li

Technical University of Munich, School of Medicine and Health, Department Clinical Medicine, Human-Centered Computing and

6D位姿估计

面向AR装配指导中多零件、遮挡和装配状态变化导致的实时无标记6D跟踪难题,GBOT用YOLOv8Pose初始化单视角RGB-D位姿,并以多状态装配图建模零件间相对位姿和运动学约束,动态切换装配阶段、将已连接零件作为模块跟踪。作者构建合成GBOT数据集及真实场景评测,结果显示其较ICG、SRT3D等跟踪器和单纯位姿估计更稳健,但强手部遮挡、快速光照变化及小/对称零件仍会导致失败。

UAV-assisted Visual SLAM Generating Reconstructed 3D Scene Graphs in GPS-denied Environments Figure 1
arXiv preprint2024-02-12

UAV-assisted Visual SLAM Generating Reconstructed 3D Scene Graphs in GPS-denied Environments

PAGE 1, Ahmed Radwan1, Ali Tourani1, Hriday Bavle1, Holger Voos1, Jose Luis Sanchez-Lopez1

6D位姿估计相机位姿航天器

面向室内等 GPS 拒止环境中无人机难以稳定定位并理解场景的问题,论文将搭载 RGB-D 相机的 UAV 与基于视觉标记的 VSLAM 框架集成,通过在墙、门等结构上布设 fiducial markers 并引入拓扑关系字典,同时重建地图和生成含房间、走廊等层级语义的 3D 场景图。真实室内实验显示轨迹与 OptiTrack 真值及 ORB-SLAM3 基线相比表现可用,但系统精度受标记遮挡、模糊和光照影响较大。

Improving 2D-3D Dense Correspondences with Diffusion Models for 6D Object Pose Estimation Figure 1
arXiv preprint2024-02-09

Improving 2D-3D Dense Correspondences with Diffusion Models for 6D Object Pose Estimation

PAGE 1, Peter Hönig

Automation and Control Institute, TU Wien, Austria, Department of Industrial Engineering, UAS Technikum Vienna, Austria

6D位姿估计物体位姿

该文关注仅用 RGB 做 6D 位姿估计时,密集 2D-3D 对应图在遮挡、杂乱和反光材质下质量不足的问题。作者把对应图估计视为图像到图像翻译,比较 Pix2Pix 与 Brownian-Bridge 扩散模型,并接 RANSAC E-PnP 求位姿。LMO 实验显示扩散模型生成的 NOCS 对应更平滑、边界和分割更准,位姿精度优于 GAN,且更受益于在线数据增强。

Real-time Holistic Robot Pose Estimation with Unknown States Figure 1
arXiv preprint2024-02-08

Real-time Holistic Robot Pose Estimation with Unknown States

Shikun Ban 0009-0007-6330-6057, Juling Fan 0009-0008-5012-8308, Xiaoxuan Ma 0000-0003-0571-2659, Wentao Zhu 0000-0002-5483-0259, Yu Qiao 0000-0001-8258-3868, Yizhou Wang 0000-0001-9888-6409

6D位姿估计机器人操作

针对实际机器人协作、人机交互中关节状态不可得或不可靠的问题,本文将未知状态下的整体机器人位姿估计分解为根深度、相机到机器人旋转、关节状态和根相对关键点等子任务,并用模块化前馈网络及一致性正则替代迭代优化/PnP。实验显示其在多种机器人上达到未知状态设定下的SOTA精度,并较Render-and-Compare快约12倍,实现实时推理。

Extending 6D Object Pose Estimators for Stereo Vision Figure 1
arXiv preprint2024-02-08

Extending 6D Object Pose Estimators for Stereo Vision

Thomas Pöllabauer, Jan Emrich, Volker Knauthe, Arjan Kuijper

Thomas Pöllabauer

6D位姿估计物体位姿多视角

本文针对单目6D位姿估计中的尺度歧义、遮挡和深度依赖问题,探索将GDRNet/SO-Pose等密集特征直接回归方法扩展到双目。核心做法是在不同阶段融合左右视图特征,并引入视差相关信息,同时构建BOP兼容的YCB-V DS双目数据集。实验表明,双目版本相较现有端到端6D位姿方法取得更高精度,但具体增益在各融合设计间的来源仍需结合完整结果判断。

NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interaction Figure 1
arXiv preprint2024-02-09

NCRF: Neural Contact Radiance Fields for Free-Viewpoint Rendering of Hand-Object Interaction

Zhongqun Zhang, Jifei Song, Eduardo Pérez-Pellitero, Yiren Zhou, Hyung Jin Chang, Aleš Leonardis, Huawei, Noah’s Ark Lab, zxz064@student.bham.ac.uk, @huawei.com @bham.ac.uk

University of Birmingham, UK Huawei, Noah’s Ark Lab

6D位姿估计手部姿态

针对手物交互中遮挡严重、接触关系难建模导致自由视角渲染模糊且6D位姿不准的问题,NCRF将接触优化场与动态手物NeRF联合训练,用注意力估计接触先验来细化手和物体姿态,并通过规范空间运动场与网格引导采样处理交互变形和遮挡。在HO3D、DexYCB上,其新视角渲染质量和手物位姿精度均优于已有方法。

Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Training Figure 1
arXiv preprint2024-02-07

Detection and Pose Estimation of flat, Texture-less Industry Objects on HoloLens using synthetic Training

Thomas Pöllabauer, Fabian Rücker, Andreas Franek, Felix Gorschlüter

Thomas Pöllabauer

6D位姿估计仿真到现实

面向AR辅助工业分拣,现有6D位姿网络难以在HoloLens等边缘设备本地运行,且定制、无纹理金属件缺少真实标注图像。论文从制造文档自动生成网格与合成训练数据,采用RGB单视角检测/6D位姿估计并以客户端—服务器方式把重计算移到工作站。作者在AR分拣任务及合成、HoloLens 2实拍数据上验证了可用性,但具体精度增益与瓶颈文中未充分说明。

4-Dimensional deformation part model for pose estimation using Kalman filter constraints Figure 1
arXiv preprint2024-02-07

4-Dimensional deformation part model for pose estimation using Kalman filter constraints

PAGE 1

Research Article

6D位姿估计

针对仅用RGB或深度进行人体姿态估计时信息利用不足、Kinect类方法训练成本和可移植性受限的问题,论文将DPM扩展为融合RGB-D的4维部件模型,并用骨架约束Kalman滤波提升连续帧关节跟踪;为控制复杂度,减少直接检测关节并用逆运动学补全。实验在CAD60和自建数据集上优于若干基线,且滤波带来额外精度提升,但具体增益拆分仍有限。

STAR: Shape-focused Texture Agnostic Representations for Improved Object Detection and 6D Pose Estimation Figure 1
arXiv preprint2024-02-07

STAR: Shape-focused Texture Agnostic Representations for Improved Object Detection and 6D Pose Estimation

Peter Hönig, Stefan Thalhammer, Jean-Baptiste Weibel Matthias Hirschmanner, Markus Vincze TU Wien, UAS Technikum Vienna

6D位姿估计

针对无纹理与金属物体在光照、反射变化下缺少稳定外观线索且 CNN 易依赖纹理的问题,STAR 在合成渲染阶段通过 UV 映射随机化物体表面纹理,迫使检测与位姿网络学习更偏形状、对纹理无关的表示。该方法几乎不增加渲染和训练开销,可接入现有流程;在三种检测器和两种 6D 位姿估计器上,对无纹理/金属物体及噪声、强光照扰动场景整体提升,且优于基于风格迁移的形状偏置方案。

A Computer Vision Based Approach for Stalking Detection Using a CNN-LSTM-MLP Hybrid Fusion Model Figure 1
arXiv preprint2024-02-05

A Computer Vision Based Approach for Stalking Detection Using a CNN-LSTM-MLP Hybrid Fusion Model

Murad Hasan 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Shahriar Iqbal 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

Department of Computer Science and Engineering, BRAC University, Dhaka 1212, Bangladesh

6D位姿估计

针对公共场景中物理尾随缺少自动检测的问题,本文将视频帧的CNN-LSTM时空特征与人脸关键点、头部姿态和相对距离等数值特征经MLP融合,用少量帧判断尾随/非尾随,并构建影视片段数据集训练评测。报告测试准确率89.58%,优于对比方法,但数据来源偏影视化,真实监控场景泛化仍文中未充分说明。

SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM Figure 1
arXiv preprint2024-02-05

SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM

Mingrui Li, Shuhong Liu, Heng Zhou, Guohao Zhu, Na Cheng, Tianchen Deng, Hongyu Wang

6D位姿估计相机位姿三维重建高斯泼溅

针对 NeRF/隐式 SLAM 在物体边界过平滑、语义解耦困难和渲染效率低的问题,SGS-SLAM 将语义特征并入 3D Gaussian Splatting 地图,用颜色、深度与语义多通道联合优化相机跟踪和建图,并用语义引导关键帧选择抑制累计误差。实验显示其在位姿估计、稠密重建、语义分割和物体级几何精度上优于多类 NeRF 与高斯 SLAM 基线,同时保持实时渲染能力。

Extreme Two-View Geometry From Object Poses with Diffusion Models Figure 1
arXiv preprint2024-02-05

Extreme Two-View Geometry From Object Poses with Diffusion Models

Yujing Sun, Caiyi Sun, Yuan Liu, Yuexin Ma, Siu Ming Yiu

6D位姿估计物体位姿

针对极端视角变化下两图几乎无重叠、传统特征匹配难以估计相对位姿的问题,论文将两视几何重写为物体位姿估计,并借助 Zero123 扩散模型生成物体新视角,再与查询图匹配反推出相机位姿。实验显示其在合成与真实数据上较匹配法和基于 Transformer 的 RelPose 系列更稳健,并可辅助 VO 闭环优化。

Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation Figure 1
arXiv preprint2024-02-04

Uncertainty-Aware Testing-Time Optimization for 3D Human Pose Estimation

Ti Wang, Mengyuan Liu, Hong Liu, Bin Ren, Yingxuan You, Wenhao Li, Nicu Sebe, Xia Li

6D位姿估计人体姿态

针对单目3D人体姿态在跨域场景中易受域差影响、测试时仅用2D投影约束又可能因深度歧义过拟合的问题,本文提出UAO:训练2D到3D提升网络同时估计关节不确定性,测试时冻结模型先验、只优化潜变量,并用不确定性限制各关节可偏移幅度。在Human3.6M、MPI-INF-3DHP和3DPW上验证有效,其中Human3.6M较此前最佳结果提升5.5%。

mmID: High-Resolution mmWave Imaging for Human Identification Figure 1
arXiv preprint2024-02-01

mmID: High-Resolution mmWave Imaging for Human Identification

Sakila S. Jayaweera, Sai Deepika Regani, Yuqian Hu, Beibei Wang, K. J. Ray Liu

Origin Research, Rockville, MD 20852, USA, University of Maryland, College Park, MD 20742, USA

6D位姿估计

针对毫米波/RF成像受孔径和分辨率限制、难以从静态人体中提取身份特征的问题,mmID不再只估计骨架关节,而是先用MUSIC空间谱作为cGAN输入,结合Kinect深度图监督重建整个人体高分辨率轮廓,再用轻量CNN做身份分类。在60GHz 802.11ad芯片、办公室和家庭环境、7名受试者实验中,生成轮廓与Kinect平均差异约5%,未见环境下静态人体识别准确率达93%;但有效距离主要限制在1–2m。

In-Bed Pose Estimation: A Review Figure 1
arXiv preprint2024-02-01

In-Bed Pose Estimation: A Review

PAGE 1, Ziya Ata Yazıcı

Istanbul Technical University, Istanbul Technical University, Istanbul, Turkey, Qatar University, Doha, Qatar

6D位姿估计

本文面向居家与医院睡眠监测中被褥遮挡下的在床人体位姿估计问题,系统梳理了压力垫、RGB/LWIR、深度等公开数据集、评价指标及单模态/多模态方法。核心洞察是多模态信息可缓解遮挡,非RGB模态也更利于隐私保护;主要结果是归纳出当前数据规模、场景覆盖和跨域泛化仍有限,未来需更真实的临床数据与稳健融合策略。

WayFASTER: a Self-Supervised Traversability Prediction for Increased Navigation Awareness Figure 1
arXiv preprint2024-02-01

WayFASTER: a Self-Supervised Traversability Prediction for Increased Navigation Awareness

Girish Chowdhary 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计

面向野外非结构化环境中单帧感知易丢失障碍、人工标注和启发式可通行性规则难部署的问题,WayFASTER用RHE产生的机器人经验与位姿自动监督训练网络,将RGB-D时序信息融合到BEV可通行性图中,并保留暂时离开视野的地形记忆。实验显示其能更稳健避障,同时把高草等几何上“可疑”但实际可通行区域判断为可行。

CMRNext: Camera to LiDAR Matching in the Wild for Localization and Extrinsic Calibration Figure 1
arXiv preprint2024-02-02

CMRNext: Camera to LiDAR Matching in the Wild for Localization and Extrinsic Calibration

Daniele Cattaneo, Abhinav Valada

6D位姿估计点云

针对低成本相机在已有 LiDAR 地图中定位、以及相机-LiDAR 外参标定难以跨传感器泛化的问题,CMRNext 将端到端位姿回归拆成跨模态点-像素匹配与几何 PnP 求解:用网络把匹配重表述为光流估计并预测不确定性,再由传统几何估计相对位姿。实验覆盖 6 个机器人平台,在公开数据和自研平台上均优于既有方法,并展示零样本迁移能力,但非实时且训练仍依赖真值位姿和准确内参。

Improved Scene Landmark Detection for Camera Localization Figure 1
arXiv preprint2024-01-31

Improved Scene Landmark Detection for Camera Localization

Tien Do, Sudipta N. Sinha

Microsoft

6D位姿估计

本文面向机器人/AR中的单图像6DoF相机定位,试图替代需大量存储局部特征且有隐私风险的结构化定位。作者指出原SLD精度差距主要来自模型容量不足和SfM生成的可见性标签噪声,并通过地标分组训练网络集成、用稠密重建改进可见性标注及更紧凑的SLD*架构提升效果。在INDOOR-6上其精度接近hloc,同时定位速度快40倍以上、存储约省20倍。

Navigating the Unknown: Uncertainty-Aware Compute-in-Memory Autonomy of Edge Robotics Figure 1
arXiv preprint2024-01-30

Navigating the Unknown: Uncertainty-Aware Compute-in-Memory Autonomy of Edge Robotics

Nastaran Darabi, Priyesh Shukla, Dinithi Jayasuriya, Divake Kumar, Alex C. Stutts, Amit Ranjan Trivedi AEON Lab, Chicago, Email: amitrt@uic.edu

Nastaran Darabi, Priyesh Shukla, Dinithi Jayasuriya, Divake Kumar, Alex C. Stutts, and Amit Ranjan Trivedi, AEON Lab, University of Illinois Chicago (UIC), Chicago, IL

6D位姿估计机器人操作

面向昆虫级无人机在动态室内环境中的低功耗、带置信度位姿估计,论文将存内计算扩展到贝叶斯/概率推理:用CMOS反相器类高斯电流与HMG地图模型加速粒子滤波,并用噪声与计算复用支持MC-Dropout视觉里程计。实验显示定位精度接近传统GMM,似然估计能耗约降低25倍,整体增益主要来自硬件-模型协同与并行模拟计算。

MESA: Matching Everything by Segmenting Anything Figure 1
arXiv preprint2024-01-30

MESA: Matching Everything by Segmenting Anything

Yesheng Zhang

Department of Automation, Shanghai Jiao Tong University

6D位姿估计

MESA针对半稠密/稠密特征匹配在整图搜索中存在大量冗余、易引入错误匹配的问题,利用SAM分割得到带隐式语义的区域,再构建含邻接与包含关系的区域图,将区域匹配转化为图模型能量最小化,并作为前端约束后续点匹配。实验显示其可提升多种匹配器在室内外任务中的精度,例如DKM室内位姿估计提升13.61%。

Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers Figure 1
arXiv preprint2024-01-30

Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers

Jianbin Jiao, Xina Cheng, ^ start_FLOATSUPERSCRIPT, end_FLOATSUPERSCRIPT, Weijie Chen, Xiaoting Yin, Hao Shi, Kailun Yang Correspondence: xncheng@xidian.edu.cn

School of Artificial Intelligence, Xidian University, China, State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University, China, School of Robotics, Hunan University, China, National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, China

6D位姿估计人体姿态

针对多视角视频中的3D人体姿态估计,论文认为现有Transformer方法仍偏重单帧图像特征,未充分利用跨帧时序与多相机空间关系。方法将序列帧输入多阶段Transformer,用窗口自注意力裁剪/保留人体相关patch以降噪降算力,再用帧-图像关系模块建模时间依赖和3D视角位置关系。在Human3.6M上报告达到SOTA,但具体增益来源仍需结合消融进一步判断。

Leveraging Positional Encoding for Robust Multi-Reference-Based Object 6D Pose Estimation Figure 1
arXiv preprint2024-01-29

Leveraging Positional Encoding for Robust Multi-Reference-Based Object 6D Pose Estimation

Jaewoo Park, Jaeguk Kim, Nam Ik Cho

Department of ECE, INMC, Seoul National University, Seoul, Korea

6D位姿估计物体位姿

针对单目物体6D位姿中坐标回归易在圆滑/弱纹理物体上产生模糊、迭代细化又易陷入局部最优且多参考渲染开销大的问题,论文提出MRPE:用NeRF式高频位置编码表示3D物体坐标,并在归一化像平面上做与内参解耦的离线多参考几何域细化,同时结合AdaIN和遮挡增强聚焦目标。实验在LM、LM-O和YCB-Video上优于已有方法。

Reconstructing Close Human Interactions from Multiple Views Figure 1
arXiv preprint2024-01-29

Reconstructing Close Human Interactions from Multiple Views

Qing Shuai, Zhiyuan Yu, Zhize Zhou, Lixin Fan, Haijun Yang, Can Yang, Xiaowei Zhou

State Key Laboratory of CAD&CG, Zhejiang University, Hong Kong University of Science and Technology, Hong Kong, Capital University of Physical Education and Sports

6D位姿估计

针对多人近距离互动中遮挡严重、跨视角关键点关联歧义大且真实标注稀缺的问题,本文将多视角2D关键点热图而非图像作为输入,引入带全局人体中心条件的3D体素网络,并用已知相机参数与大规模MoCap合成训练热图以贴近测试分布。实验显示其在近距离互动数据上较关联式和既有学习式方法取得更高3D姿态精度,并能泛化到不同相机配置与人数规模。

Multi-Person 3D Pose Estimation from Multi-View Uncalibrated Depth Cameras Figure 1
arXiv preprint2024-01-28

Multi-Person 3D Pose Estimation from Multi-View Uncalibrated Depth Cameras

PAGE 1, Yu-Jhe Li1

Carnegie Mellon University, Meta

6D位姿估计彩色深度多视角

本文针对少量、未标定 RGBD 相机下的多人 3D 姿态估计,动机是摆脱多视角 RGB 方法对密集相机、已知外参和 3D 标注训练的依赖。核心做法是提出无需 3D 回归训练的 MVD-HPE,用深度生成的彩色点云和 3D Re-ID 改善跨视角关联,并通过深度引导相机位姿估计与深度约束三角化联合恢复相机和人体姿态。作者自采多组 RGBD 视频并人工标注 3D 姿态,结果显示其在相机位姿和 3D 人体姿态上优于现有 regression-free 基线。

Multi-Robot Relative Pose Estimation in SE(2) with Observability Analysis: A Comparison of Extended Kalman Filtering and Robust Pose Graph Optimization Figure 1
arXiv preprint2024-01-30

Multi-Robot Relative Pose Estimation in SE(2) with Observability Analysis: A Comparison of Extended Kalman Filtering and Robust Pose Graph Optimization

Kihoon Shin, Hyunjae Sim, Seungwon Nam, Yonghee Kim, Jae Hu

6D位姿估计相机位姿机器人操作

面向多机器人协作控制中邻机相对位姿难以可靠估计的问题,论文从SE(2)非线性可观性出发,澄清了里程计是否共享时量测需求的差异:共享目标机器人里程计时,单独距离或方位量测在双方有非零线速度下即可可观;不共享时需同时具备距离和方位。作者在ROS/Gazebo四种信息结构及Turtlebot3+UWB实机上比较EKF与鲁棒PGO/NLS,结果显示PGO/NLS轨迹更平滑、误差通常低于EKF,但实机精度受UWB AOA视场和量测噪声限制。

Adaptive Deep Learning for Efficient Visual Pose Estimation aboard Ultra-low-power Nano-drones Figure 1
arXiv preprint2024-01-26

Adaptive Deep Learning for Efficient Visual Pose Estimation aboard Ultra-low-power Nano-drones

Beatrice Alessandra Motetti1, Luca Crupi2, Mustafa Omer Mohammed Elamin Elshaigi1, Matteo Risso1, Daniele Jahier Pagliari1, Daniele Palossi23, Alessio Burrello1

Dalle Molle Institute for Artificial Intelligence, USI and SUPSI, Lugano, 6962, Switzerland, Integrated Systems Laboratory (IIS), ETH Zürich, Zurich, 8092, Switzerland

6D位姿估计

针对厘米级纳米无人机算力、内存和功耗极低,静态CNN在人类相对位姿估计中难以兼顾精度与时延的问题,论文将不同复杂度的SoA轻量CNN组成自适应集成,并用输出时序一致性和辅助任务策略动态切换模型。在真实数据和实际硬件上,相同MAE下时延降低约28%,等时延下MAE降低约3%,最佳精度较原SoA提升约6%。

SimpleEgo: Predicting Probabilistic Body Pose from Egocentric Cameras Figure 1
arXiv preprint2024-01-26

SimpleEgo: Predicting Probabilistic Body Pose from Egocentric Cameras

PAGE 1, Hanz Cuevas-Velasquez

Max Planck Institute for Intelligent Systems, Microsoft Mesh Labs

6D位姿估计人体姿态

SimpleEgo面向HMD下视自我视角人体姿态估计,针对鱼眼镜头不利于硬件集成、热图方法难处理出框/遮挡关节且模型较重的问题,改用普通直线镜头图像直接回归参数化人体的关节旋转,并以矩阵Fisher分布表达不确定性。论文同时构建含6万组立体图的SynthEgo合成数据集;在该更难设置下MPJPE整体降低23%、下半身降低58%,参数量少8倍、速度约快2倍,并能较好迁移到真实图像。

Synthetic data enables faster annotation and robust segmentation for multi-object grasping in clutter Figure 1
arXiv preprint2024-01-24

Synthetic data enables faster annotation and robust segmentation for multi-object grasping in clutter

1 Dongmyoung Lee, 2 Wei Chen, 3 Nicolas Rojas

Dyson School of Design Engineering, Imperial College London

6D位姿估计物体位姿仿真到现实

面向杂乱场景多物体抓取中真实像素级标注昂贵、无CAD模型果蔬难以做6D位姿建模的问题,论文用WGAN-GP生成可自标注水果实例,并与少量真实场景合成混合数据训练RGB实例分割,再结合深度得到物体点云对应关系与抓取目标。实验显示该混合数据显著缩短标注时间,分割标注成功率达98.9%、抓取成功率70%,分别优于纯真实数据和公开数据集设置。

Linear Relative Pose Estimation Founded on Pose-only Imaging Geometry Figure 1
arXiv preprint2024-01-24

Linear Relative Pose Estimation Founded on Pose-only Imaging Geometry

Qi Cai, Xinrui Li, physalis@sjtu.edu.cn, yuanx_wu@hotmail.com

Shanghai Jiao Tong University

6D位姿估计相机位姿

针对两视图相对位姿估计中匹配外点多、RANSAC依赖最小采样全为内点且平面/纯旋转易退化的问题,论文提出LiRP线性算法,用n≥6点对批量求解,并将pose-only成像几何的LiGT约束作为重加权残差嵌入GNC-IRLS与RANSAC以筛除外点。仿真和Strecha实验显示,在最高80%外点下相对旋转精度较基线提升约2到10倍。

SemanticSLAM: Learning based Semantic Map Construction and Robust Camera Localization Figure 1
arXiv preprint2024-01-23

SemanticSLAM: Learning based Semantic Map Construction and Robust Camera Localization

Mingyang Li, Yue Ma, Computer Science

Department of Engineering and Computer Science, Syracuse University

6D位姿估计相机位姿

针对传统 VSLAM 依赖连续高频图像、计算与存储开销大的问题,SemanticSLAM 用 RGB-D 提取语义观测并构建可解释的网格语义地图,将当前观测与全局语义地图相关匹配进行相机定位,同时用 IMU 启动早期估计、ConvLSTM 修正地图更新误差。Gazebo 仿真实验显示其在低频观测和新环境中更稳健,位姿估计较代表性 VSLAM 方法提升约 17%。

RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos Figure 1
arXiv preprint2024-01-24

RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos

Hongchi Xia : 1, Yang Fu : 1, Sifei Liu, UC San Diego, NVIDIA

University of Illinois Urbana-Champaign, NVIDIA

6D位姿估计点云彩色深度

面向真实机器人感知中合成数据和纯 RGB 多视图数据难以提供可靠尺度、深度与杂乱场景标注的问题,本文构建 WildRGB-D:用 iPhone 360°采集约8500个物体、近2万段 RGB-D 视频,并自动生成掩码、真实尺度相机位姿和聚合点云。基准覆盖新视角合成、相机位姿、表面重建和6D位姿,结果显示深度与大规模真实数据能稳定改善多项3D学习任务,增益可能主要来自 scaling / data;但当前未提供物体6D位姿标注。

MobileARLoc: On-device Robust Absolute Localisation for Pervasive Markerless Mobile AR Figure 1
arXiv preprint2024-01-26

MobileARLoc: On-device Robust Absolute Localisation for Pervasive Markerless Mobile AR

Changkun Liu, Yukun Zhao, Tristan Braud

Hong Kong

6D位姿估计

面向大规模无标记移动 AR,论文针对结构化定位难上端、APR 快但不准、VIO 短期准却会漂移的问题,提出 MobileARLoc:用 VIO 相对运动一致性筛选可靠 APR,并以刚体变换把 VIO 结果转到世界坐标,同时用 APR 反馈校正漂移。仿真与手机实现显示,其可将底层 APR 误差约减半,MS-Transformer 平移/旋转最高提升 47%/66%,iPhone 端推理约 80ms。

SCENES: Subpixel Correspondence Estimation With Epipolar Supervision Figure 1
arXiv preprint2024-01-19

SCENES: Subpixel Correspondence Estimation With Epipolar Supervision

Dominik A. Kloepfer

Visual Geometry Group, University of Oxford, School of Computing, Australian National University

6D位姿估计

SCENES针对学习式局部匹配在新场景中泛化差、微调又依赖真值对应和3D结构的问题,提出用由相机位姿计算的极线损失替代对应监督,并进一步用估计位姿自举实现无强监督适配。该方法可作为现有Transformer匹配器的微调信号,在EuRoC-MAV室内无人机和户外手机等挑战数据上提升相对位姿估计,报告达到无强监督条件下的SOTA。

Source-Free and Image-Only Unsupervised Domain Adaptation for Category Level Object Pose Estimation Figure 1
arXiv preprint2024-01-19

Source-Free and Image-Only Unsupervised Domain Adaptation for Category Level Object Pose Estimation

Prakhar Kaushik, Aayush Mishra, Adam Kortylewski † † ^ start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT, ^ start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT akortyle@mpi-inf.mpg.de

Johns Hopkins University

6D位姿估计物体位姿类别级位姿仿真到现实

针对类别级物体位姿估计在目标域通常仍需深度、点云或源域数据的问题,论文提出 3DUDA,仅用目标域 RGB 图像做 source-free 无监督适配。其核心是利用跨域中局部物体部件更稳定、且局部可见时全局位姿可不准的洞察,按网格顶点更新神经特征并与特征提取器交替 EM 训练。实验显示在真实扰动、合成噪声和遮挡叠加的极端 UDA 场景下能显著提升位姿精度。

TEXterity: Tactile Extrinsic deXterity Figure 1
arXiv preprint2024-01-22

TEXterity: Tactile Extrinsic deXterity

Antonia Bronars, Sangwoon Kim, Parag Patre, Alberto Rodriguez

6D位姿估计

面向手内操作中物体被夹爪遮挡、外部视觉难以精确感知的问题,TEXterity将图像式触觉与机器人本体感知结合,用Viterbi离散位姿序列消歧,再以连续估计-控制器细化并闭环推动物体在外部平面上滑动重抓。实验覆盖多种3D打印物体和18类目标配置,归一化估计误差由单帧方法1.52降至0.10,并完成0.5–1 mm间隙插入任务。

Exploring Latent Cross-Channel Embedding for Accurate 3D Human Pose Reconstruction in a Diffusion Framework Figure 1
arXiv preprint2024-01-18

Exploring Latent Cross-Channel Embedding for Accurate 3D Human Pose Reconstruction in a Diffusion Framework

Junkun Jiang, Jie Chen

6D位姿估计人体姿态三维重建

该文针对单目单帧 3D 人体姿态从 2D 提升时的深度歧义和噪声问题,将扩散模型作为后处理来细化初始 3D 预测。核心在于跨通道嵌入同时建模 2D 投影与 3D 关节特征的相关性,并用上下文注意引导扩散迭代中的关节图信息传播。在 Human3.6M 与 MPI-INF-3DHP 上,方法较现有扩散/GCN式提升方案取得更高重建精度。

DK-SLAM: Monocular Visual SLAM with Deep Keypoints Adaptive Learning, Tracking and Loop-Closing Figure 1
arXiv preprint2024-01-17

DK-SLAM: Monocular Visual SLAM with Deep Keypoints Adaptive Learning, Tracking and Loop-Closing

Hao Qu, Lilian Zhang, Jun Mao, Junbo Tie, Xiaofeng He, Xiaoping Hu, Yifei Shi, Changhao Chen

6D位姿估计相机位姿

针对单目视觉 SLAM 在光照变化、低纹理和连续运动中手工特征不稳、深度特征泛化与回环检测困难的问题,DK-SLAM 将 MAML 训练的深度关键点、由光度直接法到 3D-2D 匹配的粗到细跟踪,以及在线学习的二值 BoW 回环结合。KITTI、EuRoC 等实验显示其优于 ORB-SLAM3、LIFT-SLAM,KITTI 平移和旋转精度分别提升约 17.7% 与 24.2%。

PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency Figure 1
arXiv preprint2024-01-17

PIN-SLAM: LiDAR SLAM Using a Point-Based Implicit Neural Representation for Achieving Global Map Consistency

Yue Pan, Xingguang Zhong, Louis Wiesmann, Thorbjörn Posewsky, Jens Behley, Cyrill Stachniss

6D位姿估计相机位姿点云

针对现有神经隐式 SLAM 难以在线回环校正、在大规模场景中地图全局一致性不足的问题,PIN-SLAM 用稀疏可优化神经点表示隐式 SDF,使地图可随位姿图优化弹性形变,并结合无对应点的点到隐式地图配准与体素哈希索引。实验表明其在 LiDAR 与 RGB-D 场景中定位精度达到或优于主流方法,地图更紧凑且可重建较完整网格,并能在中等 GPU 上接近传感器帧率运行。

AdaSem: Adaptive Goal-Oriented Semantic Communications for End-to-End Camera Relocalization Figure 1
arXiv preprint2024-01-16

AdaSem: Adaptive Goal-Oriented Semantic Communications for End-to-End Camera Relocalization

Qi Liao1, Tze-Yang Tung2

Nokia Bell Labs, Stuttgart, Germany, Nokia Bell Labs, Murray Hill, United States

6D位姿估计相机位姿

面向 AR/VR 等低时延远程相机重定位,论文指出既有语义通信多只优化率失真而忽略端到端推理复杂度与真实信道。AdaSem 将视觉/传感器输入直接编码为可变数量信道符号,结合潜空间分布和信道反馈自适应控制码率,并采用轻量收发模型。在真实环境数据和安卓客户端—边缘服务器基线对比中,端到端延迟降低超过75%,位姿误差降低超过63%。

S3M: Semantic Segmentation Sparse Mapping for UAVs with RGB-D Camera Figure 1
arXiv preprint2024-01-16

S3M: Semantic Segmentation Sparse Mapping for UAVs with RGB-D Camera

Thanh Nguyen Canh, Van-Truong Nguyen, Xiem HoangVan, Armagan Elibol, Nak Young Chong

University of Engineering and Technology, Vietnam National University, Department of Mechatronics Engineering, Hanoi University of Industry, School of Information Science, Japan Advanced Institute of Science and Technology

6D位姿估计点云彩色深度航天器

面向室内搜救等 GPS 失效且算力受限的无人机任务,S3M 将 ORB-SLAM3 的 RGB-D 6DoF 位姿估计、PSPNet 语义分割与 OctoMap 稀疏体素地图结合,并用几何-语义融合跨帧更新物体级地图,以降低点云存储和实时计算压力。论文在 Gazebo 中验证可构建语义稀疏地图,并部署到 Jetson Xavier AGX;但相对基线的定量精度和速度增益文中未充分说明。

Collaboratively Self-supervised Video Representation Learning for Action Recognition Figure 1
arXiv preprint2024-01-15

Collaboratively Self-supervised Video Representation Learning for Action Recognition

Jie Zhang, Zhifan Wan, Lanqing Hu, Stephen Lin, Shuzhe Wu, Shiguang Shan

6D位姿估计

该文针对视频动作识别中标注成本高、通用自监督预训练未显式建模人体动作结构的问题,提出 CSVR 框架,将未来人体姿态生成、I-frame/视频上下文对比匹配与当前/未来帧生成联合训练,以同时约束动态运动和静态场景表征。实验在 UCF101、HMDB51、Kinetics-400 等动作识别与视频检索设置中优于多种自监督方法;但其与 6D 位姿估计关联较弱。

3D Landmark Detection on Human Point Clouds: A Benchmark and A Dual Cascade Point Transformer Framework Figure 1
arXiv preprint2024-01-14

3D Landmark Detection on Human Point Clouds: A Benchmark and A Dual Cascade Point Transformer Framework

Fan Zhang, Shuyi Mao, Qing Li, Xiaojiang Peng

College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China, Department of Electrical and Computer Engineering, Georgia Institute of Technology, Shenzhen, China, AI Lab, Lenovo Research, Shenzhen, China

6D位姿估计点云数据集/基准

针对人体关键点检测长期依赖2D图像、难以直接处理无序3D点云的问题,论文构建了含103个人体点云与11个稳定标注点的HPoint103基准,并提出双级联Point Transformer:全局级联解码逐步回归关键点,局部RefineNet再细化坐标。在HPoint103和DHP19上,相比常见点云方法取得明显更低误差,且RefineNet接入其他方法也带来稳定增益。

On the representation and methodology for wide and short range head pose estimation Figure 1
arXiv preprint2024-01-11

On the representation and methodology for wide and short range head pose estimation

Alejandro Cobo, Roberto Valle, José M. Buenaposada, Luis Baumela

6D位姿估计

面向驾驶监控、群体交互等需要全 360° 头部姿态的场景,论文指出短范围 HPE 的欧拉角+MAE范式在大角度和跨数据集评测中会失效。其核心贡献是系统比较欧拉角、四元数、旋转矩阵/6D表示,主张用测地角距离评估,并提出可调样本贡献的 Opal loss 及训练/测试坐标系对齐流程。实验显示对齐可显著降低 300W-LP 到 Biwi 的系统误差并改变方法排序,6D/欧拉在短范围接近,宽范围需连续表示。

Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects Figure 1
arXiv preprint2024-01-10

Structure from Duplicates: Neural Inverse Graphics from a Pile of Objects

Tianhang Cheng, Wei-Chiu Ma, Kaiyu Guan, Antonio Torralba

University of Illinois Urbana-Champaign, Massachusetts Institute of Technology

6D位姿估计

这篇论文针对单图逆渲染缺少多视角约束、易受先验偏置影响的问题,提出利用同一图像中多个近似相同物体作为“隐式多视角”。SfD先联合估计各实例6DoF位姿,将单视角多物体转化为多视角单物体,再用共享几何与材质的神经逆图形模型恢复形状、材质和光照。实验在新建Dup数据集上显示,其重建、纹理与重光照质量优于单图方法,并可接近或超过部分多视角基线;但依赖准确分割、近乎相同实例和较好初始位姿。

Video-based Automatic Lameness Detection of Dairy Cows using Pose Estimation and Multiple Locomotion Traits Figure 1
arXiv preprint2024-01-10

Video-based Automatic Lameness Detection of Dairy Cows using Pose Estimation and Multiple Locomotion Traits

Helena Russello, Rik van der Tol, Menno Holzhauer, Eldert J. van Henten, Gert Kootstra

Agricultural Biosystems Engineering group, Wageningen University & Research, Wageningen, The Netherlands, Ruminant Health Department, Royal GD AH, Deventer, The Netherlands

6D位姿估计

针对奶牛跛行人工评分耗时且主观、传统视觉方法受光照和背景影响的问题,论文用 Faster R-CNN 裁剪奶牛并以 T-LEAP 无标记估计9个关键点,从轨迹提取背部姿态、点头、蹄迹距离等6类步态特征,并讨论多观察者标签合并以提升真值可靠性。户外视频中关键点正确率达99.6%,分类准确率由单特征76.6%提升到三大特征79.9%、全特征80.1%。

Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton Figure 1
arXiv preprint2024-01-10

Diffusion-based Pose Refinement and Muti-hypothesis Generation for 3D Human Pose Estimaiton

Hongbo Kang

6D位姿估计人体姿态

针对3D人体姿态估计中确定性模型难处理歧义、概率多假设又常因不确定性过大偏离真值的问题,DRPose将确定性初始3D姿态与扩散噪声结合,用反向扩散做姿态细化,并通过SGCT去噪学习潜特征、PRM平衡确定与不确定姿态。实验在Human3.6M和MPI-INF-3DHP上显示其单假设和多假设预测均达到SOTA。

Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker Figure 1
arXiv preprint2024-01-09

Towards Real-World Aerial Vision Guidance with Categorical 6D Pose Tracker

Jingtao Sun, Yaonan Wang, Danwei Wang

Nanyang Technological University, SG 639798, Singapore. E-mail

6D位姿估计航天器

面向无人机搭载机械臂的真实视觉引导,论文针对空中视角快速俯仰/横滚变化、帧间差异和类内形状变化导致的类别级6D位姿跟踪不稳问题,提出 Robust6DoF:融合2D-3D特征、时空增强过滤与先验引导关键点匹配,并用 PAD-Servo 将位姿解耦为旋转与平移动作。其在四个公开基准上优于对比方法,且在真实空中机器人平台验证了可部署性。

RHOBIN Challenge: Reconstruction of Human Object Interaction Figure 1
arXiv preprint2024-01-07

RHOBIN Challenge: Reconstruction of Human Object Interaction

Xianghui Xie 1, 3 1 2 3 ^ start_FLOATSUPERSCRIPT 1, 3 end_FLOATSUPERSCRIPT, Xi Wang 4 4 ^ start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT, Nikos Athanasiou 5 5 ^ start_FLOATSUPERSCRIPT 5 end_FLOATSUPERSCRIPT, Kaichun Mo 7 7 ^ start_FLOATSUPERSCRIPT 7 end_FLOATSUPERSCRIPT, Hao Chen 9 9 ^ start_FLOATSUPERSCRIPT 9 end_FLOATSUPERSCRIPT, Xia Jia 9 9 ^ start_FLOATSUPERSCRIPT 9 end_FLOATSUPERSCRIPT, Zerui Zhang 10 10 ^ start_FLOATSUPERSCRIPT 10 end_FLOATSUPERSCRIPT, Liangxian Cui 10 10 ^ start_FLOATSUPERSCRIPT 10 end_FLOATSUPERSCRIPT, Jie Xiao 10 10 ^ start_FLOATSUPERSCRIPT 10 end_FLOATSUPERSCRIPT, Wenfei Yang 10 10 ^ start_FLOATSUPERSCRIPT 10 end_FLOATSUPERSCRIPT, Hyeongjin Nam 11 11 ^ start_FLOATSUPERSCRIPT 11 end_FLOATSUPERSCRIPT, Otmar Hilliges 4 4 ^ start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT, Gerard Pons-Moll 1, 7 7 ^ start_FLOATSUPERSCRIPT 7 end_FLOATSUPERSCRIPT NVIDIA Research, Technology of China

6D位姿估计数据集/基准三维重建

针对人-物交互中严重遮挡和动态复杂导致的单目三维重建困难,RHOBIN 首次将人体重建、刚体 6D 位姿估计与联合重建放入同一 BEHAVE 基准和三赛道挑战中比较。结果显示优胜方法均超过既有 SOTA,2D-3D 对应是关键模块;人体重建已较成熟,而物体位姿和联合重建仍是主要瓶颈。

D3PRefiner: A Diffusion-based Denoise Method for 3D Human Pose Refinement Figure 1
arXiv preprint2024-01-08

D3PRefiner: A Diffusion-based Denoise Method for 3D Human Pose Refinement

PAGE 1, Danqi Yan, Qing Gao, Yuepeng Qian, Xinxing Chen, Chenglong Fu, Yuquan Leng

6D位姿估计人体姿态

单目3D人体姿态估计因深度歧义和遮挡常产生噪声,影响机器人从示教中学习高质量动作。D3PRefiner的核心洞察是估计误差在各维度呈可学习分布,因此用配对2D姿态和初始3D输出条件化多元高斯噪声,并借扩散反向过程逐步去噪,可作为任意seq2seq估计器的后处理。在两个SOTA基模型上,MPJPE至少降10.3%,P-MPJPE至少降11.0%。

Big Data and Deep Learning in Smart Cities: A Comprehensive Dataset for AI-Driven Traffic Accident Detection and Computer Vision Systems Figure 1
arXiv preprint2024-01-07

Big Data and Deep Learning in Smart Cities: A Comprehensive Dataset for AI-Driven Traffic Accident Detection and Computer Vision Systems

Victor Adewopo, Nelly Elsayed, Zag Elsayed, Murat Ozer, Constantinos L. Zekios, Ahmed Abdelgawad, Magdy Bayoumi

School of IT, University of Cincinnati, Florida International University, School of Eng. & Tech, Central Michigan University, University of Louisiana

6D位姿估计数据集/基准

面向智慧城市中真实交通事故样本稀缺、天气/光照/遮挡导致动作识别不稳的问题,论文整合 YouTube、Pexels、GitHub 等多源交通监控与行车记录仪视频,构建约 5700 条、覆盖事故与正常场景的公开基准数据集,并划分训练/验证/测试集;作者还以 I3D-CONVLSTM2D 结合 RGB 与光流验证其用于事故检测的可行性,但具体性能增益和来源文中未充分说明,可能主要来自数据规模与多样性。

Survey of 3D Human Body Pose and Shape Estimation Methods for Contemporary Dance Applications Figure 1
arXiv preprint2024-01-04

Survey of 3D Human Body Pose and Shape Estimation Methods for Contemporary Dance Applications

PAGE 1, Darshan Venkatrayappa, Alain Tremeau, Damien Muselet, Philippe Colantoni

Laboratoire Hubert Curien, Université Jean Monnet

6D位姿估计人体姿态综述

面向当代舞台表演中光学动捕需穿戴设备、限制舞者动作的问题,本文综述RGB图像/视频的3D人体姿态与形状估计方法,梳理SMPL、SMPL-X、MANO、FLAME等参数化模型及单帧、多视角、多帧方案在服装、视角、光照、背景和遮挡下的适用性。主要结论是舞蹈动作快速且姿态极端时,多帧跟踪方法如PHALP通常优于单帧估计,但定量增益和失效边界文中未充分说明。

Fit-NGP: Fitting Object Models to Neural Graphics Primitives Figure 1
arXiv preprint2024-01-04

Fit-NGP: Fitting Object Models to Neural Graphics Primitives

Marwan Taher, Ignacio Alzugaray, Andrew J. Davison Dyson Robotics Lab, Imperial College London @imperial.ac.uk

Dyson Robotics Lab, Imperial College London

6D位姿估计

面向精密抓取、插入等需要已知物体高精度6D位姿的机器人操作,Fit-NGP利用机械臂腕部单目RGB相机主动扫描,并将CAD模型直接拟合到Instant-NGP重建的密度场,而非依赖深度相机或纹理外观。核心洞察是即使密度场噪声较大,其边缘与密度跃迁仍足以约束模型位姿。真实机器人实验显示系统可在约两分钟内完成多物体检测与估计,对螺栓、垫圈等小型金属物体达到毫米级精度。

PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DOF Object Pose Dataset Generation Figure 1
arXiv preprint2024-01-04

PEGASUS: Physically Enhanced Gaussian Splatting Simulation System for 6DOF Object Pose Dataset Generation

Lukas Meyer, Floris Erich, Yusuke Yoshiyasu, Marc Stamminger, Noriaki Ando, Yukiyasu Domae

Industrial CPS Research Center, National Institute of Advanced Industrial Science and Technology, Japan

6D位姿估计物体位姿数据集/基准三维重建高斯泼溅

面向机器人操作中6D位姿数据采集昂贵、纯合成数据真实感不足的问题,PEGASUS用普通相机重建环境和物体的3D Gaussian Splatting表示,并结合物理引擎生成自然摆放场景,输出RGB、深度、掩码和位姿标注。实验显示,用其数据训练DOPE可迁移到真实UR5抓取任务;同时发布Ramen与PEGASET数据集。

Real-Time Human Fall Detection using a Lightweight Pose Estimation Technique Figure 1
arXiv preprint2024-01-03

Real-Time Human Fall Detection using a Lightweight Pose Estimation Technique

Ekram Alam, Abu Sufian, Paramartha Dutta, Marco Leo

6D位姿估计

面向老年居家看护中跌倒需及时发现、而现有方法算力需求较高的问题,论文用 Movenet Thunder 提取17个人体关键点,并以置信度筛选、上下半身关键点几何阈值和床面过滤规则实现本地实时跌倒检测。系统可在普通摄像头与低算力设备上运行,避免上传图像;在自建 GMDCSA 与 URFD 数据集上敏感度分别为0.9375和0.9167,但多人场景与精度提升仍文中未充分解决。

PLE-SLAM: A Visual-Inertial SLAM Based on Point-Line Features and Efficient IMU Initialization Figure 1
arXiv preprint2024-01-05

PLE-SLAM: A Visual-Inertial SLAM Based on Point-Line Features and Efficient IMU Initialization

Jiaming He, Mingrui Li, Yangyang Wang, Hongyu Wang

Maritime University, Dalian 116026, China (e-mail

6D位姿估计相机位姿

针对纯视觉或仅点特征 VI-SLAM 在低纹理、动态光照和快速运动下易漂移的问题,PLE-SLAM 将点线特征紧耦合用于跟踪与 BA,并通过线段合并/过滤提升稳定性;其 IMU 初始化把陀螺偏置优化与加速度计偏置、重力解析求解解耦,同时引入语义动态点剔除和深度特征闭环。公开数据集与真实场景实验显示其精度和鲁棒性达到同类先进水平。

3D Human Pose Perception from Egocentric Stereo Videos Figure 1
arXiv preprint2023-12-30

3D Human Pose Perception from Egocentric Stereo Videos

PAGE 1, Hiroyasu Akada

Max Planck Institute for Informatics, SIC

6D位姿估计人体姿态多视角

面向眼镜式第一视角双目视频中自遮挡严重、单目深度歧义和既有双目方法未利用场景的问题,论文提出基于 Transformer 的3D人体姿态估计框架,将2D关节热图、SfM重建得到的场景深度及深度padding mask、视频相关关节查询的时序增强结合起来。作者还发布更大合成集UnrealEgo2和真实集UnrealEgo-RW,实验在MPJPE上较既有方法分别提升约15%、40%和10%以上。

Geometry Depth Consistency in RGBD Relative Pose Estimation Figure 1
arXiv preprint2024-01-01

Geometry Depth Consistency in RGBD Relative Pose Estimation

Sourav Kumar Chiang-Heng Chien Benjamin Kimia, sourav_kumar@brown.edu, chiang-heng_chien@brown.edu, benjamin_kimia@brown.edu

School of Engineering, Brown University

6D位姿估计相机位姿点云彩色深度

针对RGBD相对位姿估计在低重叠、模糊或重复纹理下外点率很高、常规RANSAC迭代受限的问题,论文利用一对可信匹配可将其余匹配约束到成对嵌套曲线上的几何深度一致性(GDC)过滤外点,并结合Nested RANSAC从不同排序层采样。实验在TUM、ICL-NUIM和RGBD Scenes v2上显示,相比经典RANSAC可显著加速并提升高外点场景鲁棒性。

A comprehensive framework for occluded human pose estimation Figure 1
arXiv preprint2023-12-30

A comprehensive framework for occluded human pose estimation

Linhao Xu

6D位姿估计人体姿态

针对遮挡场景中样本稀缺、目标与干扰人体特征混淆以及身体结构信息缺失导致的人体姿态估计退化,论文提出 DAG 框架:用关节遮挡与实例粘贴合成遮挡数据,借助 ADAM 强化目标人体特征,并用特征引导多跳 GCN 结合人体结构先验修正关键点推理。作者在三个遮挡姿态基准上验证其优于已有方法,但具体增益在数据增强、注意力和图推理之间的占比仍需看消融细节。

6D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation Figure 1
CVPR 20242023-12-29

6D-Diff: A Keypoint Diffusion Framework for 6D Object Pose Estimation

Li Xu, Haoxuan Qu, Yujun Cai, Jun Liu

Singapore University of Technology and Design, Nanyang Technological University

6D位姿估计物体位姿

针对单目 RGB 6D 位姿估计在遮挡、杂乱背景下关键点热图噪声大、不确定性强的问题,6D-Diff 将2D关键点定位建模为反向扩散去噪过程,并用 Cauchy 混合分布刻画中间热图先验,再结合外观特征恢复稳定的2D-3D对应关系,经 PnP 求位姿;在 LM-O 与 YCB-V 上验证了有效性并取得更优表现。

MURP: Multi-Agent Ultra-Wideband Relative Pose Estimation with Constrained Communications in 3D Environments Figure 1
arXiv preprint2023-12-29

MURP: Multi-Agent Ultra-Wideband Relative Pose Estimation with Constrained Communications in 3D Environments

Andrew Fishberg, Brian Quiter, Jonathan P. How

B. Quiter is with Lawrence Berkeley National Laboratory

6D位姿估计相机位姿

面向无外部定位、通信受限的多机器人相对定位,MURP利用每个智能体上的多枚UWB标签,仅依赖本地测距、预设高度/姿态约束及约束违背时的事件通信,将3D相对位姿估计简化为更稳定的3自由度鲁棒非线性最小二乘,并按相对高度学习测距偏置校正。硬件实验中位置误差均值0.24m、航向误差9.5°,偏置校正使位置误差再降19%。

iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Figure 1
arXiv preprint2023-12-28

iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views

Yen-Chun Chen 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Bolivar Solarte 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Lu Yuan 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Min Sun 1, 3 1 3 ^ start_FLOATSUPERSCRIPT 1, 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Microsoft, sunmin@ee.nthu.edu.tw chinhsuanwu.github.io/ifusion

6D位姿估计三维重建

iFusion针对稀疏视角三维重建中“两张随手拍照片通常没有可靠相机位姿”的瓶颈,将Zero123这类新视角扩散模型反向用于两视图相对位姿优化,再用估计位姿对扩散模型做LoRA式目标物体自适应,生成更忠实的新视角并接入NeRF或3D Gaussian等重建器。实验显示其两视图位姿估计可优于若干五视图方法,新视角合成PSNR平均提升约3.6,重建体积IoU提升约7.2%。

EvPlug: Learn a Plug-and-Play Module for Event and Image Fusion Figure 1
arXiv preprint2023-12-28

EvPlug: Learn a Plug-and-Play Module for Event and Image Fusion

Jianping Jiang 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Xinyu Zhou 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Peiqi Duan 1, Boxin Shi 1, School of Intelligence Science, @pku.edu.cn

Peking University

6D位姿估计事件相机

针对RGB模型在过曝、运动模糊和低时间分辨率下易失效,而事件相机数据标注与专用融合模型成本高的问题,EvPlug通过事件生成模型约束无标注事件-RGB对,学习一个不改动原RGB网络权重的特征校准插件。其核心在于用事件特征修正退化RGB特征,并保留事件流的高时间分辨率;在目标检测、语义分割和3D手姿态估计上均优于多种迁移/蒸馏及单模态基线。

SR-LIVO: LiDAR-Inertial-Visual Odometry and Mapping with Sweep Reconstruction Figure 1
arXiv preprint2023-12-28

SR-LIVO: LiDAR-Inertial-Visual Odometry and Mapping with Sweep Reconstruction

Zikang Yuan 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Jie Deng 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Ruiye Ming 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Fengtian Lang 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Xin Yang 2 ⁣ * 2 ^ start_FLOATSUPERSCRIPT 2 * end_FLOATSUPERSCRIPT

6D位姿估计相机位姿点云三维重建

SR-LIVO针对现有LIV-SLAM中VIO易受光照变化、弱纹理和运动模糊影响而导致图像时刻位姿不稳的问题,将状态估计主要交给更鲁棒的LIO。其核心是用sweep reconstruction对齐重建激光扫描与相机时间戳,使LIO可直接求解成像时刻位姿,视觉模块仅负责相机参数优化和上色。实验在NTU_VIRAL和R3Live上显示其ATE优于主流方法,并相较R3Live约有1.6倍速度提升,重建质量相当或更好。

L-LO: Enhancing Pose Estimation Precision via a Landmark-Based LiDAR Odometry Figure 1
arXiv preprint2023-12-28

L-LO: Enhancing Pose Estimation Precision via a Landmark-Based LiDAR Odometry

PAGE 1

> REPLACE THIS LINE WITH YOUR MANUSCRIPT ID NUMBER (DOUBLE-CLICK HERE TO EDIT) <

6D位姿估计相机位姿点云

针对传统 LiDAR 里程计依赖点、线、面等局部几何特征,难以充分表达复杂环境且定位精度受限的问题,L-LO 将环境物体作为地标,利用上下分层凸包描述其外轮廓,并以尺寸与形状构成相似性指标完成配准,分阶段估计水平与垂直 6D 位姿。作者在 KITTI 和 UGV 实测数据上验证,相比 LOAM-Velodyne 等方法取得更高定位精度,同时生成包含分割地标的较丰富点云地图。

HMP: Hand Motion Priors for Pose and Shape Estimation from Video Figure 1
arXiv preprint2023-12-27

HMP: Hand Motion Priors for Pose and Shape Estimation from Video

Enes Duran

6D位姿估计手部姿态

判断受限于 PDF 文本抽取质量,当前内容主要来自补充材料。论文针对 HO3D、DexYCB 训练数据多样性不足导致野外视频泛化差的问题,从 AMASS 手部序列学习包含关节位置、速度、6D旋转与角速度的手部运动先验,并与 PyMAF-X 初始化结合进行视频中的手姿态与形状估计。结果称在 HO3D test 上优于现有方法,并提升 PyMAF-X 在 HO3D/DexYCB 上表现,但失败仍受关键点和框检测影响。

Camera calibration for the surround-view system: a benchmark and dataset Figure 1
arXiv preprint2023-12-27

Camera calibration for the surround-view system: a benchmark and dataset

Leidong Qin, Shujun Huang, Shangrong Yang, Yao Zhao

Institute of Information Science, \orgname, Beijing Jiaotong University, \orgaddress, Beijing Key Laboratory of Advanced Information Science and Network, \city

6D位姿估计数据集/基准

面向车载环视系统外参会因震动、碰撞等漂移且人工标定成本高的问题,论文提出无需标定板的自动外参校准流程:先用车道线几何粗估四个鱼眼相机姿态,再对前后相机迭代车道线重检测与位姿估计,对侧向相机通过相邻视角地面投影的纹理和边缘误差优化。作者同时构建含40段视频、3.2万帧及车道/外参标注的数据集,实验显示方法在真实交通场景中精度、鲁棒性和实时性较好。

Graph Context Transformation Learning for Progressive Correspondence Pruning Figure 1
arXiv preprint2023-12-26

Graph Context Transformation Learning for Progressive Correspondence Pruning

Junwen Guo, Guobao Xiao, Shiping Wang, Jun Yu

6D位姿估计

针对两视图匹配中外点比例高、现有学习式剪枝偏重“收集”上下文而缺少有效利用的问题,GCT-Net 将对应关系构成图,并用 GCET 在多分支图上下文间通过自注意力与交叉注意力强化互补信息,再由 GCGT 采样高置信匹配引导全局一致性判断。实验显示其在室内外外点剔除与相对位姿估计上优于当时方法,但具体收益中各模块贡献仍需结合消融判断。

Lifting by Image -- Leveraging Image Cues for Accurate 3D Human Pose Estimation Figure 1
arXiv preprint2023-12-25

Lifting by Image -- Leveraging Image Cues for Accurate 3D Human Pose Estimation

Feng Zhou, Jianqin Yin, Peiyang Li

6D位姿估计人体姿态

该文针对2D到3D人体姿态提升中的深度歧义,以及直接引入图像特征易过拟合实验室背景、泛化差的问题,指出有效线索并不局限于关键点局部,而包括结构相关部位。方法以两阶段渐进框架让关键点先广泛查询图像块,再用Pose-guided Transformer与自适应特征选择抑制背景、保留关键人体线索,最终在Human3.6M和MPI-INF-3DHP上达到SOTA表现。

APTv2: Benchmarking Animal Pose Estimation and Tracking with a Large-scale Dataset and Beyond Figure 1
arXiv preprint2023-12-25

APTv2: Benchmarking Animal Pose Estimation and Tracking with a Large-scale Dataset and Beyond

Yuxiang Yang, Yingqi Deng, Yufei Xu, Jing Zhang

6D位姿估计数据集/基准

针对动物视频中姿态估计与身份跟踪长期割裂、缺少连续帧关键点基准的问题,APTv2构建了覆盖30种动物的2749段视频、4.1万帧和8.5万实例标注,并设置单帧、低数据泛化和姿态跟踪三条评测轨道及ViTPoseTrack基线。实验显示ViT类模型、跨人/动物预训练与多物种数据有助于提升表现,但部分增益可能主要来自scaling / data。

PACE: Pose Annotations in Cluttered Environments Figure 1
arXiv preprint2023-12-23

PACE: Pose Annotations in Cluttered Environments

PAGE 1, PACE: A Large-Scale Dataset with Pose

Stanford University, Shanghai Jiao Tong University, Horizon Robotics Inc

6D位姿估计

现有6D位姿数据集规模小、场景受限,难以暴露模型在真实杂乱环境中的泛化问题。PACE通过三相机标定与去标记/移动物体校正流程,构建含刚体、关节体、遮挡和堆叠的真实基准,并配套大规模仿真训练集。实验显示多种SOTA在NOCS近乎饱和但迁移到PACE后性能大幅崩塌,说明瓶颈可能主要来自数据与场景复杂度。

PoseGen: Learning to Generate 3D Human Pose Dataset with NeRF Figure 1
arXiv preprint2023-12-22

PoseGen: Learning to Generate 3D Human Pose Dataset with NeRF

Mohsen Gholami, Rabab Ward, Z. Jane Wang

6D位姿估计人体姿态数据集/基准三维重建

针对公开3D人体姿态数据在姿态与视角上覆盖不足、模型遇到分布外样本易退化的问题,PoseGen将可微NeRF渲染接入数据生成闭环,由生成器产生3D姿态和相机视角,并利用预训练姿态估计器的误差反馈主动生成高难度/OOD样本用于微调,而非离线随机合成。实验在SPIN、HybrIK及四个数据集上平均带来约6%相对提升,用户特定场景也有明显增益,但多主体与复杂姿态渲染仍受NeRF能力限制。

Harnessing Diffusion Models for Visual Perception with Meta Prompts Figure 1
arXiv preprint2023-12-22

Harnessing Diffusion Models for Visual Perception with Meta Prompts

Qiang Wan 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Bingyi Kang 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Jiashi Feng 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT

6D位姿估计

本文针对文本到图像扩散模型难以直接迁移到视觉感知任务的问题,提出用可学习的 meta prompts 替代文本提示,在预训练扩散 UNet 中激活并重排任务相关特征,并结合循环细化训练增强表征。实验显示其在 NYU/KITTI 深度估计和 CityScapes 语义分割刷新结果,在 ADE20K 分割与 COCO 姿态估计上接近 SOTA。

Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization Figure 1
arXiv preprint2023-12-22

Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization

3 2 3 ^ start_FLOATSUPERSCRIPT 2, CNRS, Inria, LORIA Emails: @u-bourgogne.fr

6D位姿估计综述

针对偏振相机在位姿估计、3D重建等机器人感知中有潜力但缺少统一工具与标准的问题,本文不是提出新的6D位姿算法,而是系统梳理偏振视觉应用,并发布Pola4All开源采集与处理工具包,支持主流微栅格RGB-偏振相机、GUI与常用偏振图像算法。主要结果是降低偏振数据分析门槛,并通过综述与用例说明其在透明、无纹理物体等RGB困难场景中的补充价值。

PoseViNet: Distracted Driver Action Recognition Framework Using Multi-View Pose Estimation and Vision Transformer Figure 1
arXiv preprint2023-12-22

PoseViNet: Distracted Driver Action Recognition Framework Using Multi-View Pose Estimation and Vision Transformer

PAGE 1, IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX 2017

6D位姿估计多视角

面向驾驶分心导致事故、单视角或纯CNN难以稳定捕捉车内动作的问题,PoseViNet将三视角图像中的MediaPipe姿态关键点叠加到输入,引导ViT关注手、脸和身体ROI,并用动作推理模块融合不同视角概率。实验在SFD3的10类行为上优于对比方法,在更难的SynDD1 16类上达到97.55%验证准确率和90.92%测试准确率。

Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learning Figure 1
arXiv preprint2023-12-22

Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learning

Jay Shenoy, 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Axel Levy, 3 2 3 ^ start_FLOATSUPERSCRIPT 2, 3 end_FLOATSUPERSCRIPT Frédéric Poitevin

6D位姿估计三维重建

面向高重复率 XFEL 单颗粒成像中数百万衍射图的未知姿态搜索瓶颈,论文提出 X-RAI:用 CNN 编码器摊销每张图的 6D/旋转位姿估计,并结合遵循 X 射线衍射物理的隐式神经体解码器,以自监督在线学习重建三维强度/电子密度。实验显示其在小规模仿真和真实 PR772 数据上达到或优于 M-TIP、Dragonfly,并能单 GPU 约 161 张/秒在线处理百万级图像。

3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera Figure 1
arXiv preprint2023-12-21

3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera

Christen Millerdurai, Diogo Luvizon, Viktor Rudnev, André Jonas Jiayi Wang, Christian Theobalt, Vladislav Golyanik MPI for Informatics, SIC, RPTU Kaiserslautern-Landau

Saarland University, SIC

6D位姿估计手部姿态事件相机

针对RGB手部跟踪在高速运动、遮挡和弱光下易模糊且双手左右易混淆的问题,本文提出首个单目事件相机双手3D跟踪框架Ev2Hands,将事件流表示为时空点云,用半监督逐点分割与特征级注意力区分左右手,并加入交互/穿透损失约束手网格碰撞;同时发布合成Ev2Hands-S和真实Ev2Hands-R数据集,实验显示其在3D重建精度上优于事件与RGB基线,并能泛化到严苛光照真实数据。

DUSt3R: Geometric 3D Vision Made Easy Figure 1
arXiv preprint2023-12-21

DUSt3R: Geometric 3D Vision Made Easy

Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, Jerome Revaud, Naver Labs Europe, shuzhe.wang@aalto.fi, firstname.lastname@naverlabs.com

Aalto University Naver Labs Europe

6D位姿估计

DUSt3R针对传统SfM/MVS依赖相机内外参、流程串联且易在少视角或弱几何条件下失效的问题,将双图重建改写为密集3D pointmap回归,并用Transformer直接学习像素到场景几何及视角关系;多图时再通过3D空间全局对齐融合。实验显示其可从未标定、未知位姿图像中同时恢复场景、深度、匹配和相机,在单/多目深度与相对位姿估计上达到新的SOTA。

NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fields Figure 1
arXiv preprint2023-12-20

NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fields

Jens Naumann, Binbin Xu, Stefan Leutenegger

Binbin Xu is with University of Toronto, M3H 5T6 Toronto, Canada

6D位姿估计相机位姿三维重建

针对单目 RGB 神经 SLAM/VO 难以兼顾实时跟踪、尺度一致的稠密几何和低显存的问题,NeRF-VO 用学习式稀疏 VO 初始化位姿与路标,再引入单目深度/法向先验并做稀疏到稠密尺度对齐,在滑窗内联合优化关键帧位姿与 NeRF 场景。实验覆盖 Replica、ScanNet、7-Scenes 等,显示其在位姿精度、新视角合成和三维重建上优于多种 SOTA,同时跟踪频率更高、GPU 占用更低。

Brain-Inspired Visual Odometry: Balancing Speed and Interpretability through a System of Systems Approach Figure 1
arXiv preprint2023-12-20

Brain-Inspired Visual Odometry: Balancing Speed and Interpretability through a System of Systems Approach

PAGE 1, Habib Boloorchi Tabrizi

Oklahoma State University

6D位姿估计相机位姿

该文针对单目视觉里程计在实时速度、位姿精度与可解释性之间的权衡,提出受脑“系统之系统”启发的模块化框架:用传统VO先产生位姿特征,再由轻量全连接网络按6个自由度独立推断,并引入时间戳可解释分析以观察RPE变化。实验称系统可达35–64 FPS,部分场景RMSE最多降低约5%,但具体增益相对哪些基线及来源仍需结合全文细节判断。

Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics Figure 1
arXiv preprint2023-12-18

Unified framework for diffusion generative models in SO(3): applications in computer vision and astrophysics

Yesukhei Jagvaral, Francois Lanusse, Rachel Mandelbaum

6D位姿估计

针对欧氏扩散模型难以直接处理三维旋转流形数据的问题,本文将 SGM 与 DDPM 统一推广到 SO(3),利用该李群可解析热核和几何 SDE/ODE 求解器构造更高效的旋转生成模型。实验显示,SO(3) SGM 在合成旋转分布上达到新 SOTA,并在 SYMSOL 位姿估计及星系取向建模中优于或验证了现有基线的实用性。

Underwater Robot Pose Estimation Using Acoustic Methods and Intermittent Position Measurements at the Surface Figure 1
arXiv preprint2023-12-18

Underwater Robot Pose Estimation Using Acoustic Methods and Intermittent Position Measurements at the Surface

Vicu-Mihalis Maer, Levente Tamás, Lucian Bușoniu

Department of Automation, Technical University of Cluj-Napoca

6D位姿估计机器人操作

水下机器人无法直接使用GPS,海底垃圾搜索与回收又需要地理参考位姿。论文在ROS/Gazebo的SeaClear仿真中,用扩展卡尔曼滤波评估IMU、DVL、USBL等声学/惯性传感器组合,并进一步考察周期上浮后由GPS或空中无人机视觉提供高精度位置校正的作用。结果表明,常规融合能在一定程度上估计6D位姿,但会受DVL底面假设和USBL稀疏、异常值影响而漂移;间歇表面测量可有效抑制累积误差,适合作为低成本传感器配置的补偿策略。

SHaRPose: Sparse High-Resolution Representation for Human Pose Estimation Figure 1
arXiv preprint2023-12-17

SHaRPose: Sparse High-Resolution Representation for Human Pose Estimation

Xiaoqi An, Lin Zhao 1 Corresponding authors, Chen Gong, Nannan Wang, Di Wang, Jian Yang : 1

6D位姿估计人体姿态

针对人体姿态估计中为少量关键点却对整图构建密集高分辨率特征带来的 Transformer 计算开销,SHaRPose 的核心洞察是只在与关键点相关的区域细化表示:先用粗粒度 token 估计并挖掘区域-关键点关系,再由质量预测器决定是否进入局部高分辨率精修。其在 COCO 上较 ViTPose-Base 提升约 0.5 AP,同时 GFLOPs 降低约 25%、推理速度提升 1.4 倍。

PNeRFLoc: Visual Localization with Point-based Neural Radiance Fields Figure 1
arXiv preprint2023-12-17

PNeRFLoc: Visual Localization with Point-based Neural Radiance Fields

Boming Zhao, Luwei Yang, Mao Mao, Hujun Bao, Zhaopeng Cui

6D位姿估计相机位姿三维重建

PNeRFLoc针对现有NeRF定位多停留在数据增强、缺少几何约束而新视角泛化受限的问题,将点式NeRF作为统一表示,同时支持2D-3D特征匹配的初始位姿估计和基于新视图渲染的位姿细化;其特征适配模块连接定位特征与渲染特征,并用warping loss提升优化效率。实验显示,在NeRF可充分学习的合成场景表现最佳,真实定位基准上显著优于NeRF增强回归方法,并接近SOTA。

SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation Figure 1
arXiv preprint2023-12-15

SoloPose: One-Shot Kinematic 3D Human Pose Estimation with Video Data Augmentation

David C. Jeong, Hongji Liu, Saunder Salazar, Jessie Jiang, Christopher A. Kitts

Santa Clara University

6D位姿估计人体姿态

该文针对视频3D人体姿态估计中两阶段误差传递、many-to-one推理低效以及数据集多样性不足的问题,提出SoloPose:直接从单目视频序列进行one-shot、many-to-many时空Transformer估计,并用包含运动学邻接关系的GMM 3D热图HeatPose与交叉熵训练;同时通过AugMotion统一多数据集坐标生成Humans7.1M。实验称在Human3.6M和扩增数据上优于现有方法,但具体增益中模型与数据扩增的贡献需结合消融判断。

iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching Figure 1
arXiv preprint2023-12-14

iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching

Yuan Sun, Xuan Wang, Yunfan Zhang, Jie Zhang, Caigui Jiang, Yu Guo, Fei Wang

6D位姿估计相机位姿高斯泼溅

iComMa针对基于NeRF反演的相机位姿估计在大旋转、平移等不良初始化下易收敛失败的问题,改用3D Gaussian Splatting构建可微渲染优化,并将像素级render-and-compare损失与端到端关键点匹配损失结合,在无需类别训练和CAD模型的RGB场景中提升鲁棒性与精度;实验显示其在合成和真实复杂数据上优于现有方法,并较iNeRF约快一个数量级。

Scene 3-D Reconstruction System in Scattering Medium Figure 1
arXiv preprint2023-12-14

Scene 3-D Reconstruction System in Scattering Medium

Zhuoyifan Zhang, Lu Zhang, Liang Wang, Haoming Wu

6D位姿估计三维重建

针对水下/散射介质中图像退化导致 NeRF 重建训练慢、渲染低效的问题,论文将 CLAHE+Retinex 连续帧增强、关键帧筛选、COLMAP 位姿估计与多分辨率哈希编码 NeRF 结合成一套单目视频三维重建流程。实验显示其在约 1–10 分钟内取得接近或部分优于 Seathru-NeRF 的 PSNR/SSIM 权衡,但水下成像物理未充分建模,颜色保真和伪影仍有限。

CattleEyeView: A Multi-task Top-down View Cattle Dataset for Smarter Precision Livestock Farming Figure 1
arXiv preprint2023-12-14

CattleEyeView: A Multi-task Top-down View Cattle Dataset for Smarter Precision Livestock Farming

Kian Eng Ong, Sivaji Retta, Ramarajulu Srinivasan, Shawn Tan, Jun Liu

Information Systems Technology and Design, Singapore University of Technology and Design, Singapore, AnimalEYEQ Private Limited, Singapore

6D位姿估计数据集/基准

针对精密畜牧中牛只计数、跟踪、姿态与健康评估缺少俯视视频标注数据的问题,CattleEyeView构建了首个多任务俯视牛群数据集,覆盖6个品种、14段视频共30,703帧和753个牛实例,并提供身体/头部框、跟踪ID、计数、24个关键点与实例分割掩码;论文还给出各任务基准实验,但具体性能增益更多体现为数据与标注覆盖,方法创新有限。

PnP for Two-Dimensional Pose Estimation Figure 1
arXiv preprint2023-12-20

PnP for Two-Dimensional Pose Estimation

Joshua Wang

6D位姿估计

针对轮式机器人等相机运动被限制在平面内的场景,论文指出直接求完整 3D PnP 会浪费约束并加剧平面目标的位姿歧义。其核心是将运动自由度降到二维,先通过多项式系统求初值,再用 Levenberg–Marquardt 最小化重投影误差。文中报告相较常用 3D PnP 速度更快、平移精度和抗噪性更好,旋转精度相近,但实验细节在给定文本中未充分展开。

Pose and shear-based tactile servoing Figure 1
arXiv preprint2023-12-13

Pose and shear-based tactile servoing

John Lloyd affiliationmark, Nathan F. Lepora affiliationmark

School of Engineering Mathematics and Technology, University of Bristol, UK, Bristol Robotics Laboratory, University of Bristol, UK

6D位姿估计

针对软触觉传感器在接触后剪切、滑移会干扰位姿反馈、限制触觉伺服连续控制的问题,本文将剪切从“噪声”转为可控状态,提出带不确定性的GDN位姿-剪切估计、SE(3)上的判别式贝叶斯滤波与速度伺服控制。实验在目标跟踪、曲面跟随、单臂和双臂推物中验证了更平滑的非抓取操作,并显示滤波可降低估计误差与不确定性。

FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects Figure 1
arXiv preprint2023-12-13

FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects

Bowen Wen, Wei Yang, Jan Kautz, Stan Birchfield NVIDIA

NVIDIA

6D位姿估计未知物体

针对传统实例级或类别级6D位姿方法难以在测试时适配任意新物体、且模型式与无模型式方案割裂的问题,FoundationPose用统一RGBD框架同时处理位姿估计与跟踪:有CAD时直接渲染,无CAD时用少量参考图构建物体中心神经隐式表示做新视角合成,并结合LLM辅助的大规模合成数据、Transformer架构和对比学习提升泛化。多数据集结果显示其在四类新物体估计/跟踪设置上显著优于专用方法,部分接近实例级方法,但增益可能主要来自scaling/data与架构共同作用。

Efficient Multi-Object Pose Estimation using Multi-Resolution Deformable Attention and Query Aggregation Figure 1
arXiv preprint2023-12-13

Efficient Multi-Object Pose Estimation using Multi-Resolution Deformable Attention and Query Aggregation

PAGE 1, Arul Selvam Periyasamy∗

University of Bonn

6D位姿估计物体位姿

针对多目标 6D 位姿估计中 RGB-D 部署受限、纯 Transformer 全局注意力计算昂贵的问题,论文将位姿估计建模为集合预测,并在视觉 Transformer 中引入多分辨率可变形注意力,只在少量变形参考点上计算注意力;同时提出查询聚合,在不增加计算复杂度的情况下扩展 object queries。作者在 YCB-Video 上验证,报告达到当时最优结果。

CenterGrasp: Object-Aware Implicit Representation Learning for Simultaneous Shape Reconstruction and 6-DoF Grasp Estimation Figure 1
arXiv preprint2023-12-13

CenterGrasp: Object-Aware Implicit Representation Learning for Simultaneous Shape Reconstruction and 6-DoF Grasp Estimation

Eugenio Chisari 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Nick Heppert 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Tim Welschehold 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Wolfram Burgard 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Abhinav Valada 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计三维重建

面向未知物体的6-DoF抓取常只依赖可见局部几何,难以指定目标或处理遮挡。CenterGrasp将物体感知与整体抓取结合,用RGB-D编码器预测物体热图、位姿和潜码,再由隐式解码器同时重建形状并生成抓取。仿真和真实杂乱场景中,相比GIGA重建误差降低38.5 mm,平均抓取成功率提升33个百分点。

C-BEV: Contrastive Bird's Eye View Training for Cross-View Image Retrieval and 3-DoF Pose Estimation Figure 1
arXiv preprint2023-12-13

C-BEV: Contrastive Bird's Eye View Training for Cross-View Image Retrieval and 3-DoF Pose Estimation

PAGE 1, 1Fraunhofer IOSB

Karlsruhe Institute of Technology

6D位姿估计

针对街景到航拍跨视角定位中,同一航拍块对应多种街景姿态、传统向量嵌入难以同时保持判别性与姿态不变性的问题,C-BEV改用以相机3-DoF姿态为中心的BEV特征图,并在候选姿态上做可微匹配与重排序,只用图像配对的对比学习训练。实验显示其在多数据集检索上显著优于已有方法,VIGOR未知朝向跨区域Top-1召回由31.1%提升到65.0%,且可隐式估计3-DoF位姿。

Three-Filters-to-Normal+: Revisiting Discontinuity Discrimination in Depth-to-Normal Translation Figure 1
arXiv preprint2023-12-13

Three-Filters-to-Normal+: Revisiting Discontinuity Discrimination in Depth-to-Normal Translation

Jingwei Yang * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Bohuan Xue * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Yi Feng * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Deming Wang * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Rui Fan * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT, Qijun Chen * — * — ^ start_FLOATSUPERSCRIPT * — end_FLOATSUPERSCRIPT

6D位姿估计彩色深度

本文针对深度图到表面法线估计在物体边界、深度突变处易失准的问题,将深度曲率最小化与相关系数最大化写入 CRF,形成可插拔的 DDM 并扩展为 3F2N+。作者还构建含噪合成 SSN 数据集评测鲁棒性;结果显示其在室内/室外、干净/含噪场景均优于几何法线估计器,并在自由空间检测、6D 位姿估计和点云补全中带来小幅但可量化增益。

Diffusion Models Enable Zero-Shot Pose Estimation for Lower-Limb Prosthetic Users Figure 1
arXiv preprint2023-12-13

Diffusion Models Enable Zero-Shot Pose Estimation for Lower-Limb Prosthetic Users

Tianxun Zhou, Muhammad Nur Shahril Iskandar, Keng-Hwee Chiam

6D位姿估计

针对现有无标记姿态估计在下肢假肢用户上因训练数据偏向健全人而关键点定位失准的问题,论文用预训练图像扩散模型将视频中的假肢外观零样本转换为类似健全肢体、同时尽量保留形状和位置,再交给 OpenPose 估计。实验表明该流程相比直接用 OpenPose 减少漏检和坐标/运动学误差,可支持步态周期分析,但踝部误差仍较高且存在左右腿关键点交换问题。

RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation Figure 1
arXiv preprint2023-12-12

RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation

Peng Lu, Tao Jiang, Yining Li, Xiangtai Li, Kai Chen, yang.wenming@sz.tsinghua.edu.cn

Tsinghua Shenzhen International Graduate School, Shanghai AI Laboratory Nanyang Technological University

6D位姿估计

RTMO针对实时多人姿态中 top-down 随人数变慢、现有 one-stage 精度不足的问题,在 YOLO 式单阶段框架中引入双 1D 热图坐标分类,并用动态坐标分类器按预测框分配 bin、结合 MLE 热图损失建模样本不确定性。实验显示其在 COCO 上较同骨干 one-stage 方法 AP 提升 1.1%且约快 9 倍,RTMO-l 达 74.8% AP、V100 上 141 FPS。

COLMAP-Free 3D Gaussian Splatting Figure 1
arXiv preprint2023-12-12

COLMAP-Free 3D Gaussian Splatting

Yang Fu

6D位姿估计三维重建高斯泼溅

判断受限于 PDF 文本抽取质量。本文针对 3D Gaussian Splatting 依赖 COLMAP/已知相机位姿的问题,用单目深度初始化局部 3DGS,并冻结高斯属性、通过光度误差优化相邻帧位姿,再顺序更新全局 3DGS。实验在 Tanks and Temples 与 CO3D-V2 大运动序列上显示,相比 Nope-NeRF 位姿精度和新视角合成质量更好;未知内参下性能略降。

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs Figure 1
arXiv preprint2023-12-12

Unifying Correspondence, Pose and NeRF for Pose-Free Novel View Synthesis from Stereo Pairs

Jiaolong Yang Microsoft Research Asia, Chong Luo Microsoft Research Asia

Korea University, Microsoft Research Asia

6D位姿估计多视角三维重建

该文面向无相机位姿的双目/宽基线新视角合成,动机是传统先估位姿再接 NeRF 的流水线在位姿误差、极端视角和低重叠场景下容易失配。作者提出 CoPoNeRF,用共享表征端到端联合学习2D对应、相对位姿估计与 NeRF 渲染,并设计类似 teacher forcing 的训练策略。实验在室内外真实数据上显示其在 pose-free 合成和相对位姿精度上优于既有方法,消融支持联合表征带来收益。

Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation Figure 1
arXiv preprint2023-12-12

Mask as Supervision: Leveraging Unified Mask Information for Unsupervised 3D Pose Estimation

Yuchen Yang 0009-0002-2907-6458, Yu Qiao 0000-0002-1889-2567, Xiao Sun 0000-0001-7459-804X

6D位姿估计

本文针对单目 3D 人体姿态估计依赖昂贵 3D 标注、泛化受限的问题,提出仅用无监督分割得到的人体 mask 作为监督信号。核心思路是从轮廓中挖掘结构先验,设计 Skeleton/Physique Mask 的粗到细监督,并结合测地加权、级联优化和少量无标注多视角数据缓解远端关节与左右歧义。实验在 Human3.6M 和 MPI-INF-3DHP 上优于既有无监督方法,野外视频扩展也提升泛化,但部分增益可能主要来自可利用更多数据。

Towards Enhanced Human Activity Recognition through Natural Language Generation and Pose Estimation Figure 1
arXiv preprint2023-12-12

Towards Enhanced Human Activity Recognition through Natural Language Generation and Pose Estimation

Nikhil Kashyap, Manas Satish Bedmutha, Prerit Chaudhary, Brian Wood, Wanda Pratt, Janice Sabin, Andrea Hartzler, Nadir Weibel

University of Washington, University of California San Diego

6D位姿估计

针对视觉人体活动识别难以适应新动作、视角和人群变化的问题,论文将HAR重构为自然语言生成任务:先用AlphaPose提取人体关键点序列,再微调GPT2-XL生成活动标签/描述,以姿态作为视觉与语言之间的中间表示。在Kinetics700子集的概念验证中,作者报告Top-1准确率和可解释性优于直接视频分析思路,但具体增益幅度和对比设置文中未充分说明。

Keypoint-based Stereophotoclinometry for Characterizing and Navigating Small Bodies: A Factor Graph Approach Figure 1
arXiv preprint2023-12-11

Keypoint-based Stereophotoclinometry for Characterizing and Navigating Small Bodies: A Factor Graph Approach

Travis Driver 1 PhD Candidate, Intelligent Machines, School of Aerospace Engineering, Atlanta, Andrew Vaughan 2 Senior Engineer, Mission Design, Navigation, Pasadena, Yang Cheng 3 Robotics Technologist, Mobility, Robotic Systems, Adnan Ansar 4 Group Supervisor, John Christian 5 Associate Professor, and Panagiotis Tsiotras 6 David, Andrew Lewis Chair, Professor

Senior Engineer, Mission Design and Navigation, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, Robotics Technologist, Mobility and Robotic Systems, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, Group Supervisor, Mobility and Robotic Systems, Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA, Associate Professor, School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA

6D位姿估计多视角

面向小天体任务中传统SPC建图依赖人工校验、先验位姿和复杂maplet流程的问题,论文将光度立体约束嵌入关键点SfM,并用因子图联合优化航天器位姿、地标、太阳方向、表面法向与反照率。基于灶神星Cornelia陨坑真实图像验证,方法在无先验相机位姿和地形、无人参与条件下可与SPC重建精确对齐,法向和反照率估计接近基线。

ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation Figure 1
arXiv preprint2023-12-11

ManiPose: Manifold-Constrained Multi-Hypothesis 3D Human Pose Estimation

Cédric Rommel, Victor Letzelter, Nermin Samet, Renaud Marlet, Matthieu Cord, Patrick Pérez, Eduardo Valle, Valeo.ai, Paris, France Sorbonne Université, France LTCI, Télécom Paris, Institut Polytechnique de Paris, France Recod.ai Lab, School of Electrical, Computing Engineering, Brazil LIGM, Ecole des Ponts, Univ Gustave Eiffel, CNRS, Marne-la-Vallee, France

Recod.ai Lab, School of Electrical and Computing Engineering, University of Campinas, Brazil

6D位姿估计人体姿态

本文针对单目2D到3D人体姿态提升中的深度歧义,指出单假设回归在MPJPE等指标下会产生不符合人体拓扑与骨长一致性的预测。ManiPose以多假设输出表示可能的3D姿态及其可信度,并将预测约束在人姿流形上,避免依赖昂贵生成模型。实验在Human3.6M和MPI-INF-3DHP上显示,其姿态一致性显著优于现有方法,同时MPJPE保持竞争力。

From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguation Figure 1
arXiv preprint2023-12-10

From Correspondences to Pose: Non-minimal Certifiably Optimal Relative Pose without Disambiguation

Javier Tirado-Garín, Javier Civera I3A

I3A, University of Zaragoza

6D位姿估计相机位姿

相对相机位姿通常先估计本质矩阵、再用正深度约束在四个候选姿态中消歧,点数多时后处理开销明显。本文将非最小相对位姿直接表述为带几何有效约束的 QCQP,并给出归一化本质流形的新刻画,使求解可在认证时达到全局最优且无需消歧,还能检测纯旋转。合成与真实实验显示其精度与现有可认证方法相当或更好,在大量对应点时因省去消歧具备更好的运行时间 scaling。

You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perception Figure 1
arXiv preprint2023-12-09

You Only Learn One Query: Learning Unified Human Query for Single-Stage Multi-Person Multi-Task Human-Centric Perception

Sheng Jin 0000-0001-5736-7434, Shuhuai Li 0009-0006-0180-4248, Tong Li 0009-0005-9993-2581, Wentao Liu 0000-0001-6587-9878, Chen Qian 0000-0002-8761-5563, Ping Luo 0000-0002-6685-7950

6D位姿估计

针对多人场景中检测、分割、2D姿态、3D人体网格与属性识别长期依赖多阶段流水线、缺少统一评测的问题,论文构建 COCO-UniHuman,并提出 HQNet 用单一 Human Query 表示每个人实例,配合跨任务匹配与性别辅助模型选择实现单阶段多任务推理。实验显示其在多任务 HCP 模型中达到领先,并接近部分专用模型,且可迁移到人脸检测和多目标跟踪等新任务。

Image and AIS Data Fusion Technique for Maritime Computer Vision Applications Figure 1
arXiv preprint2023-12-07

Image and AIS Data Fusion Technique for Maritime Computer Vision Applications

Paul Koch Fraunhofer CML, Mert Yıldız Fraunhofer CML, Manfred Constapel Fraunhofer CML

University of Hamburg

6D位姿估计

针对海事视觉检测只能给出船舶框和粗类别、缺少尺寸/航向/速度等上下文的问题,本文将摄像头图像与 AIS 报文融合,用基于单应性的距离与方位估计把检测框关联到船舶身份,并扩展到固定与周期性云台相机,以降低数据集标注成本。作者发布多天气图像-AIS 数据集,人工核验显示总体关联准确率约 74.76%,固定相机达 85.06%,但云台相机仅约 39.24%,误差主要受全景定位、畸变和 AIS 缺失影响。

Correspondences of the Third Kind: Camera Pose Estimation from Object Reflection Figure 1
arXiv preprint2023-12-07

Correspondences of the Third Kind: Camera Pose Estimation from Object Reflection

Kohei Yamashita 0000-0002-5086-9906, Vincent Lepetit 0000-0001-9985-4433, Ko Nishino 0000-0002-3534-3447

6D位姿估计相机位姿

论文针对无纹理、强反光物体中传统像素匹配失效、单视角法线又受广义 bas-relief 歧义影响的问题,提出“反射对应”:在物体反射出的环境中建立匹配,并与像素对应、3D 法线对应结合。方法用神经特征估计器、两阶段 RANSAC 和迭代联合优化估计相机位姿与形状;合成和真实实验显示,反射对应与迭代框架对提升位姿和几何精度是关键。

Detecting and Restoring Non-Standard Hands in Stable Diffusion Generated Images Figure 1
arXiv preprint2023-12-07

Detecting and Restoring Non-Standard Hands in Stable Diffusion Generated Images

Yiqun Zhang, Zhenyue Qin, Yang Liu, Dylan Campbell

6D位姿估计手部姿态

针对 Stable Diffusion 生成人像中常见的缺指、多指和结构异常手部问题,论文提出先检测再修复的流水线:构建标准/非标准手数据集并微调 YOLOv8 定位异常手,再用 MediaPipe 估计姿态生成手模板控制图,结合 ControlNet 修补与 InstructPix2Pix 细化纹理。实验展示可提升手部解剖合理性和视觉真实感,但定量评估与增益来源文中未充分说明。

Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learning Figure 1
arXiv preprint2023-12-06

Skeleton-in-Context: Unified Skeleton Sequence Modeling with In-Context Learning

Xinshun Wang, Zhongbin Fang, Xia Li, Xiangtai Li, Mengyuan Liu 2, ~ { }} start_FLOATSUPERSCRIPT 2, ETH Zurich S-Lab, xia.li@inf.ethz.ch

Sun Yat-sen University, National Key Laboratory of General Artificial Intelligence, Peking University, Shenzhen Graduate School, Department of Computer Science, ETH Zurich, S-Lab, Nanyang Technological University

6D位姿估计

针对骨架序列任务长期依赖任务专用头、难以迁移到新任务的问题,本文将上下文学习引入3D骨架建模,提出SiC,用任务引导提示和任务统一提示让单一Transformer从输入/输出示例中识别任务,统一处理运动预测、2D到3D姿态估计、关节补全和未来姿态估计。实验显示其多任务结果达到SOTA,并可通过自定义提示泛化到motion-in-between等未见任务,但不同任务增益中提示设计与联合训练数据的贡献仍需进一步拆分。

Cooperative Probabilistic Trajectory Forecasting under Occlusion Figure 1
arXiv preprint2023-12-06

Cooperative Probabilistic Trajectory Forecasting under Occlusion

PAGE 1, Anshul Nayak, Azim Eskandarian

6D位姿估计

针对遮挡下自车难以直接观测行人且传输原始传感器数据代价高的问题,本文将共享视野间的相对位姿恢复与贝叶斯/MC Dropout 的概率轨迹预测串成端到端协同框架,只传递位置、速度等必要状态并给出不确定性边界。实验显示,在部分和间歇遮挡及位姿噪声下,遮挡行人的预测轨迹接近无​​遮挡真值;但当前设定依赖静态深度相机和重叠特征。

A Unified Simulation Framework for Visual and Behavioral Fidelity in Crowd Analysis Figure 1
arXiv preprint2023-12-05

A Unified Simulation Framework for Visual and Behavioral Fidelity in Crowd Analysis

PAGE 1, Niccol´o Bisagno, Nicola Garau, Antonio Luigi Stefani, Nicola Conci

University of Trento

6D位姿估计

针对拥挤场景真实数据稀缺、标注昂贵且视角覆盖不足的问题,论文提出 UniCrowd 仿真框架,同时建模视觉保真度与行人行为保真度,可自定义相机、环境、密度和光照并自动生成检测、分割、计数、轨迹等标注。实验显示 YOLO/Detectron 在合成与真实数据上的检测、分割表现接近,分割 AP 约 58.8 vs 58.7;合成数据尤其能补足俯视等稀缺视角,但增益主要来自可控数据扩充。

6D Assembly Pose Estimation by Point Cloud Registration for Robot Manipulation Figure 1
arXiv preprint2023-12-05

6D Assembly Pose Estimation by Point Cloud Registration for Robot Manipulation

PAGE 1, Kulunu Samarawickrama1, Gaurang Sharma1, Alexandre Angleraud1, Roel Pieters1

6D位姿估计点云机器人操作

面向机器人装配中仅估计物体初始位姿不足以指导放置的问题,本文将“装配位姿”定义为满足装配相对约束的末端执行器6D位姿,并提出结合RGB-D语义分割与CAD派生局部点云配准的迭代估计流程,无需额外训练或离线视角库。实验在两个仿真齿轮装配数据集上获得较高配准与位姿精度,并在柴油发动机摇臂装配中展示可行性,但对遮挡、CAD精度和复杂装配规模仍较敏感。

PolyFit: A Peg-in-hole Assembly Framework for Unseen Polygon Shapes via Sim-to-real Adaptation Figure 1
arXiv preprint2023-12-05

PolyFit: A Peg-in-hole Assembly Framework for Unseen Polygon Shapes via Sim-to-real Adaptation

PAGE 1, Geonhyup Lee, Joosoon Lee, Sangjun Noh, Minhwan Ko, Kangmin Kim, Kyoobin Lee

6D位姿估计仿真到现实

针对插孔装配中传感误差和机械偏差易导致卡滞、且视觉或真实采样方法泛化与安全性受限的问题,PolyFit改用仅基于力/力矩的监督学习来估计5DoF外参位姿,并通过多点接触消除单次力觉读数歧义,再用少量仿真-真实配对数据做适配。在多边形插孔任务中,仿真已见/未见形状成功率为97.3%/96.3%,真实实验为86.7%/85.0%,显示出对未训练复杂形状的迁移能力。

GenEM: Physics-Informed Generative Cryo-Electron Microscopy Figure 1
arXiv preprint2023-12-04

GenEM: Physics-Informed Generative Cryo-Electron Microscopy

Jiakai Zhang 1, Qihe Chen 1, Yan Zeng 1, Wenyuan Gao 1, Xuming He 1

ShanghaiTech University, iHuman Institute

6D位姿估计

针对冷冻电镜中低信噪比和高质量标注稀缺限制粒子挑选与姿态估计的问题,CryoGEM将可控物理成像仿真与基于对比学习的无配对噪声迁移结合,并用粒子/背景掩码指导采样以保留结构语义、补足真实噪声。作者在5个真实数据集上验证,合成数据提升下游模型训练效果,粒子挑选平均提高44%,最终重建分辨率平均改善22%。

Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors Figure 1
arXiv preprint2023-12-02

Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors

Yu Zhang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Songpengcheng Xia 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Lei Chu 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Jiarui Yang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Qi Wu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Location Based Services, Systems Group (WiDeS

6D位姿估计人体姿态

针对稀疏 IMU 人体姿态估计中加速度难用、未观测关节歧义大以及过度依赖合成 IMU 数据的问题,DynaIP 先回归关节伪速度以显式利用动态信息,再按上肢、躯干、下肢建立局部分支,并用骨架映射纳入更多真实惯性动捕数据。实验在五个公开数据集优于现有方法,DIP-IMU 上姿态误差降低约 19%,但部分增益可能来自真实数据扩充。

iMatching: Imperative Correspondence Learning Figure 1
arXiv preprint2023-12-04

iMatching: Imperative Correspondence Learning

Zitong Zhan 0009-0003-4111-766X, Dasong Gao 0000-0002-1391-0869, Yun-Jou Lin, Youjie Xia, Chen Wang 0000-0002-4630-0805

SAIR Lab, IAD, CSE, University at Buffalo, Buffalo, NY 14260, USA, Massachusetts Institute of Technology, Cambridge, MA 02139, USA, InnoPeak Technology, Palo Alto, CA 94303, USA

6D位姿估计

本文针对特征对应学习缺少像素级真值、姿态和深度标注获取成本高的问题,提出 iMatching:把匹配网络训练写成双层优化,用束调整的重投影误差自监督更新模型,并借助驻点条件避免展开 BA 迭代反传,使任意连续视频可用于训练。实验显示该方法可即插即用微调 CAPS、ASpanFormer、DKM 等模型,在特征匹配和位姿估计上相对 SOTA 平均带来约 30% 精度提升。

SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM Figure 1
arXiv preprint2023-12-04

SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM

Nikhil Keetha, Jay Karhade, Krishna Murthy Jatavallabhula, Gengshan Yang, Sebastian Scherer, Deva Ramanan, Jonathon Luiten

Nikhil Keetha1, Jay Karhade1, Krishna Murthy Jatavallabhula2, Gengshan Yang1, CMU, MIT

6D位姿估计相机位姿点云彩色深度高斯泼溅

针对传统稠密 SLAM 显式表示难以合成新视角、隐式体表示又慢且难编辑的问题,SplaTAM 将场景直接建模为可微渲染的 3D Gaussian,并用轮廓掩码区分已建图区域与新增区域,实现在线相机跟踪、增量加点和地图优化。实验在多组 RGB-D 数据上显示,其在相机位姿、重建和新视角渲染上优于多数稠密基线,部分指标最高约 2 倍提升,且渲染速度可达约 400 FPS。

Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection Figure 1
arXiv preprint2023-12-04

Disentangled Interaction Representation for One-Stage Human-Object Interaction Detection

Xubin Zhong 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Changxing Ding 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Yupeng Hu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, China Pazhou Lab, Australia eexubin@mail.scut.edu.cn, chxding@scut.edu.cn, dacheng.tao@sydney.edu.au

South China University of Technology, China, Pazhou Lab, China, The University of Sydney, Australia

6D位姿估计

本文针对一阶段 HOI 检测中 Transformer 交互特征纠缠、可解释性弱的问题,借鉴两阶段方法的显式组合思想,提出 DIR:用 SCA 训练时将注意力头分流到人、物体与全局上下文,并引入交互感知姿态估计提取与类别相关的关键点特征,再融合外观与姿态表示。该方法可插入现有一阶段检测器,推理中 SCA 不增加额外开销,并在 HICO-DET 与 V-COCO 上取得 SOTA 表现。

Hulk: A Universal Knowledge Translator for Human-Centric Tasks Figure 1
arXiv preprint2023-12-05

Hulk: A Universal Knowledge Translator for Human-Centric Tasks

Yizhou Wang, Yixuan Wu, Weizhen He, Xun Guo, Feng Zhu, Lei Bai, Rui Zhao, Jian Wu, Tong He, Wanli Ouyang, Shixiang Tang

6D位姿估计

面向人体检测、姿态、动作识别和图文等任务长期依赖专用头与任务微调的问题,Hulk 将离散语义与连续坐标归并为两类通用预测头,并把图像、文本、稀疏/稠密标签统一为模态翻译。模型在约3000万标注样本上联合训练,无需下游微调即可覆盖8类任务;在12个基准中11个达到SOTA,但部分增益可能主要来自 scaling / data。

Multi-View Person Matching and 3D Pose Estimation with Arbitrary Uncalibrated Camera Networks Figure 1
arXiv preprint2023-12-04

Multi-View Person Matching and 3D Pose Estimation with Arbitrary Uncalibrated Camera Networks

Yan Xu, Kris Kitani

Carnegie Mellon University

6D位姿估计多视角

本文针对多相机外参未知时跨视角行人匹配与3D人体姿态估计难以依赖极线约束或3D标注的问题,提出PME:先用2D检测、跟踪与re-ID构造时序外观特征,再将匹配转化为带簇大小约束和同源互斥约束的多步聚类,随后由关节对应进行三角化和BA优化。实验在三个公开集及室内外自采未标定数据上显示,其跨视角匹配显著优于多种聚类基线,并在无需相机位姿和3D训练数据时达到SOTA级3D姿态性能。

Open-vocabulary object 6D pose estimation Figure 1
arXiv preprint2023-12-01

Open-vocabulary object 6D pose estimation

Jaime Corsetti 1, Davide Boscaini 1, Changjae Oh 3

University, Queen Mary University, Idiap Research Institute, EPFL

6D位姿估计物体位姿未知物体

针对现有新物体6D位姿方法在测试时仍依赖CAD模型、参考视图或视频采集的问题,论文提出开放词汇设定:仅用文本提示在两幅不同场景RGBD图像中指定目标。其方法Oryon利用VLM将提示语义与局部视觉特征融合,同时完成目标分割与匹配,再通过3D配准估计相对位姿。在REAL275和Toyota-Light构建的约4000对图像基准上,Oryon优于SIFT和ObjectMatch。

Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Cameras Figure 1
arXiv preprint2023-12-01

Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Cameras

Mohammad Altillawi 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Zador Pataki 1, 3 1 3 ^ start_FLOATSUPERSCRIPT 1, 3 end_FLOATSUPERSCRIPT, Shile Li 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ziyuan Liu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计

针对机器人/AR中单张图像在已建图场景的6DoF重定位,本文认为直接位姿回归未充分利用训练时天然可得的3D几何标签。方法让网络预测全局与相机坐标系下的3D表示,并用相邻及跨序列远距离相机的相对时空几何约束联合训练,再经加权Kabsch对齐求位姿。在少于1% 3D真值坐标可用时仍能学习定位,并在3个常用数据集上优于其他直接位姿估计方法。

Learning Unorthogonalized Matrices for Rotation Estimation Figure 1
arXiv preprint2023-12-01

Learning Unorthogonalized Matrices for Rotation Estimation

Kerui Gu, Zhihao Li, Shiyong Liu, Jianzhuang Liu, Songcen Xu, Youliang Yan, Michael Bi Mi, Kenji Kawaguchi

National University of Singapore, Huawei Noah’s Ark Lab, Huawei International Pte Ltd

6D位姿估计

本文针对6D位姿/人体姿态中旋转矩阵训练常依赖Gram-Schmidt或SVD正交化的问题,指出这些操作会带来梯度方向冲突、梯度爆炸和非局部单射导致的优化困难。作者提出训练阶段直接学习未正交化的伪旋转矩阵PRoM,仅在推理后处理正交化,使矩阵元素独立回归。实验显示该替换可加快收敛,并在人体/手部姿态和点云相关任务的大规模基准上取得更优结果。

PoseGPT: Chatting about 3D Human Pose Figure 1
arXiv preprint2023-11-30

PoseGPT: Chatting about 3D Human Pose

Yao Feng 1, 3 Jing Lin 3, 4 Sai Kumar Dwivedi 1

Max Planck Institute for Intelligent Systems - Tübingen ETH Zürich, Meshcapade Tsinghua University

6D位姿估计人体姿态

该工作针对传统3D人体姿态估计/生成缺乏语义理解和交互推理的问题,提出ChatPose:将SMPL姿态作为特殊<POSE>信号嵌入多模态LLM,并用MLP回归姿态参数,从图像或文本直接生成3D姿态。核心洞察是让LLM把世界知识与人体姿态参数对齐,从而支持推测式姿态生成和基于场景查询的姿态估计。实验显示其在新设推理任务上优于多模态LLM和部分专用基线,但经典估计精度仍未超过专用方法。

FoundPose: Unseen Object Pose Estimation with Foundation Features Figure 1
arXiv preprint2023-11-30

FoundPose: Unseen Object Pose Estimation with Foundation Features

Evin Pınar Örnek 1∗

Yann Labbé

6D位姿估计物体位姿未知物体

FoundPose面向机器人等场景中快速接入新物体的6D位姿估计,避免为每个物体重新渲染大数据并训练模型。其关键洞察是冻结的DINOv2中间层patch特征已能跨真实图像与渲染模板建立稳定2D-3D对应,并结合BoW式模板检索和featuremetric对齐提升效率与精度。在BOP七个数据集上,该方法显著优于既有RGB无精修方法,并可结合渲染比较精修达到RGB-only SOTA。

Pose Estimation and Tracking for ASIST Figure 1
arXiv preprint2023-11-30

Pose Estimation and Tracking for ASIST

PAGE 1

unlimited", Naval Air Warfare Center Aircraft Division Lakehurst

6D位姿估计

该文针对ASIST舰载直升机回收中原HPSE/红外信标方案需改装飞机、人工目视负担高的问题,提出无需机体改装的PETA视觉辅助原型。系统用Unity合成环境生成带19个关键点的数据,结合Faster R-CNN检测、HRNet关键点与PnP估计位姿,并以编码器-解码器校验航向。实验主要在合成数据上完成,达到10Hz、XY约半英尺精度和姿态误差小于0.5弧度;真实视频泛化仍待验证。

A Stochastic-Geometrical Framework for Object Pose Estimation based on Mixture Models Avoiding the Correspondence Problem Figure 1
arXiv preprint2023-11-29

A Stochastic-Geometrical Framework for Object Pose Estimation based on Mixture Models Avoiding the Correspondence Problem

Mathematics Lothstraße 64, 80335 München, Germany wolfgang.hoegele@hm.edu

Munich University of Applied Sciences HM, Department of Computer Science and Mathematics

6D位姿估计物体位姿

针对6D物体位姿估计中点特征对应关系难解、多视角随机依赖常被经验化处理的问题,论文提出统一的随机几何框架,用混合模型同时描述物体空间特征密度与观测测量,并由此推导单视角和多视角的直接优化算法。实验仅为数值仿真,覆盖相机与测距等三类观测系统,显示在测量分辨率、噪声和物体形变变化下仍可获得较稳健精度,但真实数据验证文中未充分说明。

Pose Anything: A Graph-Based Approach for Category-Agnostic Pose Estimation Figure 1
arXiv preprint2023-11-29

Pose Anything: A Graph-Based Approach for Category-Agnostic Pose Estimation

Or Hirschorn, Shai Avidan

6D位姿估计类别级位姿

该文针对传统姿态估计依赖预定义类别、难以迁移到新物体的问题,研究少样本类别无关关键点定位。核心洞察是不要把支持关键点视为独立点,而将骨架连通关系建模为图,在解码器中利用几何结构来缓解对称歧义、遮挡和结构不一致。作者补全 MP-100 骨架标注,并在 1-shot/5-shot 上较强化 CapeFormer-T 分别提升约 0.98%/0.26%,达到当时 CAPE SOTA;但任务本身是2D关键点而非严格6D位姿。

Cinematic Behavior Transfer via NeRF-based Differentiable Filming Figure 1
arXiv preprint2023-11-29

Cinematic Behavior Transfer via NeRF-based Differentiable Filming

3 1 3 ^ start_FLOATSUPERSCRIPT 1, dhlin@ie.cuhk.edu.hk * * * denotes equal contribution

{}^{1} start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Shanghai Artificial Intelligence Laboratory

6D位姿估计三维重建

针对影视片段中相机运动与人物动作耦合、传统 SLAM 在动态场景易受干扰的问题,本文将 SMPL 轨迹表示为动态 NeRF,并把 NeRF 作为可微渲染器反向优化相机轨迹,再将估计出的拍摄行为迁移到新视频或 3D 引擎场景。实验与用户研究显示,该流程能复现多类镜头尺度、角度和复杂运镜,并在可控渲染与主观评价上优于基线。

PViT-6D: Overclocking Vision Transformers for 6D Pose Estimation with Confidence-Level Prediction and Pose Tokens Figure 1
arXiv preprint2023-11-29

PViT-6D: Overclocking Vision Transformers for 6D Pose Estimation with Confidence-Level Prediction and Pose Tokens

Sebastian Stapf, Tobias Bauernfeind, Marco Riboldi Ludwig-Maximilians-Universität München, BMW Group s.stapf@campus.lmu.de, tobias.baeuernfeind@bmw.de, marco.riboldi@physik.lmu.de

Ludwig-Maximilians-Universität München, BMW Group

6D位姿估计

针对现有6D位姿方法依赖关键点/稠密对应、流程复杂且缺少可靠置信度的问题,PViT-6D将RoI内目标位姿重新表述为ViT端到端直接回归,引入旋转/平移pose tokens分离特征,并用基于3D-IoU的类别置信度及场景复杂度条件注意力提升可解释性与可靠性。在LM-O上ADD(-S)较SOTA提升0.3%,YCB-V提升2.7%。

On the Calibration of Human Pose Estimation Figure 1
arXiv preprint2023-11-28

On the Calibration of Human Pose Estimation

Kerui Gu, Rongyu Chen

National University of Singapore

6D位姿估计人体姿态

这篇论文关注人体姿态估计中长期被忽视的置信度校准问题:现有方法常用热图峰值等启发式分数,但与 OKS/mAP 所需的真实位姿精度不一致。作者从理论上分析 heatmap 与回归方法的错配来源,并提出轻量后处理分支 CCNet,用 OKS 和可见性监督学习模型特定校准。实验显示其可在现成姿态模型上提升最高 1.4% AP,并在下游人体网格恢复中降低约 1.0mm 3D 关键点误差。

Telling Left from Right: Identifying Geometry-Aware Semantic Correspondence Figure 1
arXiv preprint2023-11-28

Telling Left from Right: Identifying Geometry-Aware Semantic Correspondence

Junyi Zhang † † ^ start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT, Charles Herrmann ‡ ‡ ^ start_FLOATSUPERSCRIPT ‡ end_FLOATSUPERSCRIPT, Junhwa Hur ‡ ‡ ^ start_FLOATSUPERSCRIPT ‡ end_FLOATSUPERSCRIPT, Eric Chen § § ^ start_FLOATSUPERSCRIPT § end_FLOATSUPERSCRIPT, Varun Jampani ¶ ¶ ^ start_FLOATSUPERSCRIPT ¶ end_FLOATSUPERSCRIPT, Deqing Sun ‡ ‡ ^ \ start_FLOATSUPERSCRIPT ‡ end_FLOATSUPERSCRIPT, Ming-Hsuan Yang, ⁣ * ‡ § ^ start_FLOATSUPERSCRIPT, end_FLOATSUPERSCRIPT

6D位姿估计

本文关注语义对应中基础视觉特征容易混淆左右、前后等几何朝向的问题,指出这类“几何感知”匹配在现有基准中占比很高且显著拉低性能。作者通过测试时视角对齐、轻量后处理训练、姿态增强与窗口 soft-argmax 缓解歧义,并基于 AP-10K 构建更难动物对应基准。方法在 SPair-71k 上零样本 PCK@0.10 达 65.4、监督达 85.6,分别较 SOTA 提升 5.5 和 11.0 个百分点。

HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors Figure 1
arXiv preprint2023-11-28

HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priors

Shutong Zhang 1, 1 ^ start_FLOATSUPERSCRIPT 1, end_FLOATSUPERSCRIPT, Yi-Ling Qiao 2, 2 ^ start_FLOATSUPERSCRIPT 2, Guanglei Zhu 1, Dylan Turpin 1, 3 1 3 ^ start_FLOATSUPERSCRIPT 1, 3 end_FLOATSUPERSCRIPT, Jingzhou Liu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ming Lin 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Miles Macklin 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Animesh Garg 1

6D位姿估计手部姿态

针对手-物交互中遮挡、高自由度和接触约束导致的位姿估计不稳定问题,HandyPriors将可微渲染与可微物理统一为先验:前者对齐RGB/分割观测,后者抑制穿模与帧间相对滑动,并提供优化式高精度估计和滤波式快速跟踪两种模式。实验显示其在手-物6D位姿与接触细化上达到相当或更好效果,并可迁移到机器人手操作和野外人-物场景。

Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement Figure 1
arXiv preprint2023-11-28

Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement

PAGE 1, Jian Wang1

Google, University of Pennsylvania

6D位姿估计人体姿态

本文面向 VR/AR 中头戴单鱼眼相机同时捕捉身体与手部动作的需求,针对鱼眼畸变、自遮挡和全身标注数据缺乏问题,提出按视场分块校正的 FisheyeViT、像素对齐 3D 热图身体回归、独立手部估计以及基于关节不确定性的扩散运动先验细化,并构建 EgoWholeBody 合成数据集。实验显示其在 SceneEgo、GlobalEgoMocap、Mo2Cap2 等基准上优于既有自中心人体动捕方法,但部分增益可能来自更大规模合成数据。

UniHPE: Towards Unified Human Pose Estimation via Contrastive Learning Figure 1
arXiv preprint2023-11-24

UniHPE: Towards Unified Human Pose Estimation via Contrastive Learning

Zhongyu Jiang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Wenhao Chai 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Lei Li 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, lilei@di.ku.dk

6D位姿估计人体姿态

UniHPE针对2D-3D lifting依赖检测器、图像式3D姿态又受限于成对数据不足的问题,尝试把RGB图像、2D姿态和3D姿态统一到共享特征空间。其核心是在编码器-解码器框架中用对比学习预训练,并提出基于奇异值的InfoNCE损失以同时对齐三种模态。实验在Human3.6M上MPJPE为50.5 mm、3DPW上PA-MPJPE为51.6 mm,但具体增益中多任务训练与数据规模贡献仍需进一步拆分说明。

DiffSLVA: Harnessing Diffusion Models for Sign Language Video Anonymization Figure 1
arXiv preprint2023-11-27

DiffSLVA: Harnessing Diffusion Models for Sign Language Video Anonymization

NJ 08854 zx149@rutgers.edu, MA 02215 carol@bu.edu, NJ 08854 dnm@cs.rutgers.edu

Rutgers University, Boston University, Dimitris N. Metaxas

6D位姿估计

针对手语视频中手部与面部同时承载语义、简单遮脸会破坏表达且现有方法依赖精确姿态估计和专用数据的问题,DiffSLVA用预训练扩散模型与ControlNet的HED边缘进行零样本文本引导匿名化,并加入面部表情生成模块、跨帧注意力和光流潜变量融合以保持视频一致性。实验显示其能在改变签名者身份的同时较好保留手语内容,消融表明面部模块有助于语义保持。

Uncertainty Quantification of Set-Membership Estimation in Control and Perception: Revisiting the Minimum Enclosing Ellipsoid Figure 1
arXiv preprint2023-11-27

Uncertainty Quantification of Set-Membership Estimation in Control and Perception: Revisiting the Minimum Enclosing Ellipsoid

Financial Engineering, USA, Jean-Bernard Lasserre lasserre@laas.fr LAAS-CNRS, Toulouse School of Economics (TSE, Toulouse, France, Applied Sciences

Department of Operations Research and Financial Engineering, Princeton University, LAAS-CNRS and Toulouse School of Economics (TSE), School of Engineering and Applied Sciences, Harvard University

6D位姿估计

针对传统最大似然在神经网络感知噪声非高斯、且难给出可证明不确定性的问题,本文用集合成员估计保证真值落在可行集内,并以最小包围椭球给出可操作的不确定性外包络。核心贡献是把SOS/半定松弛的MEE框架通过约束剪枝、广义松弛Chebyshev中心和非欧几何处理推向系统辨识与物体6D位姿估计。实验展示了可计算且较紧的椭球不确定性,但仍受半定规划规模限制。

Computer Vision for Carriers: PATRIOT Figure 1
arXiv preprint2023-11-27

Computer Vision for Carriers: PATRIOT

PAGE 1, distribution is

unlimited", Naval Air Warfare Center Aircraft Division Lakehurst

6D位姿估计

航母甲板资产跟踪仍依赖人工更新 Ouija Board,且难以部署 GPS 等主动定位硬件。PATRIOT 利用既有摄像头,将检测、分类与6D位姿估计串联,比较 HRNet、HigherHRNet、OpenPifPaf 和编码器-解码器/DLT 等管线,并结合合成与实拍数据训练。实验显示系统可实时估计飞机等资产位姿,合成数据能补充实拍标注;OpenPifPaf 在速度与精度上表现最好,但融合、持续跟踪和真实场景泛化仍待扩展。

SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation Figure 1
CVPR20242023-11-27

SAM-6D: Segment Anything Model Meets Zero-Shot 6D Object Pose Estimation

Jiehong Lin, Lihua Liu, Dekun Lu, Kui Jia

{}^{3} start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT South China University of Technology, Guangzhou

6D位姿估计物体位姿

面向机器人抓取等场景中未见物体的零样本6D位姿估计,SAM-6D将任务拆为RGB-D实例分割与位姿求解:先用SAM生成候选掩码,并结合语义、外观和几何匹配筛选目标;再把位姿估计建模为部分点云到部分点云匹配,引入背景token和粗到细两阶段对应建立。在BOP七个核心数据集上,其新物体分割和位姿估计均优于既有方法,显示出较强跨物体泛化能力。

RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling Figure 1
arXiv preprint2023-11-24

RSB-Pose: Robust Short-Baseline Binocular 3D Human Pose Estimation with Occlusion Handling

Xiaoyue Wan, Zhuo Chen, Yiming Bao, Xu Zhao

6D位姿估计手部姿态人体姿态

本文关注短基线双目人体 3D 姿态估计:设备更便携但对 2D 关键点误差更敏感,且双目视差小导致遮挡互补不足。方法以视差构建 Stereo Volume Feature,并联合回归双目 co-keypoints 以约束视图一致性;再用预训练 Pose Transformer 通过遮挡关节恢复学习关节相关性来细化三角化结果。H36M、MHAD 及遮挡测试表明其在短基线和遮挡场景优于基线,PPT 的具体增益机制虽有注意力可视化支持但仍未完全解释清楚。

Appearance-based gaze estimation enhanced with synthetic images using deep neural networks Figure 1
arXiv preprint2023-11-23

Appearance-based gaze estimation enhanced with synthetic images using deep neural networks

Dmytro Herashchenko, Igor Farkaš, IEEE member Faculty of Mathematics, Physics, Slovak Republic igor.farkas@fmph.uniba.sk

Comenius University Bratislava, Slovak Republic

6D位姿估计仿真到现实

面向人机交互中机器人理解人类注意与意图的需求,论文将视线估计做成可用普通 RGB 相机运行的模块化系统:用 RetinaFace 检脸、6DRepNet 估头姿,再由 CNN 从裁剪眼部和头姿回归 pitch/yaw。核心增益主要来自加入 MetaHuman 生成的 5.7 万余张带视线与头姿标注的合成脸数据;在 Columbia Gaze 上联合训练后平均误差降至双方向低于 2°,并在 NICO 机器人眼部 4K 相机上做了初步真实场景验证。

GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence Figure 1
arXiv preprint2023-11-23

GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence

Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann, Vincent Lepetit LIGM, École des Ponts, Adobe, EPFL

EPFL

6D位姿估计物体位姿未知物体

面向工业中无需为新物体重新训练的 CAD/未知物体 6D 位姿估计,GigaPose 针对现有模板粗估计速度慢、对分割误差敏感的问题,将模板搜索限制在方位/俯仰两个自由度,并用局部特征近邻检索;其余平面旋转、尺度和平移由单个 patch 对应结合 RANSAC 求解。在 BOP 七个核心数据集上达到 SOTA 粗估计精度,较 MegaPose 约快 35 倍,并可接入后续 refinement,甚至能利用单图重建的 3D 模型。

GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence Figure 1
arXiv preprint2023-11-23

GS-Pose: Category-Level Object Pose Estimation via Geometric and Semantic Correspondence

Pengyuan Wang : 1, Takuya Ikeda : 2, Robert Lee : 2, Woven by Toyota : 2 pengyuan.wang@tum.de, @woven-planet.global

Technical University of Munich 1 1 footnotemark, Woven by Toyota 2 2 footnotemark

6D位姿估计物体位姿类别级位姿

GS-Pose针对类别级6D位姿估计中RGB方法依赖大量带标注/高保真数据、纯几何方法又缺少语义消歧的问题,将DINOv2提取的2D语义特征投影并融合到单个类别参考CAD的3D点云中,再用结合几何与语义的Transformer匹配网络及内点概率预测,在单视角未见实例与完整参考模型间建立对应。实验表明其仅用少量合成数据训练即可优于多种先前方法,体现出较好的数据效率与跨真实场景泛化能力。

HEViTPose: High-Efficiency Vision Transformer for Human Pose Estimation Figure 1
arXiv preprint2023-11-22

HEViTPose: High-Efficiency Vision Transformer for Human Pose Estimation

Chengpeng Wu, Guangxing Tan, Control College of Automation, Technology, Liuzhou, China 221068325@stdmail.gxust.edu.cn, 100000321@gxust.edu.cn, 221068310@stdmail.gxust.edu.cn

Liuzhou Key Laboratory of Intelligent Sensing and Control, College of Automation, Guangxi University of Science and Technology, Liuzhou, China

6D位姿估计人体姿态

针对 Transformer 人体姿态估计精度提升常伴随参数量和计算量过高的问题,HEViTPose 将高效骨干用于热图式关键点检测,核心是 CGSR-MHA 通过特征分组、空间降采样和级联多头注意力降低冗余,并用 PEOW 分析重叠 patch 对局部连续性的影响。在 MPII/COCO 上,HEViTPose-B 达到 90.7 PCK@0.5 和 72.6 AP,相比 HRNet-W32、Swin-S 显著减少参数与 GFLOPs。

Calibration System and Algorithm Design for a Soft Hinged Micro Scanning Mirror with a Triaxial Hall Effect Sensor Figure 1
arXiv preprint2023-11-21

Calibration System and Algorithm Design for a Soft Hinged Micro Scanning Mirror with a Triaxial Hall Effect Sensor

Di Wang, Xiaoyu Duan, Shu-Hao Yeh, Jun Zou, Dezhen Song

6D位姿估计

面向软铰链微扫描镜中不可忽略的面外平移,论文将问题从传统2自由度转角标定扩展到2转动+1平移的动态位姿估计。其核心是用低成本双激光与双标定板构建反射约束,并以因子图优化恢复镜面位姿,再利用周期性自同步拟合建立三轴霍尔读数到位姿的非线性映射。实验报告角度估计精度约0.020°、标准差0.011°。

HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation Figure 1
arXiv preprint2023-11-21

HiPose: Hierarchical Binary Surface Encoding and Correspondence Pruning for RGB-D 6DoF Object Pose Estimation

Yongliang Lin, Yongzhi Su, Praveen Nathan, Sandeep Inuganti, Yan Di, Martin Sundermeyer, Fabian Manhardt, Didier Stricker, Jason Rambach, Yu Zhang

Zhejiang University German Research Center for Artificial Intelligence (DFKI), RPTU Kaiserslautern-Landau Technische Universit¨at M¨unchen Google

6D位姿估计物体位姿点云彩色深度

面向RGB-D 6DoF物体位姿估计中渲染式/迭代精修耗时、RGB或深度利用不充分的问题,HiPose将物体表面编码为层级二进制码,直接预测点云到CAD表面的稠密3D-3D对应,并用由粗到细的点到表面匹配逐步收缩候选面、剔除外点,避免RANSAC和渲染精修。在LM-O、YCB-V、T-LESS上,其无精修结果超过同类方法,并接近昂贵精修方案,突出实时性。

CoVOR-SLAM: Cooperative SLAM using Visual Odometry and Ranges for Multi-Robot Systems Figure 1
arXiv preprint2023-11-21

CoVOR-SLAM: Cooperative SLAM using Visual Odometry and Ranges for Multi-Robot Systems

PAGE 1, Young-Hee Lee∗, Chen Zhu∗, Thomas Wiedemann∗, Emanuel Staudinger∗, Siwei Zhang∗, Christoph G¨unther∗

6D位姿估计相机位姿机器人操作

针对多机器人 VSLAM 中跨机器人回环检测依赖共享视觉特征、计算和通信开销高且限制运动的问题,CoVOR-SLAM改用视觉里程计位姿及协方差、机器人间/锚点测距进行图优化融合,并以 Sim(3) 7DoF 表达显式处理单目尺度漂移。真实双车图像与 UWB 测距、以及大规模公开数据仿真实验显示,其能保持较准确位姿估计,同时显著降低通信与计算需求。

HCA-Net: Hierarchical Context Attention Network for Intervertebral Disc Semantic Labeling Figure 1
arXiv preprint2023-11-21

HCA-Net: Hierarchical Context Attention Network for Intervertebral Disc Semantic Labeling

PAGE 1, Afshin Bozorgpour 1

Faculty of Informatics and Data Science, University of Regensburg, Germany, South Dakota State University, Brookings, USA, Faculty of Electrical Engineering and Information Technology, RWTH Aachen University, Germany, Machine and Hybrid Intelligence Lab, Northwestern University, Chicago, IL, USA, Fraunhofer Institute for Digital Medicine MEVIS, Germany

6D位姿估计

针对椎间盘在 MRI 中精确定位与语义标注易受局部外观相似、脊柱整体几何约束不足影响的问题,HCA-Net 将标注建模为位姿估计,引入层次上下文注意力与多尺度大核注意力以融合局部到全局依赖,并用 skeleton loss 约束预测符合脊柱结构。多中心 T1w/T2w 实验显示其优于既有方法,但具体增益中架构与损失各自贡献需结合消融判断。

Two Views Are Better than One: Monocular 3D Pose Estimation with Multiview Consistency Figure 1
arXiv preprint2023-11-21

Two Views Are Better than One: Monocular 3D Pose Estimation with Multiview Consistency

Christian Keilstrup Ingwersen, Rasmus Tirsgaard, Rasmus Nylander, Janus Nørtoft Jensen, Anders Bjorholm Dahl, TrackMan A/S, Denmark @trackman.com, @dtu.dk

Visual Computing, Technical University of Denmark

6D位姿估计多视角

单目3D姿态存在深度歧义,而采集3D标注或标定多相机成本高。本文的核心是在训练阶段利用同步双视角,引入基于Procrustes刚性对齐的多视角一致性损失,无需相机内外参与3D真值,推理仍保持单目。实验显示该损失在无3D数据微调和半监督从头训练中显著降低误差,并在Human3.6M等设置达到半监督SOTA;但收益依赖视角选择,3D监督下部分提升可能主要来自更多数据。

Fingerspelling PoseNet: Enhancing Fingerspelling Translation with Pose-Based Transformer Models Figure 1
arXiv preprint2023-11-20

Fingerspelling PoseNet: Enhancing Fingerspelling Translation with Pose-Based Transformer Models

Pooya Fayyazsanavi, Negar Nejatishahidin, Jana Kosecka

George Mason University

6D位姿估计

本文针对野外视频中的 ASL 手指拼写翻译:单手细微快速动作易受外观、背景和签者差异影响,RGB 方法泛化受限。作者改用手部姿态序列,构建 Transformer 编解码器并结合 CTC、解码器语言建模,引入词长预测损失和两阶段重排序以缓解漏字。实验在 ChicagoFSWild/FSWild+ 上较既有方法取得超过 10% 相对提升,但具体增益在姿态估计、词长损失与重排序之间的来源仍需结合消融判断。

Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation Figure 1
CVPR 20242023-11-20

Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation

Wenhao Li, Mengyuan Liu, Hong Liu, Pichao Wang, Jialun Cai, Nicu Sebe

National Key Laboratory of General Artificial Intelligence, Peking University, Shenzhen Graduate School, Amazon Prime Video University of Trento

6D位姿估计人体姿态

视频人体3D姿态Transformer依赖长序列建模,但全帧token在深层计算冗余,难以部署到算力受限设备。HoT的核心洞察是在中间层只保留语义多样的代表帧token,并通过TPC聚类剪枝、TRA注意力恢复完整时间分辨率,形成可插拔的“沙漏”结构。其接入MotionBERT、MixSTE等模型后,在Human3.6M和MPI-INF-3DHP上可减少约40%–50% FLOPs,精度基本不降或仅约0.2%下降。

SniffyArt: The Dataset of Smelling Persons Figure 1
the 5th Workshop on analySis, Understanding and proMotion of heritAge Contents. 2023. S. 49-582023-11-20

SniffyArt: The Dataset of Smelling Persons

Azhar Hussian, Hang Tran, Prathmesh Madhu, Vincent Christlein

Pattern Recognition Lab

6D位姿估计数据集/基准

面向历史艺术品中嗅觉线索难以直接识别的问题,论文构建 SniffyArt 数据集,将441幅作品中的1941个人物同时标注紧框、17个人体关键点和气味手势标签,并通过5份关键点标注融合提升质量。作者给出检测、姿态估计与手势分类基线,初步显示结合姿态关键点有助于气味手势识别,但具体增益仍需更多实验验证。

Robot Hand-Eye Calibration using Structure-from-Motion Figure 1
arXiv preprint2023-11-21

Robot Hand-Eye Calibration using Structure-from-Motion

PAGE 1, Nicolas Andreff1, Radu Horaud2, Bernard Espiau2

6D位姿估计手部姿态机器人操作

本文面向现场机器人手眼标定中无法携带标定物、运动幅度受限的问题,提出将结构光束法/运动恢复结构得到的相机运动与机器人编码器运动结合,用正交矩阵建立线性自标定模型,同时估计手眼变换和SfM尺度因子,并分析纯平移、纯旋转、平面运动等退化情形。仿真和真实实验显示,其精度与依赖标定板的传统方法相当,且适用于未知环境中的自校准。

SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation Figure 1
arXiv preprint2023-11-18

SecondPose: SE(3)-Consistent Dual-Stream Feature Fusion for Category-Level Pose Estimation

PAGE 1, Yamei Chen1, Yan Di1, Guangyao Zhai1, Fabian Manhardt3, Chenyangguang Zhang4

Technical University of Munich, Munich Center for Machine Learning, Google, Tsinghua University

6D位姿估计类别级位姿

SecondPose面向类别级6D/9DoF位姿估计中类内形状差异大、均值形状先验表达不足的问题,利用DINOv2的跨视角语义一致性,并引入点云中成对距离与角度等SE(3)不变几何特征,按局部到全局层次聚合后与语义特征逐点对齐融合,形成更易映射到规范空间的表示。实验显示其在NOCS-REAL275较SOTA提升12.4%,在更复杂的HouseCat6D上也明显优于对比方法。

Synthetic Data Generation for Bridging Sim2Real Gap in a Production Environment Figure 1
arXiv preprint2023-11-18

Synthetic Data Generation for Bridging Sim2Real Gap in a Production Environment

Mrunal Sompura, Wolfgang Hintze

6D位姿估计仿真到现实

面向生产现场中无纹理、反光零件及复杂装配导致的合成训练数据失效问题,本文强调仅靠通用域随机化不足,需把目标域知识纳入数据生成;其做法包括从装配 CAD 自动分离目标零件、设计五类不同随机化/适配强度的照片级渲染流程,并按比例组合生成数据。在真实产线图像上,部分组合相较基础流程最高带来约 15% 性能提升。

Multiple View Geometry Transformers for 3D Human Pose Estimation Figure 1
arXiv preprint2023-11-18

Multiple View Geometry Transformers for 3D Human Pose Estimation

PAGE 1, Ziwei Liao1

University of Toronto, Southeast University, Microsoft Research Asia

6D位姿估计人体姿态

针对多视角 3D 人体姿态中纯 Transformer 易把相机几何学成数据偏置、在新视角和遮挡下泛化变差的问题,论文提出 MVGFormer,将可学习外观模块负责图像到 2D 姿态估计,免学习几何模块用三角化迭代更新 3D query,显式解耦外观与多视图几何。实验在三个基准、域内和跨域设置均优于已有方法,跨相机/跨数据集场景提升尤其明显。

Jenga Stacking Based on 6D Pose Estimation for Architectural Form Finding Process Figure 1
arXiv preprint2023-11-18

Jenga Stacking Based on 6D Pose Estimation for Architectural Form Finding Process

Zixun Huang

University of California, Berkeley, USA

6D位姿估计

论文面向离散建筑设计中过度依赖虚拟仿真、缺少手工模型即时反馈的问题,将 6D 位姿估计引入 Jenga 木块堆叠,把实体摆放映射到建模/CFD 风环境评估流程。其核心洞察是开放集、免 CAD 的 Gen6D 更适合早期形态探索。实验中三色木块的位姿可被跟踪并重建到数字空间,但遮挡、环境纹理干扰和预处理成本仍限制实时稳定应用。

BiHRNet: A Binary high-resolution network for Human Pose Estimation Figure 1
arXiv preprint2023-11-17

BiHRNet: A Binary high-resolution network for Human Pose Estimation

PAGE 1, Zhicheng Zhanga, Xueyao Suna, Yonghao Danga, Jianqin Yina

aSchool of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing, China

6D位姿估计人体姿态

面向边缘设备部署高精度人体姿态估计时,HRNet 等模型计算和存储开销过高,直接二值化又会损失关键点热图的局部信息。BiHRNet 将权重和激活约束为 ±1,并通过真实值 HRNet 蒸馏、KL+AWing 损失、IR Bottleneck 与多尺度 MS-Block 减少二值化信息损失。在 MPII 上达到 87.9 PCKh,在 COCO 上达到 70.8 mAP,优于已有二值姿态估计方法,并接近或超过部分轻量全精度网络。

Match and Locate: low-frequency monocular odometry based on deep feature matching Figure 1
arXiv preprint2023-11-16

Match and Locate: low-frequency monocular odometry based on deep feature matching

PAGE 1, Stepan Konev, Yuriy Biktairov

6D位姿估计相机位姿

本文面向低成本机器人在低帧率、丢帧和单目相机条件下的里程计问题,指出传统依赖高频多传感器或稀疏特征的方案难以适应大位姿变化。方法以深度稠密特征匹配估计相对旋转,再用CNN结合深度、光流和时间间隔修正系统误差并补足单目尺度。在AISG–SLA挑战中取得约3°姿态误差、2m平移误差并排名第三,但具体增益来源仍可能受启发式和数据分布影响。

LIO-EKF: High Frequency LiDAR-Inertial Odometry using Extended Kalman Filters Figure 1
arXiv preprint2023-11-16

LIO-EKF: High Frequency LiDAR-Inertial Odometry using Extended Kalman Filters

Yibin Wu

6D位姿估计相机位姿点云

针对现有激光惯性里程计在特征提取、数据关联阈值和迭代次数上依赖调参、且纯激光方法对快速加速度变化不够稳健的问题,LIO-EKF采用紧耦合点到点配准与经典误差状态EKF,用IMU提供初始预测,并以位姿不确定性、地图离散误差和激光噪声自适应设定关联阈值。实验显示其精度接近主流LIO系统,同时里程计计算显著更快,可接近IMU帧率输出。

Improved TokenPose with Sparsity Figure 1
arXiv preprint2023-11-16

Improved TokenPose with Sparsity

PAGE 1, Anning Li

University of Electronic Science and Technology of China

6D位姿估计

该文针对 TokenPose 在高分辨率特征上全局自注意力计算量随 token 数二次增长、且注意力图本身较稀疏的问题,引入两类稀疏性:基于人体骨架邻接与对称关系的关键点稀疏关节 mask,以及按注意力重要性动态剪枝视觉 token 连接的稀疏注意力。作者在 MPII 人体姿态估计实验中报告精度提升并称达到新 SOTA,同时可加速网络;但具体增益与速度收益的来源仍需结合完整实验细节判断。

Pseudo-keypoints RKHS Learning for Self-supervised 6DoF Pose Estimation Figure 1
arXiv preprint2023-11-16

Pseudo-keypoints RKHS Learning for Self-supervised 6DoF Pose Estimation

Yangzheng Wu 0000-0001-8893-0672, Michael Greenspan 0000-0001-6054-8770

6D位姿估计

本文针对6DoF位姿估计中真实位姿标注昂贵、纯合成训练存在sim2real域差的问题,提出RKHSPose:先用合成数据训练关键点径向投票网络,再用伪关键点/伪位姿生成真实域自监督信号,并通过RKHS中可学习核的Adapter以MMD缩小特征分布差异。实验显示其在LINEMOD、Occlusion LINEMOD和YCB-Video上超过既有自监督方法,并在多个BOP数据集上接近强监督结果。

NormNet: Scale Normalization for 6D Pose Estimation in Stacked Scenarios Figure 1
arXiv preprint2023-11-15

NormNet: Scale Normalization for 6D Pose Estimation in Stacked Scenarios

PAGE 1, En-Te Lin, Wei-Jie Lv, Ding-Tao Huang, Long Zeng

6D位姿估计

本文针对堆叠场景中6D位姿估计对物体尺度敏感的问题,指出固定感受野和聚类超参数只在特定尺度范围内最优。NormNet先逐点回归尺度,并通过语义分割与仿射变换把不同尺度物体归一到SNCS,再共享位姿估计器;同时结合深度缺失风格迁移和域随机化做Sim-to-Real。在Siléane、Parametric和自建MultiScale上分别取得约7–24% mAP提升,效果可能主要来自尺度归一化与合成数据增强。

Range-Visual-Inertial Sensor Fusion for Micro Aerial Vehicle Localization and Navigation Figure 1
arXiv preprint2023-11-15

Range-Visual-Inertial Sensor Fusion for Micro Aerial Vehicle Localization and Navigation

Abhishek Goudar, Wenda Zhao, Angela P. Schoellig

the Learning Systems and Robotics Lab

6D位姿估计航天器

针对室内杂乱环境中 MAV 无法依赖 GPS、UWB 量测易受 NLOS 偏置而 VIO 又会漂移的问题,论文提出双固定滞后平滑器融合框架:一条用于联合估计轨迹与 UWB 系统偏差,另一条对 VIO 生成平滑高频修正以服务闭环控制。其偏差估计不依赖真值、额外传感器或训练数据;实飞结果显示相较不估计偏差轨迹误差降低约 50%,并达到分米至亚分米定位和分米级跟踪精度。

LocaliseBot: Multi-view 3D object localisation with differentiable rendering for robot grasping Figure 1
arXiv preprint2023-11-14

LocaliseBot: Multi-view 3D object localisation with differentiable rendering for robot grasping

PAGE 1, Sujal Vijayaraghavan1, Redwan Alqasemi2, Rajiv Dubey2, Sudeep

Department of Computer Science, Department of Mechanical Engineering, University of South Florida, Tampa

6D位姿估计机器人操作多视角

面向夹爪抓取中单目/深度感知不稳、点云缺失噪声导致6D位姿和抓取搜索空间过大的问题,LocaliseBot利用多视角RGB、相机外参和物体CAD模型,先由FCN-ResNet给出类别、分割与粗位姿,再通过可微渲染对多视角投影误差进行在线优化细化位姿,避免依赖深度或点云。实验在ShapeNet上相对既有方法有提升,并在OCID Grasp上结合真值抓取候选达到99.65%抓取准确率,但实时性受在线优化限制。

SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models Figure 1
arXiv preprint2023-11-13

SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models

PAGE 1, Ziyi Lin1, Chris Liu1∗, Renrui Zhang1, Peng Gao1∗, Longtian Qiu1

Shanghai AI Laboratory, MMLab, CUHK, ShanghaiTech University

6D位姿估计

针对现有多模态大模型在视觉-语言对齐、任务泛化和高分辨率细粒度感知上的不足,SPHINX将LLM解冻预训练、真实/合成域模型权重线性混合、多任务指令调优,以及多视觉编码器与高分辨率子图嵌入融合结合起来。实验显示其在VQA、区域理解、检测、文档解析和人体姿态等基准上表现更强,但部分增益可能同时来自更大规模数据与视觉token扩展。

Bio-Inspired Grasping Controller for Sensorized 2-DoF Grippers Figure 1
arXiv preprint2023-11-13

Bio-Inspired Grasping Controller for Sensorized 2-DoF Grippers

PAGE 1, Luca Lach1, S´everin Lemaignan1, Francesco Ferro1, Helge Ritter2, Robert Haschke2

6D位姿估计机器人操作

针对移动服务机器人依赖视觉位姿估计、接触阶段缺少反馈而易推移或损伤物体的问题,本文提出仿生的2自由度夹爪整体控制器:接近时位置控制,首次触觉接触后暂停单关节闭合以建立力闭合,持物时解耦内外力并显式补偿重力。TIAGo平行夹爪实验显示其在位姿不确定下能减少抓取位移、维持目标夹持力,消融验证各组件对抑制漂移和外力顺应均必要。

CESPED: a new benchmark for supervised particle pose estimation in Cryo-EM Figure 1
arXiv preprint2023-11-10

CESPED: a new benchmark for supervised particle pose estimation in Cryo-EM

Ruben Sanchez-Garcia, Michael Saur, Javier Vargas, Carl Poelking, Oxford OX1 3LB, UK @stats.ox.ac.uk, Astex Pharmaceuticals, Cambridge CB4 0QA, UK @astx.com, Departamento de Optica, Universidad Complutense de Madrid, Madrid 28040, Spain jvargas@fis.ucm.es

Michael Saur 2 , Javier Vargas 3 , Carl Poelking 2 , Charlotte M Deane Department of Statistics, University of Oxford, Oxford OX1 LB, UK

6D位姿估计数据集/基准

针对 Cryo-EM 单颗粒重构中姿态估计耗时、深度学习方法缺少统一监督评测的问题,论文构建了 CESPED 基准,并配套 PyTorch 数据处理与指标工具,统一整理多组 EMPIAR 粒子及 Relion 姿态标签。作者用 Image2Sphere 做基线,结果显示模型可获得一定姿态预测能力并具备跨样本泛化潜力,但精度与可靠性仍落后传统 refinement 方法。

2D Image head pose estimation via latent space regression under occlusion settings Figure 1
arXiv preprint2023-11-10

2D Image head pose estimation via latent space regression under occlusion settings

PAGE 1, Jos´e Celestino, Manuel Marques, Jacinto C. Nascimento, Jo˜ao Paulo

Institute for Systems and Robotics, Instituto Superior T´ecnico, Lisboa, Portugal

6D位姿估计

论文关注遮挡场景下2D头部姿态估计失效的问题,动机来自驾驶监测与机器人辅助进食等真实应用。核心做法是用潜空间回归与多损失来重组欧拉角预测,并提出基于RGB-D提取遮挡物、合成遮挡数据的流程。实验在合成遮挡BIWI/AFLW2000、真实遮挡Pandora及机器人进食场景中优于多种遮挡HPE方法,非遮挡场景也保持相近或更好精度。

Robust Adversarial Attacks Detection for Deep Learning based Relative Pose Estimation for Space Rendezvous Figure 1
arXiv preprint2023-11-10

Robust Adversarial Attacks Detection for Deep Learning based Relative Pose Estimation for Space Rendezvous

PAGE 1, Ziwei Wanga, Nabil Aoufa, Jose Pizarrob, Christophe Honvaultb

aDepartment of Engineering, City, University of London, Northampton Square, London, EC1V HB, United Kingdom, bEuropean Space Agency, European Space Research & Technology Centre, Keplerlaan 1, PO Box 299, Noordwijk, AG, The Netherlands

6D位姿估计相机位姿

面向航天器交会中深度相对6D位姿估计易受不可察觉对抗扰动影响、可能导致错误制导的问题,本文先构建基于改进Darknet-19的CNN位姿估计器并用FGSM验证脆弱性,再利用CNN预测的SHAP解释序列训练LSTM检测攻击。实验在合成与实验室真实数据上分别达到99.21%和96.29%检测准确率,但物理攻击实现与攻击后位姿纠正仍未充分解决。

A Practical Guide to Implementing Off-Axis Stereo Projection Using Existing Ray Tracing Libraries Figure 1
arXiv preprint2023-11-10

A Practical Guide to Implementing Off-Axis Stereo Projection Using Existing Ray Tracing Libraries

PAGE 1, Technical Report

University of Cologne, NVIDIA

6D位姿估计多视角

面向 CAVE、powerwall 等 VR 场景,现有 OSPRay/ANARI 等光线追踪库通常只暴露居中透视相机,难以直接支持用户头部跟踪下的离轴双目投影。论文的核心贡献是把离轴投影转化为可在现有库中生成主光线的三类实现策略,包括反变换矩阵生成光线、转换为双针孔相机以及利用子图像区域等,并提供可复用代码。作者在现有 VR 应用和光追库中验证这些方法可用,报告未见性能退化或数值精度问题。

Visually Guided Model Predictive Robot Control via 6D Object Pose Localization and Tracking Figure 1
arXiv preprint2023-11-09

Visually Guided Model Predictive Robot Control via 6D Object Pose Localization and Tracking

Mederic Fourmy, Vojtech Priban, Jan Kristof Behrens, Nicolas Mansard, Josef Sivic, Vladimir Petrik

6D位姿估计物体位姿机器人操作

面向动态物体抓取、协作搬运等需要相对物体6D位姿闭环控制的场景,论文指出单纯位姿估计太慢、单纯跟踪又依赖初始化。其核心是异步结合学习式6D位姿定位器与高速模型式跟踪器,并接入基于力矩的MPC控制器,在最高约120Hz、单帧跟踪约5ms下提供低延迟连续位姿;方法在BOP/YCBV评测和7自由度Franka实机动态物体控制中得到验证。

Spatial Attention-based Distribution Integration Network for Human Pose Estimation Figure 1
arXiv preprint2023-11-09

Spatial Attention-based Distribution Integration Network for Human Pose Estimation

PAGE 1, Date of publication xxxx 00, date of current version xxxx 00

School of Mathematics and Information Science, Guangzhou University, Guangzhou 510006, China, School of Electronics and Communication Engineering Lab Center, Guangzhou University, Guangzhou 510006, China, School of Electronics and Communication Engineering, Guangzhou University, Guangzhou 510006, China

6D位姿估计人体姿态

针对人体关键点在遮挡、姿态多样、光照变化和肢体重叠下定位不稳的问题,论文在 HourglassNet 上提出 SADI-Net:用含空洞残差与 SE 注意力的 RFM 扩大感受野,用全局/局部空间注意力的 SFM 融合多尺度特征,并通过受 RLE 启发的 DLM 学习热图分布而非固定高斯先验。在 MPII 与 LSP 上验证,MPII 测试集 PCKh 达 92.10%,优于对比方法。

SPADES: A Realistic Spacecraft Pose Estimation Dataset using Event Sensing Figure 1
arXiv preprint2023-11-09

SPADES: A Realistic Spacecraft Pose Estimation Dataset using Event Sensing

PAGE 1, Arunkumar Rathinam1, Haytam Qadadri2, Djamila Aouada1

6D位姿估计事件相机数据集/基准航天器

针对航天器6D位姿估计中真实轨道数据稀缺、合成到真实域迁移性能下降的问题,SPADES引入同内参的仿真与实验室真实事件相机数据,并提供相机坐标系下真值位姿;同时提出事件帧过滤和三通道图像化事件表示。基线实验比较不同表示、过滤策略和直接/混合框架,显示过滤可提升训练质量,新表示优于已有事件表示,但实际增益可能部分来自更高质量数据。

Differentiable Cloth Parameter Identification and State Estimation in Manipulation Figure 1
arXiv preprint2023-11-09

Differentiable Cloth Parameter Identification and State Estimation in Manipulation

Dongzhe Zheng, Siqiong Yao, Wenqiang Xu, Cewu Lu

6D位姿估计机器人操作

面向机器人布料操作中仅靠关键点/边界难以恢复完整状态、且忽略材料物理会影响估计的问题,DiffCP将各向异性弹塑性A-EP模型接入可微MPM仿真,通过RGB-D观测的真实点云与仿真状态几何对齐来反推布料参数,并服务于位姿估计与轨迹生成。实验在多种织物、服装、动作、抓取点和速度下显示参数估计较稳定,可区分材料,获得较低Chamfer距离的服装状态,并在轨迹优化中比RL基线收敛更快。

POISE: Pose Guided Human Silhouette Extraction under Occlusions Figure 1
arXiv preprint2023-11-09

POISE: Pose Guided Human Silhouette Extraction under Occlusions

PAGE 1

University of California, Riverside, AWS AI Labs

6D位姿估计

遮挡会使常规人体分割模型把被遮部位误判为背景,导致轮廓破碎并影响步态识别等下游任务。POISE的核心思路是自监督融合预训练分割结果与2D姿态关键点:前者保留可见区域的体型细节,后者提供被遮挡肢体的空间结构,并通过关键点到稠密轮廓的辅助变换生成伪监督。实验显示其在遮挡场景下能提升人体轮廓完整性,并改善步态识别表现。

Active Transfer Learning for Efficient Video-Specific Human Pose Estimation Figure 1
arXiv preprint2023-11-08

Active Transfer Learning for Efficient Video-Specific Human Pose Estimation

PAGE 1, Hiromu Taketsugu

Toyota Technological Institute

6D位姿估计人体姿态

针对预训练人体姿态估计器在具体视频域中因域差导致精度显著下降、逐帧标注成本又过高的问题,论文将主动学习与迁移学习结合做视频级自适应。核心是用热图时间连续性衡量不确定性、用全身姿态异常性捕捉不自然估计,并通过动态不确定性加权融入 Core-Set 代表性采样,同时改进 ACFT 重训练和停止准则。实验在 PoseTrack21 等设置下显示,该策略比随机、传统不确定性和代表性采样更高效,消融表明 THC、WPU、DUW 均有贡献。

3D Pose Estimation of Tomato Peduncle Nodes using Deep Keypoint Detection and Point Cloud Figure 1
arXiv preprint2023-11-08

3D Pose Estimation of Tomato Peduncle Nodes using Deep Keypoint Detection and Point Cloud

PAGE 1, Jianchao Cia, Xin Wanga, David Rapado-Rincóna, Akshay K. Burusaa, Gert Kootstraa

aAgricultural Biosystems Engineering Group, Department of Plant Sciences, the Netherlands

6D位姿估计点云

面向温室番茄采摘中果梗节点姿态难获取、遮挡和视角变化影响机器人操作的问题,论文将番茄果梗节点表示为4个解剖关键点,先用深度关键点检测在RGB图像中定位,再融合RGB-D点云估计3D姿态角度。商业温室测试显示,节点检测AP@0.5达0.96,关键点PDJ@0.2为94.31%,上下相对角MAE分别为11.38°和9.93°,对多视角较稳健但高视角略优。

Learning Robust Multi-Scale Representation for Neural Radiance Fields from Unposed Images Figure 1
arXiv preprint2023-11-08

Learning Robust Multi-Scale Representation for Neural Radiance Fields from Unposed Images

PAGE 1

International Journal of Computer Vision manuscript No

6D位姿估计

本文针对日常手持多视图图像中相机位姿未知且尺度变化大的问题,指出仅处理多尺度混叠或仅联合优化位姿都不足。方法将相机内外参与多尺度 NeRF 表示一起学习,引入单图深度先验、刚体场景约束和基于图神经网络的多重运动平均来稳健估计绝对位姿。实验在多个基准上显示,相比 Mip-NeRF、BARF 等,在存在位姿误差和多尺度输入时能获得更稳定的新视角合成与位姿恢复。

PLV-IEKF: Consistent Visual-Inertial Odometry using Points, Lines, and Vanishing Points Figure 1
arXiv preprint2023-11-08

PLV-IEKF: Consistent Visual-Inertial Odometry using Points, Lines, and Vanishing Points

PAGE 1, Tong Hua1, Tao Li1, Liang Pang2, Guoqing Liu1, Wencheng Xuanyuan2, Chang Shu2, Ling Pei∗

6D位姿估计相机位姿

针对传统 EKF/MSCKF 视觉惯性里程计在弱纹理、人造场景中易受点特征不足和不一致性导致角漂的问题,本文提出融合点、线与消失点的右不变 IEKF VIO。核心在于证明地标不入状态时,点/线的常规加性误差可与不变误差形成等价量测并保持一致性,同时分析消失点量测自然保留不可观方向。仿真和真实实验显示其在人造环境中获得更准确且一致的位姿估计。

UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields Figure 1
arXiv preprint2023-11-08

UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields

PAGE 1, Injae Kim∗

Korea University

6D位姿估计三维重建

UP-NeRF针对无相机位姿先验的NeRF在互联网照片中易受光照变化、临时遮挡和复杂视角干扰而位姿优化失败的问题,提出以颜色不敏感的深度特征场作为替代束调目标,并用独立瞬态模块、候选头和瞬态感知深度监督减少遮挡与错误先验影响。在Phototourism等非受控场景中,相比BARF及变体获得更稳健的位姿估计和更好的渲染质量。

A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation Figure 1
arXiv preprint2023-11-06

A Single 2D Pose with Context is Worth Hundreds for 3D Human Pose Estimation

PAGE 1, Qitao Zhao1∗

Robotics Institute, Carnegie Mellon University, Center for Research in Computer Vision, University of Central Florida, Key Laboratory of Machine Perception, Peking University, Shenzhen Graduate School

6D位姿估计人体姿态

针对2D到3D人体姿态提升方法依赖数百帧时序线索、计算重且存在非因果推理的问题,论文指出瓶颈在于仅用2D关节坐标会丢失图像空间上下文。作者复用冻结2D姿态检测器的中间多尺度特征,设计Context-Aware PoseFormer,通过可变形上下文提取与姿态-上下文融合来缓解深度歧义和遮挡。单帧模型在Human3.6M和MPI-INF-3DHP上超过使用最多351帧的时序方法,并兼顾速度与精度。

Enabling In-Situ Resources Utilisation by leveraging collaborative robotics and astronaut-robot interaction Figure 1
arXiv preprint2023-11-06

Enabling In-Situ Resources Utilisation by leveraging collaborative robotics and astronaut-robot interaction

PAGE 1, Baku, Azerbaijan, 2-6 October 2023

b ESTEC, ESA, Keplerlaan 1, AZ Noordwijk, The Netherlands

6D位姿估计机器人操作

面向月球/火星原位资源利用中宇航员需与多机器人协作的需求,本文提出硬件无关的 CISRU 软件套件,将多智能体自治、AI 环境感知与6D位姿估计、安全/社交导航、多工具操作和混合现实人机交互整合到统一流程。其在宇航员-巡视器数据集和 GMV SPoT 类行星环境中验证了两机器人一宇航员协作的可行性与效率,但实验仍限于受控模拟场景,通信距离、系统规模和协同操作能力的实际增益仍需进一步说明。

Simultaneous Time Synchronization and Mutual Localization for Multi-robot System Figure 1
arXiv preprint2023-11-06

Simultaneous Time Synchronization and Mutual Localization for Multi-robot System

Xiangyong Wen, Yingjian Wang, Xi Zheng, Kaiwei Wang, Chao Xu, Fei Gao

6D位姿估计机器人操作

多机器人互定位常默认时间同步,但时钟偏移会造成观测关联偏差并降低相对位姿精度。该文将时间偏移作为待估变量并入基于方位观测的互定位,在短时恒速假设下构造含时间与6D相对位姿的新误差模型,通过QCQP与半定松弛求解,并用粗到细迭代扩大可处理偏移范围。仿真和真实实验显示,同步联合优化能提升互定位精度与鲁棒性。

Initialisation of Autonomous Aircraft Visual Inspection Systems via CNN-Based Camera Pose Estimation Figure 1
arXiv preprint2023-11-06

Initialisation of Autonomous Aircraft Visual Inspection Systems via CNN-Based Camera Pose Estimation

PAGE 1, Xueyan Oh1, Leonard Loh1, Shaohui Foong1, Zhong Bao Andy Koh2, Kow Leong Ng2, Poh Kang Tan2, Pei

6D位姿估计相机位姿

面向机场停机坪约两小时周转内的飞机外观自动巡检,论文关注无基础设施、无真实飞机预采集条件下的相机初始化。方法用合成A320模型图像和域随机化训练PTZ相机位姿回归网络,并在PoseNet类损失中加入利用飞机几何约束位置与朝向的ICSC项。28张真实图像测试中,中位误差达0.217 m、0.731°,优于PoseNet+的0.292 m、1.252°。

Efficient, Self-Supervised Human Pose Estimation with Inductive Prior Tuning Figure 1
arXiv preprint2023-11-06

Efficient, Self-Supervised Human Pose Estimation with Inductive Prior Tuning

Nobline Yoo, Olga Russakovsky

Princeton University

6D位姿估计人体姿态

针对人体姿态估计依赖大量关键点标注、而自监督重建式方法精度不足的问题,论文从重建损失与姿态精度的关系入手,调节归纳先验:加入 MSE 重建项、设计更贴合 Human3.6M 姿态分布的新高斯模板,并用矩阵扩展实现手臂粗到细估计和翻转增强;还提出无需真值的肢体长度比例一致性指标。最佳模型用约 18 万训练对、少于基线三分之一数据,PDJ 从已发布检查点的 40.8 提升到 42.6,归一化 L2 从 11.0 降至 6.4。

Generating Unbiased Pseudo-labels via a Theoretically Guaranteed Chebyshev Constraint to Unify Semi-supervised Classification and Regression Figure 1
arXiv preprint2023-11-03

Generating Unbiased Pseudo-labels via a Theoretically Guaranteed Chebyshev Constraint to Unify Semi-supervised Classification and Regression

PAGE 1, Jiaqi Wu1, Junbiao Pang1, Qingming Huang2

Beijing University of Technology, University of Chinese Academy of Sciences

6D位姿估计

论文针对半监督伪标签中“置信度不等于标签质量”的偏差问题,尤其是回归式姿态估计中热图峰值难以筛选可靠伪标签,提出基于切比雪夫不等式的 UBPL 多分支框架,并用特征去相关损失提升分支预测多样性,从多个弱预测组合出更无偏的伪标签。方法可接入 Mean Teacher、FixMatch、DualPose,在 Mouse、FLIC、LSP 姿态估计及 CIFAR/SVHN 分类实验中整体优于对应基线。

Sim2Real Bilevel Adaptation for Object Surface Classification using Vision-Based Tactile Sensors Figure 1
arXiv preprint2023-11-02

Sim2Real Bilevel Adaptation for Object Surface Classification using Vision-Based Tactile Sensors

Gabriele M. Caddeo, Andrea Maracani, Paolo Didier Alfano, Nicola A. Piga, Lorenzo Rosasco, Lorenzo Natale

MaLGa Center, DIBRIS, Università di Genova, Genoa, Italy. {\dagger}

6D位姿估计仿真到现实

针对视觉触觉传感器真实数据难采、仿真难以还原凝胶形变和光照而导致表面分类 Sim2Real 落差的问题,论文用少量无标注 DIGIT 真实触觉图像训练扩散模型,将自动采样并按局部曲率标注的 YCB 仿真触觉图像翻译到真实域,再结合 DANN 做特征级对齐。该方法在10个3D打印YCB物体上表面分类准确率达81.9%,显著高于仅用仿真训练的34.7%,并用于触觉6D位姿估计验证。

A Spatial-Temporal Transformer based Framework For Human Pose Assessment And Correction in Education Scenarios Figure 1
arXiv preprint2023-11-01

A Spatial-Temporal Transformer based Framework For Human Pose Assessment And Correction in Education Scenarios

PAGE 1, Wenyang Hu

Fudan-Xiding AI Joint LAB, Research Center Co., Ltd, Shanghai, China, R&D Center, School of Information, Science and Technology, Fudan University

6D位姿估计人体姿态

面向体育锻炼、实验操作等教育场景中学生动作难以及时评估和纠错的问题,论文提出STTF框架,将LitePose骨架跟踪、姿态匹配、时空Transformer动作质量评估与基于关节角范围的可视化纠错结合,在自建五类练习数据集上显示可给出动作评分和错误关节反馈;但样本规模较小,纠错规则的专业覆盖仍文中未充分说明。

HAP: Structure-Aware Masked Image Modeling for Human-Centric Perception Figure 1
arXiv preprint2023-10-31

HAP: Structure-Aware Masked Image Modeling for Human-Centric Perception

PAGE 1, Junkun Yuan1, Xinyu Zhang2∗, Hao Zhou2, Jian Wang2, Zhongwei Qiu3, Zhiyin Shao4

Zhejiang University, University of Science and Technology Beijing, South China University of Technology, Shanghai Jiao Tong University, Jilin University

6D位姿估计

这篇工作针对通用 MIM 预训练直接用于以人为中心感知时容易破坏人体结构、效果不佳的问题,提出 HAP:用人体部件先验引导遮挡采样,并加入结构不变对齐损失,使 ViT 预训练更关注身体部位关系。方法仅用 LUPerson 图像/关键点预训练,却在行人重识别、属性识别、2D/3D 姿态等 11 个基准达到或刷新 SOTA。

Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior Figure 1
arXiv preprint2023-10-31

Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior

PAGE 1

Stanford University ETH Zurich

6D位姿估计

为缓解目标角色缺少高质量动捕数据时难以生成可信运动的问题,论文提出 Pose-to-Motion:用目标域少量静态姿态作为姿态先验,将源域动捕运动通过非对称 CycleGAN 投射到目标骨架,并用软约束合成合理根节点运动以处理位移歧义。实验覆盖 Mixamo、动物姿态和图像估计马姿态,显示其在小样本、噪声姿态及骨架差异较大时仍能生成更自然、伪影更少的动作,但目标域真实步态差异仍可能无法完全捕捉。

FetusMapV2: Enhanced Fetal Pose Estimation in 3D Ultrasound Figure 1
arXiv preprint2023-10-30

FetusMapV2: Enhanced Fetal Pose Estimation in 3D Ultrasound

PAGE 1, Medical Image Analysis (2023

Contents lists available at ScienceDirect, aNational-Regional Key Technology Engineering Laboratory for Medical Ultrasound, School of Biomedical Engineering, Health Science Center, Shenzhen, University, Shenzhen, China, bMedical Ultrasound Image Computing (MUSIC) Laboratory, Shenzhen University, Shenzhen, China, cShenzhen RayShape Medical Technology Co., Ltd, Shenzhen, China, dDepartment of Ultrasound, Luohu People’s Hosptial, Shenzhen, China, eThe Hong Kong University of Science and Technology (Guangzhou), Nansha, Guangzhou, China, fThe Hong Kong University of Science and Technology, Hong Kong SAR, China, gDepartment of Statistics and Actuarial Science, The University of Hong Kong, Hong Kong SAR, China, hHunan First Normal University, Changsha, China, iDepartment of Medical Ultrasonics, The First People’s Hospital of Foshan, Foshan, China, Available online

6D位姿估计

本文面向3D超声中胎儿全身位姿估计,解决体数据分辨率受显存限制、肢体左右/相似结构易混淆、姿态变化大导致泛化困难的问题。FetusMapV2通过启发式显存管理提升输入分辨率,引入Pair Loss分离类别判别与关键点定位,并用形状先验自监督在线细化预测。在含1000个体数据、每例22个标志点的数据集上,实验显示其优于多种强基线,并可支持生物测量、标准切面定位等应用。

Distributed Nonlinear Filtering using Triangular Transport Maps Figure 1
arXiv preprint2023-10-29

Distributed Nonlinear Filtering using Triangular Transport Maps

PAGE 1, Daniel Grange∗

6D位姿估计

针对多传感器网络中各节点只能获得局部、异构观测而需一致估计全局状态的问题,本文将Knothe–Rosenblatt三角传输映射引入分布式非线性滤波,并结合降维与共识机制,用映射采样替代粒子权重更新以缓解退化。方法在卫星6D位姿估计的直接/间接观测网络上做数值验证,结果主要作为概念证明,文中未充分说明相对强基线的稳定增益。

Improving Multi-Person Pose Tracking with A Confidence Network Figure 1
arXiv preprint2023-10-29

Improving Multi-Person Pose Tracking with A Confidence Network

PAGE 1, JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021

6D位姿估计

针对自顶向下多人姿态跟踪在遮挡、快速运动下依赖检测器、易漏检并导致轨迹断裂的问题,论文引入关键点置信网络显式估计关键点可见性,并在在线跟踪中加入 Bbox-revision 修复漏框、ID-retrieve 找回历史轨迹。方法可接入不同检测器和姿态网络,在 PoseTrack 2017/2018 上报告达到 SOTA,2018 验证集 MOTA 为 69.2%。

HDMNet: A Hierarchical Matching Network with Double Attention for Large-scale Outdoor LiDAR Point Cloud Registration Figure 1
WACV20242023-10-29

HDMNet: A Hierarchical Matching Network with Double Attention for Large-scale Outdoor LiDAR Point Cloud Registration

Weiyi Xue, Fan Lu, Guang Chen

Tongji University

6D位姿估计点云

面向大规模户外 LiDAR 点云稀疏、范围大且分布复杂导致传统 ICP 依赖初值、学习方法易误匹配或低效的问题,HDMNet 采用层次化全局局部到局部配准加精配准框架,引入特征一致性增强的双重 soft matching 做 patch-to-patch 对应,并将深层对应置信度转为浅层可训练掩码以聚焦关键区域、减少重复计算。在 KITTI 与 NuScenes 上,论文报告其精度优于现有方法且保持较高效率。

Enhancing Grasping Performance of Novel Objects through an Improved Fine-Tuning Process Figure 1
arXiv preprint2023-10-28

Enhancing Grasping Performance of Novel Objects through an Improved Fine-Tuning Process

PAGE 1, Xiao Hu1, Xiangsheng Chen1

6D位姿估计未知物体

针对 PointNetGPD/GraspNet 等点云 6D 抓取模型在未知物体上需重新微调、而传统 Antipod 合成标注耗时的问题,论文提出通过抓取方向采样快速生成候选,并用大规模仿真过滤重复/不可行抓取、重新评分以考虑夹爪闭合导致的位移和力矩失衡。实验称单物体 6500 个标注抓取由约 10 小时降至 1.2 小时,微调流程约快 400%,真实抓取验证了成功率提升。

ProcNet: Deep Predictive Coding Model for Robust-to-occlusion Visual Segmentation and Pose Estimation Figure 1
arXiv preprint2023-10-27

ProcNet: Deep Predictive Coding Model for Robust-to-occlusion Visual Segmentation and Pose Estimation

Michael Zechmair, Alban Bornet, Yannick Morel

6D位姿估计

面向人机协作中机械臂/人体相互遮挡导致的安全感知失效,ProcNet 将预测编码的反馈误差最小化机制引入视觉分割,并用生成的目标掩码与候选位姿掩码匹配、通过梯度搜索收敛到最可能位姿。实验评估了关键参数影响,并与 NVIDIA PoseCNN 对比,显示其在瞬时部分遮挡下的分割与位姿估计更稳健,但文中结果主要为仿真验证。

Learning Extrinsic Dexterity with Parameterized Manipulation Primitives Figure 1
arXiv preprint2023-10-26

Learning Extrinsic Dexterity with Parameterized Manipulation Primitives

Shih-Min Yang, Martin Magnusson, Johannes A. Stork, Todor Stoyanov

the Center for Applied Autonomous Sensor Systems (AASS), Örebro University, Sweden

6D位姿估计机器人操作

针对平放或受环境遮挡导致无可行直接抓取位姿的物体,论文用层次强化学习把推、翻转、抓取等参数化操作原语串联起来,并让复杂的翻转原语从深度图交互中学习,减少对物体检测、位姿估计和手工控制器的依赖。方法在仿真中经课程学习和自动域随机化训练,可零样本迁移到真实机械臂,在不同重量、形状和摩擦的盒状物抓取实验中达到98%成功率。

6-DoF Stability Field via Diffusion Models Figure 1
arXiv preprint2023-10-26

6-DoF Stability Field via Diffusion Models

PAGE 1, Takuma Yoneda∗

6D位姿估计

面向杂乱场景中的机器人放置与堆叠,论文指出手工规则和基于稳定性判别的采样方法泛化弱、样本效率低。6-DoFusion 将物体形状与已有 6D 位姿作为上下文,用扩散模型在 SE(3) 中从随机位姿逐步生成稳定放置分布,只需正例稳定配置训练。实验显示其能为已见和新物体生成多样且稳定的 6D 放置,并可提升现有 3D 位姿估计结果;但方法假设已知物体位姿和 SDF。

SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimation Figure 1
arXiv preprint2023-10-26

SE(3) Diffusion Model-based Point Cloud Registration for Robust 6D Object Pose Estimation

PAGE 1, Haobo Jiang1, Mathieu Salzmann2, Zheng Dang2, Jin Xie1∗, Jian Yang1∗

PCA Lab, Nanjing University of Science and Technology, China, CVLab, EPFL, Switzerland

6D位姿估计物体位姿点云

面向真实场景中点云配准式 6D 位姿估计易受大位姿差、噪声与遮挡影响的问题,本文将刚体变换估计建模为 SE(3) 上的扩散去噪过程,并借助 se(3) 李代数实现扰动与反向更新,同时以配准专用变分下界训练、可接入不同深度配准网络。实验在 TUD-L、LINEMOD 和 Occluded-LINEMOD 上显示其相较现有配准方法更稳健、精度更高。

Automatic Edge Error Judgment in Figure Skating Using 3D Pose Estimation from a Monocular Camera and IMUs Figure 1
arXiv preprint2023-10-26

Automatic Edge Error Judgment in Figure Skating Using 3D Pose Estimation from a Monocular Camera and IMUs

PAGE 1, Ryota Tanaka

Nagoya University

6D位姿估计

花样滑冰鲁兹跳的刃错误涉及起跳脚内外刃的细微三维姿态,人工判罚易受经验和主观性影响,既有方法多停留在2D动作分析。本文结合单目手机视频的3D姿态估计与IMU,构建监督分类系统,并比较关节坐标、关节角等特征对判罚的贡献。实验显示,使用单目相机估计的3D关节位置在未知选手上达到83%准确率,说明低成本视频方案有望用于日常训练中的自动辅助判罚。

Real-time 6-DoF Pose Estimation by an Event-based Camera using Active LED Markers Figure 1
arXiv preprint2023-10-25

Real-time 6-DoF Pose Estimation by an Event-based Camera using Active LED Markers

PAGE 1, Gerald Ebmer 1∗

6D位姿估计事件相机

针对传统视觉标记定位受相机帧率、运动模糊和计算开销限制的问题,本文将事件相机与具有唯一闪烁频率的主动 LED 标记结合,通过频率识别完成点匹配并用 PnP 实时求解 6D 位姿,同时利用事件流跟踪降低延迟。系统在普通 PC 上实现低于 0.5 ms 延迟和 3 kHz 输出,2.1–4.8 m 下平移误差约 34.5 mm、姿态误差约 0.74°,并在四旋翼高速室内外实验中验证可用性。

ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee Behaviors Figure 1
arXiv preprint2023-10-25

ChimpACT: A Longitudinal Dataset for Understanding Chimpanzee Behaviors

PAGE 1, Xiaoxuan Ma 1

CFCS, School of Computer Science, Peking University, China, Department of Cognitive Science, University of California, San Diego, USA, Institute for Artificial Intelligence, Peking University, China, Nat’l Eng. Research Center of Visual Technology, China, PKU-WUHAN Institute for Artificial Intelligence, China

6D位姿估计数据集/基准

针对非人灵长类长期社会行为数据稀缺、人工编码成本高的问题,ChimpACT发布了2015–2018年莱比锡动物园20余只黑猩猩的纵向视频数据,含16.05万帧、5.6万框/姿态、身份跟踪及23类精细时空行为标签,并引入专家ethogram标注。论文在跟踪识别、2D姿态估计和动作检测三条任务上评测代表方法,显示现有人类/动物视觉模型迁移到群体黑猩猩场景仍具挑战,数据集价值可能主要来自高质量纵向标注与基准设定。

MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Network Figure 1
arXiv preprint2023-10-25

MotionAGFormer: Enhancing 3D Human Pose Estimation with a Transformer-GCNFormer Network

PAGE 1, Soroush Mehraban1, Vida Adeli1, Babak Taati1

KITE Research Institute, Institute of Biomedical Engineering, University of Toronto, Department of Computer Science, University of Toronto

6D位姿估计人体姿态

本文针对单目2D到3D人体姿态提升中 Transformer 偏全局、GCN偏局部且高精度模型计算开销大的问题,提出 MotionAGFormer:在 AGFormer 块中并行使用 Transformer 与 GCNFormer 分别建模全局关节依赖和相邻关节的时空局部关系,并自适应融合,同时一次前向预测完整序列以减少冗余。其在 Human3.6M 和 MPI-INF-3DHP 上达到 P1 38.4mm、16.2mm,并较前一领先方法参数约为四分之一、计算效率约提升三倍。

TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer Figure 1
arXiv preprint2023-10-25

TransPose: 6D Object Pose Estimation with Geometry-Aware Transformer

Xiao Lin, Deming Wang, Guangliang Zhou, Chengju Liu, Qijun Chen

6D位姿估计物体位姿

面向遮挡、噪声下仅依赖RGB或局部点云特征难以稳定估计6D位姿的问题,TransPose从深度点云出发,先用图卷积在均匀采样的局部区域提取点对几何特征,再通过带geometry-aware模块的Transformer传播全局信息,把点云几何关系作为注意力学习的约束。实验在LineMod、Occlusion LineMod和YCB-Video上取得有竞争力结果,显示仅用点云也可接近部分RGB-D方法。

Converting Depth Images and Point Clouds for Feature-based Pose Estimation Figure 1
arXiv preprint2023-10-23

Converting Depth Images and Point Clouds for Feature-based Pose Estimation

PAGE 1, Robert L¨osch1, Mark Sastuba2, Jonas Toth1, Bernhard Jung1

6D位姿估计点云彩色深度

针对原始深度图/点云缺少稳定角点、给特征式配准与位姿估计带来困难的问题,论文提出 Flexion 图像:先去噪,再由邻域点构造两组法向量并编码其差异,以突出被深度值掩盖的几何细节。相比 Bearing Angle 图像,它更亮、对比度更高且具一定旋转不变性;在合成 VO 与 TUM RGB-D 上的 ORB-SLAM3 测试中,AKAZE/ORB/SIFT/SURF 多数优于 BA,但仍整体弱于彩色图,适合作为无 RGB 时的替代表示。

Object Pose Estimation Annotation Pipeline for Multi-view Monocular Camera Systems in Industrial Settings Figure 1
arXiv preprint2023-10-23

Object Pose Estimation Annotation Pipeline for Multi-view Monocular Camera Systems in Industrial Settings

PAGE 1, Hazem Youssef[0000−0002−7197−9127

TU Dortmund University, Dortmund, Germany

6D位姿估计物体位姿多视角

面向仓库/产线等大空间的6D物体位姿数据稀缺且多视角人工标注成本高,本文提出一条自动标注流水线:先定位多台单目RGB相机并与动捕坐标系统一,再将物体3D模型按真实6D位姿投影生成相机相对位姿、框和掩码。作者在8相机工业仿真场景采集Multi-log数据集,含约6136张图、2.65万实例,标注总耗时13.9小时,约1.9秒/实例,显著快于人工标注。

Player Re-Identification Using Body Part Appearences Figure 1
arXiv preprint2023-10-23

Player Re-Identification Using Body Part Appearences

PAGE 1, Mahesh Bhosale

A2IL, University at Buffalo

6D位姿估计

针对足球比赛中球员外观和球衣高度相似、跨摄像机视角差异大且样本少导致的重识别困难,论文提出外观分支与OpenPose身体部位分支的双流网络,用紧凑双线性池化融合局部部位与外观特征,并以三元组损失训练,无需SoccerNet-V3部位标注。实验称在SoccerNet-V3上取得较高mAP和Rank-1并优于OsNet、InceptionNet,但具体增益幅度文中片段未充分说明。

LanPose: Language-Instructed 6D Object Pose Estimation for Robotic Assembly Figure 1
arXiv preprint2023-10-20

LanPose: Language-Instructed 6D Object Pose Estimation for Robotic Assembly

PAGE 1, Bowen Fu1, Sek Kun Leong1, Yan Di2, Jiwen Tang1, Xiangyang Ji1

6D位姿估计物体位姿机器人操作

面向仅靠2D视觉定位难以完成高精度装配的问题,LanPose将自然语言指令中的对象关系与RGB几何特征结合,用跨注意力和语言融合的6D位姿映射模块,同时预测被观测物体与装配位置的SE(3)位姿,并仅用合成数据训练。实验中物体位姿和装配位姿ADD(-S)-0.1d分别达98.09和93.55,真实机器人积木装配成功率为82.1%。

FMRT: Learning Accurate Feature Matching with Reconciliatory Transformer Figure 1
arXiv preprint2023-10-20

FMRT: Learning Accurate Feature Matching with Reconciliatory Transformer

Xinyu Zhang * ^ start_FLOATSUPERSCRIPT * end_FLOATSUPERSCRIPT, Li Wang * ^ start_FLOATSUPERSCRIPT * end_FLOATSUPERSCRIPT, Zhiqiang Jiang, Kun Dai, Tao Xie, Lei Yang, Wenhao Yu, Yang Shen, Jun Li

6D位姿估计

FMRT针对现有无检测器Transformer匹配方法只在固定感受野上建模、且依赖手工位置编码导致匹配精度受限的问题,提出RecFormer自适应融合多感受野全局/局部特征,并用AWPE将行列坐标解耦为可学习位置编码。实验显示其在相对位姿估计、视觉定位、单应估计和图像匹配等基准上均取得更优表现。

ColAG: A Collaborative Air-Ground Framework for Perception-Limited UGVs' Navigation Figure 1
arXiv preprint2023-10-20

ColAG: A Collaborative Air-Ground Framework for Perception-Limited UGVs' Navigation

Zhehan Li, Rui Mao, Nanhe Chen, Chao Xu, Fei Gao, Yanjun Cao

6D位姿估计

针对多台低成本、无环境感知UGV在未知障碍场景中难以安全自主导航的问题,ColAG将一架具备SLAM与相对位姿观测能力的UAV作为共享“空中眼”。其核心是在UGV端融合轮速计与有限RPE并进行带不确定性的碰撞预测,在UAV端将支援顺序建模为带时间窗VRP以减少等待和碰撞风险。系统在最多7台UGV仿真和3台UGV实机实验中验证了可行性。

CylinderTag: An Accurate and Flexible Marker for Cylinder-Shape Objects Pose Estimation Based on Projective Invariants Figure 1
arXiv preprint2023-10-20

CylinderTag: An Accurate and Flexible Marker for Cylinder-Shape Objects Pose Estimation Based on Projective Invariants

Shaoan Wang, Mingzhu Zhu, Yaoqing Hu, Dongyue Li, Fusong Yuan, Junzhi Yu

6D位姿估计

针对传统平面视觉标记贴附在圆柱等曲面物体上易变形、视角受限并影响6D位姿精度的问题,论文提出可环绕圆柱表面的 CylinderTag。其核心是在可展曲面流形假设下,沿零曲率方向利用投影不变量交比进行编码,并配套启发式字典生成与实时识别器。实验比较检测率、速度、字典规模、定位抖动和位姿精度,显示其在多视角圆柱物体上较传统标记具有更稳检测和更高定位精度。

Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey Figure 1
arXiv preprint2023-10-19

Human Pose-based Estimation, Tracking and Action Recognition with Deep Learning: A Survey

Lijuan Zhou, Xiang Meng, Zhihuan Liu, Mengqi Wu, Zhimin Gao, Pichao Wang

School of Computer and Artificial Intelligence, Zhengzhou University, China, Amazon Prime Video, USA

6D位姿估计人体姿态综述

面向人体姿态在监控、交互、运动分析等应用中从单帧关节定位走向视频理解的需求,本文梳理深度学习时代姿态估计、姿态跟踪与基于姿态的动作识别三类任务。核心洞察是将三者视为连续链条而非孤立问题,按2D/3D、单人/多人、图像/视频及CNN/RNN/GCN/Transformer等方法建立统一分类,并比较常用数据集与SOTA结果。作为综述并不报告新模型增益,主要结果是总结现有方法优缺点、基准表现与统一视频框架的挑战方向。

FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects Figure 1
arXiv preprint2023-10-19

FSD: Fast Self-Supervised Single RGB-D to Categorical 3D Objects

PAGE 1, Mayank Lunayach1

Georgia Institute of Technology, Toyota Research Institute

6D位姿估计点云彩色深度

本文针对真实数据缺少3D标注时,单张RGB-D图像的类别级6D位姿、尺寸与形状估计难以高效落地的问题,提出FSD端到端前馈框架:先用合成数据2D/3D监督预训练,再在真实数据上结合2D监督与由深度反投影点云构成的Chamfer自监督,并用单一模型覆盖多类别、避免测试时优化。其在NOCS测试集上较自监督基线的6D位姿mAP绝对提升16.4%,推理约5Hz。

Mesh Represented Recycle Learning for 3D Hand Pose and Mesh Estimation Figure 1
arXiv preprint2023-10-18

Mesh Represented Recycle Learning for 3D Hand Pose and Mesh Estimation

Bosang Kim † † ^ start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT, Jonghyun Kim † † ^ start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT, Hyotae Lee, Lanying Jin, Jeongwon Ha, Dowoo Kwon, Jungpyo Kim, Wonhyeok Im, KyungMin Jin, Jungho Lee LG Electronics 19, Yangjae-daero 11gil, Seocho-Gu, Seoul, Republic of Korea, 06772 @lge.com

6D位姿估计手部姿态

本文针对3D手姿态/网格估计中标注数据受限、定量精度与网格视觉质量不一致的问题,提出“网格表示的循环学习”:先用真实图像预测手部关键点和网格,再由自估计网格合成图像并送回同一模型训练,并用自相关损失约束前后输出一致。在 FreiHAND 上实验表明,该策略可提升姿态与网格估计及视觉质量,且仅作用于训练阶段,推理无额外计算开销。

One-Shot Imitation Learning: A Pose Estimation Perspective Figure 1
arXiv preprint2023-10-18

One-Shot Imitation Learning: A Pose Estimation Perspective

PAGE 1, Pietro Vitiello∗

The Robot Learning Lab, Imperial College London

6D位姿估计

论文针对仅一次示范、无额外采集且无任务/物体先验的机器人模仿学习,指出问题可转化为基于未见物体6D位姿估计的轨迹迁移:用示范与部署时的RGB-D观测估计物体相对变换,并迁移末端轨迹。作者系统分析标定误差、位姿误差与空间泛化对十个真实任务成功率的影响,比较八类位姿估计器;结果显示该范式平均较DOME高22%,且适用于需第三人称视角的任务,但性能仍受分割、sim-to-real和精细位姿误差限制。

ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction from a Single Depth Map Figure 1
arXiv preprint2023-10-18

ShapeGraFormer: GraFormer-Based Network for Hand-Object Reconstruction from a Single Depth Map

AHMED TAWFIK ABOUKHADRA1, JAMEEL MALIK3, NADIA ROBERTINI1, AHMED ELHAYEK4, and DIDIER STRICKER1

Augmented Vision Group, German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany, Department of Computer Science, University of Kaiserslautern-Landau (RPTU), Kaiserslautern, Germany, Artificial Intelligence Department, College of Computer and Cyber Sciences, University of Prince Mugrin (UPM), Madinah, Saudi Arabia

6D位姿估计手部姿态彩色深度三维重建

面向机器人模仿与交互理解中手-物接触带来的遮挡、尺度和物理约束问题,ShapeGraFormer从单张深度图构建体素输入,联合预测姿态热图、体素形状并直接回归手和物体网格顶点;其核心是将GraFormer的图卷积与多头注意力用于模板网格重建,并加入位置嵌入和交互细化模块。HO-3D与DexYCB实验显示其手部重建优于已有方法,物体形状也更合理。

Holistic Parking Slot Detection with Polygon-Shaped Representations Figure 1
arXiv preprint2023-10-17

Holistic Parking Slot Detection with Polygon-Shaped Representations

Lihao Wang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Antonyo Musabini 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Christel Leonet 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Rachid Benmokhtar 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Amaury Breheret 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Chaima Yedes 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Thomas Boulay 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Xavier Perrotton 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT

{}^{3} start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT Mines ParisTech - Center for Robotics, Paris - France

6D位姿估计

该文针对超声波泊车位检测需驶过车位、难以连续多车位检测和分类的问题,提出基于环视相机的 HPS-Net:将 YOLOv4 改为在俯视域一次性回归车位四边形顶点,并用 polygon-corner GIoU 优化角点、方向和入口线。实验在 Valeo VPSD 上 F1=0.92、PS2.0 上 F1=0.99,室内和铺装场景仍具鲁棒性,并在 Drive AGX Xavier 上达到 17 FPS。

Diver Interest via Pointing in Three Dimensions: 3D Pointing Reconstruction for Diver-AUV Communication Figure 1
arXiv preprint2023-10-17

Diver Interest via Pointing in Three Dimensions: 3D Pointing Reconstruction for Diver-AUV Communication

Chelsey Edge 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Demetrious Kutzke 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Megdalia Bromhal 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Junaed Sattar 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计三维重建

面向水下任务中潜水员难以通过低带宽声学信道向AUV临场指定目标的问题,DIP-3D将潜水员指向手势从2D扩展到含距离的3D理解:在左右目图像中估计人体关键点并做稀疏三角化,结合传统目标检测,用指向射线在多个候选物中判定真实兴趣目标。论文通过人类研究和封闭水域实验验证了框架可用于AUV视野内多目标区分,但具体量化增益在给定文本中未充分说明。

Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior Figure 1
arXiv preprint2023-10-15

Tabletop Transparent Scene Reconstruction via Epipolar-Guided Optical Flow with Monocular Depth Completion Prior

Xiaotong Chen, Zheming Zhou, Zhuo Deng, Omid Ghasemalizadeh, Min Sun, Cheng-Hao Kuo, Arnie Sen

6D位姿估计彩色深度三维重建

针对透明桌面物体在 RGB 中跨视角外观不一致、在廉价 RGB-D 深度图中缺失/失真的问题,论文提出 D-EOF 两阶段重建:先用现成分割与单目深度补全给出单视角形状先验,再用边界启发采样和极线约束的光流建立透明表面对应,并通过 BA 融合多视角。实验显示 EOF 显著降低 2D 匹配误差,整体 3D 重建精度和精确率优于深度补全直接拼接、通用重建及透明物体重建基线。

Socially reactive navigation models for mobile robots in dynamic environments Figure 1
arXiv preprint2023-10-15

Socially reactive navigation models for mobile robots in dynamic environments

PAGE 1, Ricarte de Sousa Ribeiro, Plinio Moreno

6D位姿估计机器人操作

针对移动机器人在公共空间中既要接近人群又要避免冒犯个人/群体空间的问题,论文提出随场景、人群运动和机器人尺寸自适应的个人与群体空间模型,并改进接近位姿估计,将其接入 ROS costmap2d 与 move_base。数据集对比、静态/动态仿真和静态实机实验表明,机器人能更贴近个人或群体发起交互,同时保持安全与舒适性;但动态实机验证文中未充分说明。

MoEmo Vision Transformer: Integrating Cross-Attention and Movement Vectors in 3D Pose Estimation for HRI Emotion Detection Figure 1
arXiv preprint2023-10-15

MoEmo Vision Transformer: Integrating Cross-Attention and Movement Vectors in 3D Pose Estimation for HRI Emotion Detection

PAGE 1, David C. Jeong1, Member, IEEE, Tianma Shen1, Hongji Liu1, Raghav Kapoor1, Casey Nguyen1

6D位姿估计

面向人机交互中仅依赖表情或单帧图像难以稳健识别情绪的问题,本文提出 MoEmo:用3D人体姿态估计提取全身运动向量,并通过交叉注意力 ViT 融合环境上下文特征,同时构建含1512段视频的 Naturalistic Motion Database。实验报告其在六类情绪上的准确率和F1均优于 ResNet50、ViT、WSCNet、PDANet、ABAW 等基线,但具体增益幅度需依赖表格细节。

IMU Preintegration for Multi-Robot Systems in the Presence of Bias and Communication Constraints Figure 1
arXiv preprint2023-10-16

IMU Preintegration for Multi-Robot Systems in the Presence of Bias and Communication Constraints

PAGE 1

Mohammed Ayman Shalaby, Charles Champagne Cossette, Jerome Le Ny, James Richard Forbes

6D位姿估计机器人操作

面向仅依赖机器人间测距、且通信受限的多机器人长期相对位姿估计,本文将 IMU 陀螺仪偏置和相对加速度计偏置纳入原有 UWB/RMI 预积分框架,同时保持过程模型的微分 Sylvester 方程形式。其关键做法是各机器人本地校正陀螺仪并在 RMI 协方差中反映偏置不确定性,加速度计则估计相对偏置。仿真与实验显示,在无偏置初始化时估计性能得到改善。

Towards Design and Development of an ArUco Markers-Based Quantitative Surface Tactile Sensor Figure 1
arXiv preprint2023-10-12

Towards Design and Development of an ArUco Markers-Based Quantitative Surface Tactile Sensor

PAGE 1, Ozdemir Can Kara, Student Member, IEEE, Charles Everson, Farshid Alambeigi, Member

6D位姿估计

针对现有视觉触觉传感器多只能输出定性形变图、难以实时获得凝胶层定量变形且标记制造复杂的问题,论文提出QS-TS:在柔性凝胶表面集成1.5 mm ArUco标记,利用每个标记的实时相机位姿估计直接量化局部形变,并给出更易复现的贴附/制造流程。实验验证其凝胶层形变估计相对误差小于5%,显示可用于机器人精细操作中的定量触觉反馈。

Multimodal Active Measurement for Human Mesh Recovery in Close Proximity Figure 1
arXiv preprint2023-10-12

Multimodal Active Measurement for Human Mesh Recovery in Close Proximity

Takahiro Maeda, Keisuke Takeshita, Norimichi Ukita, Kazuhito Tanaka

Manuscript received: April 9th, 2024; Revised, Toyota Technological Institute, Nagoya, Aichi, Japan, R-Frontier Division, Frontier Research Center, Toyota Motor

6D位姿估计

面向近距离物理人机交互中相机视野被截断、遮挡导致人体姿态/网格恢复不准的问题,论文提出主动测量与多模态融合框架:按不确定性动态调整相机视角及触觉、2D LiDAR等传感器位置,并用稀疏但可靠的接触/测距点约束SMPL表面对齐。实验显示其在遮挡基准和真实机器人场景中均优于无主动测量或无融合方案,盖毯等遮挡下仍能稳定估计。

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention Figure 1
ICME 20222023-10-12

X-HRNet: Towards Lightweight Human Pose Estimation with Spatially Unidimensional Self-Attention

Yixuan Zhou, Xuanhan Wang, Xing Xu, Lei Zhao, Jingkuan Song

Center for Future Media & School of Computer Science and Engineering, University of Electronic Science and Technology of China, China

6D位姿估计人体姿态

该文面向高分辨率人体姿态估计计算量过高、难以移动端部署的问题,抓住关节点热图可由横纵两个一维热向量表示的任务特性,用空间单维自注意力 SUSA 替代深度可分离卷积中的 1×1 卷积,并构建 X-HRNet。实验在 COCO 上显示其以更低参数量和 FLOPs 超过 Lite-HRNet 等轻量模型,SUSA 对精度—复杂度权衡的贡献由消融验证。

PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction Figure 1
arXiv preprint2023-10-12

PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction

Jia-Wang Bian

Department of Engineering Science, University of Oxford

6D位姿估计三维重建

PoRF针对神经表面重建对COLMAP/ARKit位姿噪声高度敏感、逐帧独立优化易陷入局部最优的问题,提出用共享MLP表示整段序列的位姿残差,并加入仅依赖匹配点与位姿的极线几何损失以强化监督、避免依赖不准的NeRF深度。实验中DTU上将旋转误差降78%,Chamfer由3.48mm降至0.85mm;MobileBrick上ARKit位姿重建F1由69.18升至75.67。

SAGE-ICP: Semantic Information-Assisted ICP Figure 1
arXiv preprint2023-10-11

SAGE-ICP: Semantic Information-Assisted ICP

PAGE 1, Jiaming Cui, Jiming Chen, Liang Li

6D位姿估计

面向未知大规模场景中实时且鲁棒的激光里程计位姿估计,SAGE-ICP在KISS-ICP式简洁点到点ICP框架中系统引入点级语义:用于语义体素降采样、语义约束数据关联、自适应局部体素地图和基于先验的动态车辆剔除,以在语义分割存在误差时仍减少错误匹配。KITTI、KITTI-360及道路序列实验显示,其定位精度优于基线,同时运行速度快于传感器帧率。

DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation Figure 1
NeurIPS 20232023-10-11

DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation

Rong Wang, Wei Mao, Hongdong Li

The Australian National University

6D位姿估计手部姿态

针对单图手物交互位姿中“看似接触但抓不稳”的问题,DeepSimHO把重力下的稳定抓取作为约束:先用物理仿真评估初始估计,再训练MLP近似稳定性损失及平滑梯度以反传细化。实验显示其提升估计稳定性,并比测试时优化更高效;但判断受限于PDF文本抽取质量。

FABind: Fast and Accurate Protein-Ligand Binding Figure 1
arXiv preprint2023-10-12

FABind: Fast and Accurate Protein-Ligand Binding

Qizhi Pei ∗ ∗ ^ start_FLOATSUPERSCRIPT ∗ end_FLOATSUPERSCRIPT, Kaiyuan Gao, Lijun Wu † † ^{ } start_FLOATSUPERSCRIPT † end_FLOATSUPERSCRIPT, Jinhua Zhu, Yingce Xia, Shufang Xie, Tao Qin, Kun He, Tie-Yan Liu, Technology, Recommendation, Analysis Methods @ruc.edu.cn, @hust.edu.cn @microsoft.com, teslazhu@mail.ustc.edu.cn

Gaoling School of Artificial Intelligence, Renmin University of China, Microsoft Research AI4Science, Engineering Research Center of Next-Generation Intelligent Search, Beijing Key Laboratory of Big Data Management and Analysis Methods

6D位姿估计

针对分子对接中采样法慢、回归法精度不足且常依赖外部口袋检测的问题,FABind将配体感知的结合口袋预测与6D对接位姿估计统一到端到端等变几何网络中,并用预测口袋的渐进训练缓解训练/推理不一致。实验显示其在基准上取得更低配体RMSD,且推理速度显著快于DiffDock等采样式方法。

EARL: Eye-on-Hand Reinforcement Learner for Dynamic Grasping with Active Pose Estimation Figure 1
arXiv preprint2023-10-10

EARL: Eye-on-Hand Reinforcement Learner for Dynamic Grasping with Active Pose Estimation

PAGE 1, Baichuan Huang, Jingjin Yu, Siddarth Jain

6D位姿估计手部姿态

针对动态场景中目标运动不可预测、固定相机易遮挡且预规划抓取会失效的问题,EARL将腕部RGB-D相机的主动6D位姿跟踪与课程训练的强化学习控制结合,把目标位姿差和抓取位姿变化映射为关节速度,在保持目标处于视野内的同时完成6DoF动态抓取。论文在仿真和UR5e等真实机械臂、未知物体与多种运动轨迹上验证,真实实验成功率通常达80%–100%,但未显式建模碰撞且目标速度不能超过机器人。

Augmenting Vision-Based Human Pose Estimation with Rotation Matrix Figure 1
arXiv preprint2023-10-09

Augmenting Vision-Based Human Pose Estimation with Rotation Matrix

Data Science, Faculty of Mathematics, Statistics

Department of Computer and Data Science, Faculty of Mathematical Science, Shahid Beheshti University, Department of Computer Science, Faculty of Mathematics, Statistics, and Computer Science, University of Allameh Tabataba’i, Boston University, Department of Computer Science at Metropolitan College

6D位姿估计人体姿态

本文面向健身房/居家训练中缺少自动记录与动作监督的问题,先用 BlazePose 从单目视频提取人体关键点,再用旋转矩阵在姿态空间模拟不同相机视角,以缓解每类仅少量样本带来的视角歧义。实验比较多种分类器后,SVM-SGD 在五类动作识别上达到 96% 准确率,高于未增强的 64%;但动作类别较少,泛化到更复杂运动仍需更大数据验证。

Federated Self-Supervised Learning of Monocular Depth Estimators for Autonomous Vehicles Figure 1
arXiv preprint2023-10-07

Federated Self-Supervised Learning of Monocular Depth Estimators for Autonomous Vehicles

PAGE 1, Elton F. de S. Soares

IBM Research & UNIRIO

6D位姿估计彩色深度

面向自动驾驶中单目深度估计缺少标注且车端数据隐私、带宽受限的问题,论文提出 FedSCDepth,将联邦学习与 SC-DepthV3 式自监督训练结合,使车辆只交换模型更新而非原始视频。在 KITTI Eigen split 上,该方法在 IID/Non-IID 设置下接近现有自监督方法,测试损失低于 0.13,每车每轮约 1.5k 训练步、最多 0.415GB 权重传输,效率优于集中式训练。

1st Place Solution of Egocentric 3D Hand Pose Estimation Challenge 2023 Technical Report:A Concise Pipeline for Egocentric Hand Pose Reconstruction Figure 1
arXiv preprint2023-10-10

1st Place Solution of Egocentric 3D Hand Pose Estimation Challenge 2023 Technical Report:A Concise Pipeline for Egocentric Hand Pose Reconstruction

PAGE 1, Zhishan Zhou1, Zhi Lv1, Shihao Zhou, Minqiang Zou

Jiiov Technology

6D位姿估计手部姿态数据集/基准三维重建

面向第一视角单图3D手姿态在手物遮挡、自遮挡和鱼眼畸变下易退化的问题,本文给出一套竞赛型简洁流水线:以MAE预训练Hiera/ViT特征和MLP直接回归2D、相对3D关键点与根深度,并通过额外公开数据、透视校正、遮挡增强、多视角结果相似性融合、时序平滑、TTA和模型集成提升精度。最终在AssemblyHands挑战测试集达到12.21mm MPJPE并获第一名,但部分增益可能主要来自data/scaling与集成。

SwimXYZ: A large-scale dataset of synthetic swimming motions and videos Figure 1
arXiv preprint2023-10-06

SwimXYZ: A large-scale dataset of synthetic swimming motions and videos

Guénolé Fiche, Vincent Sevestre ∗ ∗ ^ start_FLOATSUPERSCRIPT ∗ end_FLOATSUPERSCRIPT, Camila Gonzalez-Barral ∗ ∗ ^ start_FLOATSUPERSCRIPT ∗ end_FLOATSUPERSCRIPT, Simon Leglaive, Renaud Séguier

6D位姿估计仿真到现实数据集/基准

游泳场景中水下/水面反射、设备布置困难且公开标注数据稀缺,使通用视觉姿态估计难以迁移。SwimXYZ的核心贡献是构建面向游泳的合成数据生成流程,提供含相机、人体、水体外观、光照和动作变化的单目视频,以及SMPL格式运动序列。数据集包含11520段视频、340万帧2D/3D关节真值和240段游泳动作,并展示了其在泳姿聚类与2D姿态估计中的可用性;具体性能增益幅度文中未充分说明。

BID-NeRF: RGB-D image pose estimation with inverted Neural Radiance Fields Figure 1
arXiv preprint2023-10-05

BID-NeRF: RGB-D image pose estimation with inverted Neural Radiance Fields

Ágoston István Csehi, Csaba Máté Józsa

6D位姿估计点云彩色深度三维重建

面向机器人、SLAM等场景中iNeRF位姿优化收敛范围窄、速度慢的问题,BID-NeRF将RGB重投影损失扩展为含深度约束的定位目标,并利用具有已知相对位姿的多帧窗口进行联合约束,同时去除NeRF分层采样、仅用粗模型以降低推理与存储开销。实验显示其收敛速度提升约2–4倍,Blender上成功收敛率约提升2.5倍,单步优化时间和存储需求约减半。

RGBManip: Monocular Image-based Robotic Manipulation through Active Object Pose Estimation Figure 1
arXiv preprint2023-10-05

RGBManip: Monocular Image-based Robotic Manipulation through Active Object Pose Estimation

Boshi An, Yiran Geng, Kai Chen, Xiaoqi Li, Qi Dou, Hao Dong

6D位姿估计物体位姿机器人操作

RGBManip针对深度/点云在稀疏、噪声、透明反光物体上不可靠,而单目RGB缺少3D信息的问题,提出在夹爪上安装眼在手单目相机,通过机器人运动主动采集多视角RGB,并用运动学引导的6D位姿估计与强化学习全局调度联合决定观察和操作,权衡位姿精度与执行效率;在仿真和真实任务中报告了优于既有方法的操作效果。

Cyber Physical System Information Collection: Robot Location and Navigation Method Based on QR Code Figure 1
arXiv preprint2023-10-05

Cyber Physical System Information Collection: Robot Location and Navigation Method Based on QR Code

PAGE 1, Hongwei Li1 。Tao Xiong2

6D位姿估计机器人操作

面向AGV在CPS中的低成本视觉导航,论文利用QR码同时提供已知地理坐标与可检测角点,先用P4P从四个特征点求相机/二维码相对6D位姿,再在李群流形上做梯度迭代优化并转换到世界坐标。仿真显示,在低信噪比下该优化明显优于P4P解析解,噪声降低时差距缩小,增加特征点也可提升定位精度;真实系统验证文中未充分说明。

Condition numbers in multiview geometry, instability in relative pose estimation, and RANSAC Figure 1
arXiv preprint2023-10-04

Condition numbers in multiview geometry, instability in relative pose estimation, and RANSAC

Hongyi Fan, Joe Kileel, Benjamin Kimia

of Engineering, Brown University, Providence

6D位姿估计相机位姿多视角

针对相对位姿估计中即使无外点、匹配数量足够时5点/7点RANSAC仍会失败的问题,本文从条件数角度解释其根源在最小问题的内在数值不稳定。作者用计算代数与黎曼几何建立通用分析框架,刻画导致无限条件数的场景与图像数据,并提出求解前评估病态性的测试。合成和真实实验表明,RANSAC除剔除外点外,还会偏向选择条件更好的对应点,从而起到稳定化作用。

USB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fields Figure 1
arXiv preprint2023-10-05

USB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fields

Moyang Li, Peng Wang, Lingzhe Zhao

Department of Computer Science, Westlake University, Department of, University of

6D位姿估计三维重建

该工作针对手机、GoPro 等滚动快门相机在运动拍摄中产生的果冻畸变及其对建图、定位精度的影响,提出将滚动快门成像模型直接嵌入 NeRF,并以 NeRF 作为三维表示进行密集 bundle adjustment,而非先校正再重建。实验显示其能渲染更高保真的全局快门校正图像,并较已有 RS BA 或两阶段方法获得更稳定、准确的位姿估计;但动态场景处理文中未充分说明。

Beyond the Benchmark: Detecting Diverse Anomalies in Videos Figure 1
arXiv preprint2023-10-03

Beyond the Benchmark: Detecting Diverse Anomalies in Videos

Yoav Arad, Israel Jerusalem, Israel @mail.huji.ac.il

Department of Computer Science, The Hebrew University of Jerusalem, Israel

6D位姿估计数据集/基准

本文指出现有视频异常检测基准多聚焦单帧新物体或简单运动,难以检验真实场景中的动作级、多帧异常。作者基于 HMDB51 构建 HMDB-AD 与 HMDB-Violence,并在 AI-VAD 上加入长时序视频编码特征与逻辑回归融合形成 MFAD。实验显示其在传统 Ped2、Avenue、ShanghaiTech 上保持竞争力,并在新动作异常数据集上明显优于近期方法,说明现有模型对复杂异常仍有短板。

MFOS: Model-Free & One-Shot Object Pose Estimation Figure 1
arXiv preprint2023-10-03

MFOS: Model-Free & One-Shot Object Pose Estimation

JongMin Lee 1, Yohann Cabon 3, Romain Brégier 3, Sungjoo Yoo 2, Jerome Revaud 3

6D位姿估计物体位姿

MFOS针对传统6D位姿估计依赖已见实例/类别或精确3D模型、难以扩展到新物体的问题,提出纯ViT的一次前向one-shot框架:用少量带位姿参考图和粗略尺寸,通过CroCo 3D预训练与长方体代理形状预测密集2D-3D对应并解姿态。实验显示其在LINEMOD上超过既有one-shot方法,在OnePose和少参考图设置下也保持较好性能。

LEAP: Liberate Sparse-view 3D Modeling from Camera Poses Figure 1
arXiv preprint2023-10-02

LEAP: Liberate Sparse-view 3D Modeling from Camera Poses

PAGE 1, Hanwen Jiang

Department of Computer Science, The University of Texas at Austin, Amazon

6D位姿估计相机位姿

稀疏视角下相机位姿往往难以可靠估计,而现有可泛化 NeRF 对投影误差很敏感。LEAP 的核心是放弃显式位姿与投影,用共享神经体积学习几何/纹理先验,并通过特征相似度注意力聚合多视图信息,在局部 canonical 坐标中解码辐射场。实验显示其在2–5张无位姿图像上优于使用SOTA估计位姿的基线,接近使用真值位姿的方法,且推理约1秒、比 PixelNeRF 快约400倍。

H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation Figure 1
arXiv preprint2023-10-02

H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation

Yanjie Ze, Yuyao Liu, Ruizhe Shi, Jiaxin Qin, Zhecheng Yuan, Jiashun Wang, Huazhe Xu

Shanghai Qi Zhi Institute, Shanghai Jiao Tong University, Tsinghua University, IIIS, Renmin University of China, Carnegie Mellon University, Shanghai AI Lab

6D位姿估计手部姿态机器人操作

针对多指机器人仅靠视觉强化学习难以高效获得灵巧操作能力的问题,H-InDex的核心洞察是利用人与机器人手形态相近的先验:直接借用3D人手姿态估计模型的视觉编码器,再用自监督关键点和EMA BatchNorm做极少参数的域适配,以保留人手表征。其在Adroit和DexMV的12个任务上显著超过RRL、R3M、VC-1、MVP等基线,但对新物体泛化和部分EMA增益来源文中未充分说明。

Self-supervised Learning of Contextualized Local Visual Embeddings Figure 1
arXiv preprint2023-10-04

Self-supervised Learning of Contextualized Local Visual Embeddings

PAGE 1, Thalles Silva

Institute of Computing, University of Campinas, Department of Informatics, University of Oslo

6D位姿估计

本文针对CNN自监督预训练常把特征图池化为全局向量、易丢失检测和姿态等密集预测所需局部细节的问题,提出CLoVE:在局部特征层面用归一化多头自注意力按相似性聚合上下文,并以单一目标跨视图预测局部表示。实验显示其在目标检测、实例分割、关键点检测和 dense pose 估计上优于或匹配CNN系自监督与监督基线。

Diff-DOPE: Differentiable Deep Object Pose Estimation Figure 1
arXiv preprint2023-09-30

Diff-DOPE: Differentiable Deep Object Pose Estimation

PAGE 1, Jonathan Tremblay, Bowen Wen, Valts Blukis, Balakumar Sundaralingam, Stephen Tyree, Stan Birchfield

NVIDIA

6D位姿估计物体位姿

针对6D位姿估计中“粗估计后精修”依赖大规模合成数据训练、难解释且重训成本高的问题,Diff-DOPE将精修改为基于可微渲染的直接优化:给定图像、纹理3D模型和初始位姿,通过RGB/深度/边缘/分割等损失做并行梯度下降,并用随机学习率缓解局部极小。实验显示其在HOPE上可达亚厘米精度,并在T-LESS、YCB-Video上优于既有方法,但对初始位姿误差较大时鲁棒性不如MegaPose。

Diver Identification Using Anthropometric Data Ratios for Underwater Multi-Human-Robot Collaboration Figure 1
arXiv preprint2023-09-29

Diver Identification Using Anthropometric Data Ratios for Underwater Multi-Human-Robot Collaboration

Jungseok Hong * ^ start_FLOATSUPERSCRIPT * end_FLOATSUPERSCRIPT, Engineering, MN USA @umn.edu

Department of Computer Science & Engineering and the Minnesota Robotics Institute, University of Minnesota

6D位姿估计机器人操作

面向多潜水员-AUV协作中装备外观相似、标记/手势会增加负担的问题,论文用姿态估计得到的人体测量比例(ADR)作为距离与光照相对不变特征,并通过姿态过滤和嵌入网络拉开类间距离,支持离线预训练或在线部署训练。在封闭水域真实AUV实验与UDI数据集评估中,方法取得较高识别准确率,但场景规模仅8名参与者,泛化仍需更多验证。

Denoising and Selecting Pseudo-Heatmaps for Semi-Supervised Human Pose Estimation Figure 1
arXiv preprint2023-09-29

Denoising and Selecting Pseudo-Heatmaps for Semi-Supervised Human Pose Estimation

Zhuoran Yu, Manchen Wang : 1, Yanbei Chen, Paolo Favaro, @amazon.com

AWS AI Labs

6D位姿估计人体姿态

针对人体姿态标注成本高、半监督训练中伪热图噪声易造成确认偏差的问题,论文在双学生框架中引入多视角增强集成与阈值-细化去噪,并用跨学生逐像素不确定性选择更可靠的伪热图监督。COCO-Partial/Additional 上取得优于既有半监督方法的结果,极低标注量 0.5K 时较 DualPose 提升 7.22 AP,显示其收益主要来自更稳健的伪标签生成与筛选。

Revisiting Cephalometric Landmark Detection from the view of Human Pose Estimation with Lightweight Super-Resolution Head Figure 1
arXiv preprint2023-09-29

Revisiting Cephalometric Landmark Detection from the view of Human Pose Estimation with Lightweight Super-Resolution Head

Qian Wu, Si Yong Yeo, Yufei Chen, Jun Liu

6D位姿估计人体姿态

针对头影测量关键点检测缺少统一流程且易受量化偏差影响的问题,论文借鉴人体姿态估计范式,在 MMPose 上构建 backbone-neck-head 基线,并引入轻量超分辨率头,在高分辨率特征上预测热图以减小坐标离散化误差。方法在 MICCAI CLDetection2023 中三项指标第 1、另一项第 3,但具体增益中 scaling 与无偏数据处理的贡献需结合消融判断。

AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFi Figure 1
arXiv preprint2023-09-29

AdaPose: Towards Cross-Site Device-Free Human Pose Estimation with Commodity WiFi

Yunjiao Zhou, Jianfei Yang, He Huang, Lihua Xie

6D位姿估计人体姿态

该文针对 WiFi CSI 人体姿态估计跨场景部署时易受环境变化导致域偏移、且新环境标注昂贵的问题,提出 AdaPose 弱监督域自适应框架;核心是以 Mapping Consistency Loss 在输入 CSI 与输出骨架的映射关系层面对齐源/目标域,避免回归任务中特征尺度误对齐。作者在自采两场景数据上验证,无监督和少量目标标注设置均提升迁移性能,并优于常见域适应方法。

End-to-End (Instance)-Image Goal Navigation through Correspondence as an Emergent Phenomenon Figure 1
arXiv preprint2023-09-28

End-to-End (Instance)-Image Goal Navigation through Correspondence as an Emergent Phenomenon

Guillaume Bono, Leonid Antsfeld, Boris Chidlovskii, Philippe Weinzaepfel, Christian Wolf Naver Labs Europe @naverlabs.com

Naver Labs Europe

6D位姿估计

这篇工作针对 ImageNav/Instance-ImageNav 中仅凭目标示例图导航时难以从弱奖励学到跨视角匹配的问题,认为核心瓶颈是极宽基线视觉对应、相对位姿与可见性判断。方法用跨视角补全和相对位姿/可见性预训练,结合带交叉注意力的双编码器,使对应关系在端到端训练中涌现而非显式匹配。实验在两个基准上较既有方法显著提升并达到 SOTA。

Off-the-shelf bin picking workcell with visual pose estimation: A case study on the world robot summit 2018 kitting task Figure 1
arXiv preprint2023-09-28

Off-the-shelf bin picking workcell with visual pose estimation: A case study on the world robot summit 2018 kitting task

PAGE 1, Frederik Hagelskjær1, Kasper Høj Lorenzen1, Dirk Kraft1

6D位姿估计机器人操作

针对 WRS 2018 装配挑战中料箱拣选得分极低、工业零件6D位姿估计和抓取难以稳定结合的问题,本文用现成工业硬件构建工作站,结合 Zivid2 点云、改造的无颜色位姿估计算法、碰撞预测与力/夹爪反馈抓取策略。系统在大件 kitting 任务上可完成全部目标,平均每件约28秒,优于当年参赛队表现,说明近年传感与位姿估计进步已能显著提升该场景可用性。

Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing Figure 1
arXiv preprint2023-09-28

Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing

PAGE 1, Lu Dai1, Liqian Ma2, Shenhan Qian3, Hao Liu1, Ziwei Liu4, Hui Xiong1

The Hong Kong University of Science and Technology (Guangzhou), Technical University of Munich, 4S-Lab, Nanyang Technological University

6D位姿估计

本文针对仅有服装图像、人体不可见时难以恢复可编辑三维人体的问题,提出 Cloth2Body 任务与端到端框架:用运动学感知姿态估计、基于量体信息的形状估计、自适应深度投影和进化式姿态生成,在保持服装像素级对齐的同时输出多样 SMPL 人体。实验在合成与真实数据上优于改造的替代方法,但非正面视角和罕见服装仍会影响对齐。

CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Prompting Figure 1
arXiv preprint2023-09-28

CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Prompting

PAGE 1, Shaoxiang Guo

Ocean University of China

6D位姿估计手部姿态

针对单目3D手部姿态/网格估计依赖大编码器、速度慢且难以利用语言先验的问题,CLIP-Hand3D将21个关节在x/y/z方向的空间排序转写为上下文提示,并用CLIP式对比学习对齐文本与姿态感知特征;同时设计粗到细Transformer网格回归器从特征金字塔查询关节线索。实验显示其在多个手部基准上相对同规模骨干达到更高精度,并在FreiHAND上实现更快、接近实时的推理速度。

A Modular Bio-inspired Robotic Hand with High Sensitivity Figure 1
arXiv preprint2023-09-28

A Modular Bio-inspired Robotic Hand with High Sensitivity

Chao Liu, Andrea Moncada, Hanna Matusik, Deniz Irem Erus, Daniela Rus

Intelligence Laboratory, Massachusetts Institute of Technology

6D位姿估计手部姿态机器人操作

面向日常抓取中刚性灵巧手昂贵复杂、软体手难建模且感知不足的问题,本文提出软硅胶包覆刚性“骨骼”的模块化仿生手指/手,将位置传感嵌入连杆以获得实时姿态估计和高灵敏触碰响应。实验展示五指可快速重构,传感姿态与MANO可视化匹配,并完成多种人类抓握类型。

Handbook on Leveraging Lines for Two-View Relative Pose Estimation Figure 1
arXiv preprint2023-09-27

Handbook on Leveraging Lines for Two-View Relative Pose Estimation

Petr Hruby 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Shaohui Liu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Marc Pollefeys 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Daniel Barath 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, ETH Zurich, AI Zurich lab

{}^{1} start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT Department of Computer Science, ETH Zurich

6D位姿估计手部姿态相机位姿

针对纯点特征在低纹理、重复结构场景中相对位姿估计不稳的问题,本文系统梳理点、线、消失点及线交点等组合的最小求解配置,并构建混合RANSAC/局部优化框架,联合估计消失点对应与多模态BA。在室内外数据集上,相比点特征方法AUC@10提升约1–7个百分点,速度基本相当。

Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature Figure 1
arXiv preprint2023-09-27

Q-REG: End-to-End Trainable Point Cloud Registration with Surface Curvature

Shengze Jin, Daniel Barath, Marc Pollefeys, Iro Armeni

6D位姿估计点云

针对学习式点云配准通常只优化匹配、再依赖不可微 RANSAC 估计位姿的问题,Q-REG 利用对应点邻域拟合二次曲面/曲率信息,使单个对应即可生成刚体位姿假设,并将鲁棒估计改写为可微的穷举搜索,兼容不同匹配器。实验显示其在仅推理替换 RANSAC 和端到端训练两种设置下均带来稳定提升,并在 3DMatch、KITTI、ModelNet 上达到新的 SOTA。

Analysis on Multi-robot Relative 6-DOF Pose Estimation Error Based on UWB Range Figure 1
arXiv preprint2023-09-27

Analysis on Multi-robot Relative 6-DOF Pose Estimation Error Based on UWB Range

PAGE 1

6D位姿估计机器人操作

面向无 GNSS、无固定锚的多机器人协同,论文分析仅依赖机器人间 UWB 测距时相对 6-DOF 位姿估计的退化与误差来源。其核心是从 TOA 测量模型、FIM/CRLB 和雅可比奇异值推导误差下界,指出三维估计至少需要非共面 4 标签,且在尺寸约束下正四面体/正三角形布设更优。仿真显示误差随机器人间距近似线性增大,并与标签单纯形高度的倒数近似线性相关,可用于指导标签部署。

Learning Vision-Based Bipedal Locomotion for Challenging Terrain Figure 1
arXiv preprint2023-09-26

Learning Vision-Based Bipedal Locomotion for Challenging Terrain

Helei Duan, Bikram Pandit, Mohitvishnu S. Gadde, Bart van Marum, Jeremy Dao, Chanho Kim, Alan Fern

6D位姿估计

针对纯本体感知双足控制器难以提前适应台阶、障碍等复杂地形的问题,论文提出在仿真中先训练接收机器人局部高度图的强化学习步态策略,再用单目深度历史与机器人状态预测局部高度图,避免全局里程计和显式位姿估计。通过域随机化,该系统在Cassie实机上无需真实数据微调即可完成具有挑战地形的视觉双足行走迁移。

Spring-IMU Fusion Based Proprioception for Feedback Control of Soft Manipulators Figure 1
arXiv preprint2023-09-25

Spring-IMU Fusion Based Proprioception for Feedback Control of Soft Manipulators

PAGE 1, Yinan Meng, Guoxin Fang, Member, IEEE, Jiong Yang, Yuhu Guo

6D位姿估计

针对软体机械臂在大伸长、大弯曲和外载变化下难以稳定感知与闭环控制的问题,本文将导电弹簧的长度信息与 IMU 姿态信息融合,用仿真到真实迁移学习建立传感器到末端 6D 位姿的映射,并在传感器空间中用梯度下降生成参考信号。实验在气动软体臂上实现约 0.7% 工作空间平均位姿误差,且在最高 500g 外载下完成路径跟踪和抓放任务。

Industrial Application of 6D Pose Estimation for Robotic Manipulation in Automotive Internal Logistics Figure 1
arXiv preprint2023-09-25

Industrial Application of 6D Pose Estimation for Robotic Manipulation in Automotive Internal Logistics

Philipp Quentin 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Dino Knoll 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Daniel Goehring 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT

6D位姿估计机器人操作

面向汽车厂内物流中仍大量依赖人工的零件拣放,论文搭建从真实/合成数据生成到6D位姿估计的代表性工业流水线,比较LabelFusion/NVISII数据与GDR-Net、DenseFusion在典型零件上的表现。核心洞察是当前瓶颈不主要在位姿精度,而在估计器缺乏可靠不确定性,导致难以保证工业所需鲁棒性;合成数据具备扩展潜力,但RGB与RGB-D受域差和深度噪声影响方式不同,整体仍未达到稳定部署要求。

BoIR: Box-Supervised Instance Representation for Multi-Person Pose Estimation Figure 1
arXiv preprint2023-09-25

BoIR: Box-Supervised Instance Representation for Multi-Person Pose Estimation

PAGE 1, JEONG, BAEK, CHANG

Ulsan National Institute of Science and, Technology, University of Birmingham, Pohang University of Science and

6D位姿估计

针对拥挤场景中单阶段多人姿态估计难以区分个体、关键点易错关联的问题,BoIR用人体框监督学习实例表示:通过Bbox Mask Loss在框内拉近同实例嵌入、在背景和不同实例间推远,并结合框回归与自底向上关键点辅助任务,训练时提供更密集的空间与多任务监督,推理不增加开销。实验在COCO test-dev、CrowdPose和OCHuman上分别提升0.5、4.9、3.5 AP,优势主要体现在遮挡拥挤场景。

ORTexME: Occlusion-Robust Human Shape and Pose via Temporal Average Texture and Mesh Encoding Figure 1
arXiv preprint2023-09-21

ORTexME: Occlusion-Robust Human Shape and Pose via Temporal Average Texture and Mesh Encoding

PAGE 1, Yu Cheng1, Bo Wang2, Robby T. Tan1

National University of Singapore

6D位姿估计

该文针对单目视频中遮挡、多人互遮和分割误差导致渲染式3D人体形状/姿态细化失效的问题,提出ORTexME:在NeRF框架中引入时序特征约束不可见身体部位,用视频学习的平均纹理生成更可靠采样掩码,并用人体网格编码正则化不透明度场以减少模糊噪声。在3DPW多人数据集上,方法使P-MPJPE降低1.8,而对比渲染式方法反而最高增大5.6。

ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers Figure 1
arXiv preprint2023-09-21

ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers

Philipp Ausserlechner 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, David Haberger 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Stefan Thalhammer 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Jean-Baptiste Weibel 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Markus Vincze 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

Automation and Control Institute

6D位姿估计物体位姿

针对现有6D位姿方法依赖特定物体训练、难以扩展到未见物体的问题,ZS6D利用自监督预训练ViT提取通用视觉描述子,在渲染模板与查询图像间匹配并建立局部对应,再通过几何对应与RANSAC-PnP估计6D位姿,无需任务微调且模板数量较少。在LMO、YCBV、TLESS上,相比两类新物体位姿方法取得更高Average Recall,其中对一个基线三数据集均提升,对另一个基线两数据集提升。

Ego3DPose: Capturing 3D Cues from Binocular Egocentric Views Figure 1
arXiv preprint2023-09-21

Ego3DPose: Capturing 3D Cues from Binocular Egocentric Views

Taeho Kang, Kyungjin Lee, Jinrui Zhang, Youngki Lee

Seoul National University, Central South University

6D位姿估计

本文针对双目第一视角人体3D姿态估计中视野受限、自遮挡和鱼眼畸变导致精度偏低的问题,指出既有方法未充分利用双目立体对应与强透视变化这两类3D线索。Ego3DPose通过按肢体独立估计的双路径Stereo Matcher减少对全身姿态分布的偏置,并用三角关系构造透视感知热图显式编码肢体3D方向。在UnrealEgo上相较SOTA将MPJPE降低23.1%,定性结果也显示遮挡和非常规动作下更稳健。

A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose Figure 1
arXiv preprint2023-09-21

A Real-Time Multi-Task Learning System for Joint Detection of Face, Facial Landmark and Head Pose

Qingtian Wu, Xiaoming Wang, Liming Zhang, Fei Richard Yu

6D位姿估计

面向驾驶辅助、IoT 等需要低延迟的人脸分析场景,论文针对大角度头部姿态下检测、68点人脸关键点与头姿估计串行管线耗时且误差传递的问题,提出基于轻量 YOLOv8 的 YOLOMT,增加关键点回归头并用重参数化 stem/bottleneck 提升特征表达,再由3D投影对应的2D关键点结合 PnP 间接求头姿。在300W-LP与AFLW2000-3D上,模型报告关键点 NME 3.02、tiny 版本约102 FPS,显示实时性较强,但具体增益中数据增强/迁移学习与结构改动的贡献需看消融。

Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation Figure 1
arXiv preprint2023-09-20

Understanding Pose and Appearance Disentanglement in 3D Human Pose Estimation

Mathieu Salzmann 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT

6D位姿估计人体姿态

针对自监督3D人体姿态估计常假设“姿态码不含外观信息”、从而可少量标注训练回归器的问题,本文不是提出新估计器,而是构建诊断测试:通过图像合成、潜变量通道分析和仅改变自然外观的对抗策略评估解耦程度。对NSD、CSSL、DRNet的实验显示,姿态与外观远未完全分离,姿态码中仍保留大量主体外观信息,外观变化也会影响回归的3D姿态。

Online Supervised Training of Spaceborne Vision during Proximity Operations using Adaptive Kalman Filtering Figure 1
arXiv preprint2023-09-20

Online Supervised Training of Spaceborne Vision during Proximity Operations using Adaptive Kalman Filtering

Tae Ha Park Simone D’Amico

6D位姿估计

面向非合作航天器近距离操作中“只能用合成图训练、真实飞行图像缺标注”导致的域差问题,本文把轻量位姿网络嵌入自适应无迹卡尔曼滤波器,用滤波状态为在线到来的图像生成伪标签并做监督更新。硬件在环轨迹实验显示,若RPO过程中视角足够多样,OST可降低滤波稳态误差并提升目标域6D位姿估计性能;受限视角场景下收益较弱。

OCC-VO: Dense Mapping via 3D Occupancy-Based Visual Odometry for Autonomous Driving Figure 1
arXiv preprint2023-09-20

OCC-VO: Dense Mapping via 3D Occupancy-Based Visual Odometry for Autonomous Driving

Heng Li, Yifan Duan, Xinran Zhang, Haiyi Liu, Jianmin Ji, Yanyong Zhang

6D位姿估计相机位姿

针对传统视觉里程计缺少深度、BA优化易退化且地图稀疏的问题,OCC-VO将环视图像经TPV-Former转为3D语义占据,把位姿估计重写为带语义约束的点云配准,并加入语义标签、动态物体与Voxel PFilter过滤以稳定位姿和建图。在Occ3D-nuScenes上,相比ORB-SLAM3成功率提升20.6%,轨迹误差降低29.6%,但代价是依赖环视相机且计算延迟更高。

Language-Conditioned Affordance-Pose Detection in 3D Point Clouds Figure 1
arXiv preprint2023-09-19

Language-Conditioned Affordance-Pose Detection in 3D Point Clouds

Toan Nguyen 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Baoru Huang 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Vy Truong 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Bac Le 6 6 ^ start_FLOATSUPERSCRIPT 6 end_FLOATSUPERSCRIPT, Anh Nguyen 7 7 ^ start_FLOATSUPERSCRIPT 7 end_FLOATSUPERSCRIPT

{}^{1} start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT FPT Software AI Center, Vietnam

6D位姿估计点云

针对以往可供性检测与6D位姿估计多依赖预定义任务、难以按自然语言适配真实操作的问题,本文提出3DAPNet:在3D点云中结合开放词汇可供性分割与语言引导扩散模型,按文本生成对应6-DoF操作位姿,并构建含语言标签和多位姿标注的3DAP数据集。实验显示其在开放词汇可供性与位姿生成上明显优于基线,并在真实机器人任务中验证了可用性,但仍受单物体数据集限制。

MAGIC-TBR: Multiview Attention Fusion for Transformer-based Bodily Behavior Recognition in Group Settings Figure 1
arXiv preprint2023-09-19

MAGIC-TBR: Multiview Attention Fusion for Transformer-based Bodily Behavior Recognition in Group Settings

Surbhi Madan, Rishabh Jain, Gulshan Sharma, Ramanathan Subramanian, Abhinav Dhall

Indian Institute of Technology Ropar, University of Canberra, & Monash University

6D位姿估计多视角

面向群体讨论中仅靠头/体姿态难以捕捉的细粒度身体行为,MAGIC-TBR将多视角视频的RGB特征与逐帧DCT频域特征分别经Video Swin Transformer提取,并用注意力融合不同视角以建模互补信息。在BBSI多标签行为识别实验中,该方法相较既有基线提升了识别性能,但具体增益在多视角、DCT与模型容量之间的归因仍需更多消融支撑。

SHOWMe: Benchmarking Object-agnostic Hand-Object 3D Reconstruction Figure 1
arXiv preprint2023-09-19

SHOWMe: Benchmarking Object-agnostic Hand-Object 3D Reconstruction

PAGE 1, Anilkumar Swamy1

NAVER LABS Europe Inria centre at the University Grenoble Alpes

6D位姿估计手部姿态数据集/基准三维重建

针对现有手-物交互数据集物体多样性有限、手形真值多依赖 MANO 且难评估未知物体重建的问题,SHOWMe 提供 96 段单相机刚性手持物体视频及亚毫米扫描对齐的高质量纹理网格真值,并将任务拆为刚体配准与多视角重建两阶段基准。实验显示,SfM 或手姿态估计结合现成 MVR 可在约四分之三序列上得到可用重建,但对无纹理物体、手部遮挡和初始相机位姿仍很敏感。

GloPro: Globally-Consistent Uncertainty-Aware 3D Human Pose Estimation & Tracking in the Wild Figure 1
arXiv preprint2023-09-20

GloPro: Globally-Consistent Uncertainty-Aware 3D Human Pose Estimation & Tracking in the Wild

PAGE 1, Simon Schaefer1, Dorian F. Henning2, Stefan Leutenegger1

6D位姿估计人体姿态

面向机器人在人机共处场景中的安全规划,GloPro关注动态相机、遮挡和在线因果输入下的3D人体网格位姿跟踪不确定性。其核心是把不确定性感知SMPL网格回归器与人体中心坐标系中的学习运动模型融合,同时估计形状、姿态和根位姿分布,以解耦相机与人体运动。3DPW实验显示其未对齐全局误差显著优于多种基线,G-MPJPE降至114.48mm,并给出更一致的不确定性,且可实时运行。

RGB-based Category-level Object Pose Estimation via Decoupled Metric Scale Recovery Figure 1
arXiv preprint2023-09-19

RGB-based Category-level Object Pose Estimation via Decoupled Metric Scale Recovery

Jiaxin Wei 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Xibin Song 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Weizhe Liu 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Laurent Kneip 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Hongdong Li 2, 3 2 3 ^ start_FLOATSUPERSCRIPT 2, 3 end_FLOATSUPERSCRIPT, Pan Ji 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT

6D位姿估计物体位姿类别级位姿

本文针对类别级6D位姿估计对深度传感器依赖强、单目RGB存在尺度歧义的问题,提出将刚体位姿与物体尺寸/尺度恢复解耦:用预训练单目模型提供相对深度和法向等局部几何线索来学习2D-3D对应,同时以类别统计直接回归度量尺度,再用RANSAC-PnP求解位姿。实验在合成与真实数据上优于已有RGB方法,提升主要体现在旋转精度。

Hierarchical Attention and Graph Neural Networks: Toward Drift-Free Pose Estimation Figure 1
arXiv preprint2023-09-18

Hierarchical Attention and Graph Neural Networks: Toward Drift-Free Pose Estimation

Kathia Melbouci, Fawzi Nashashibi

6D位姿估计

针对 ICP 逐帧配准易累积漂移、位姿图优化又依赖回环且计算开销大的问题,论文尝试用单一学习模型替代传统流程:在多帧点云束上结合动态图神经网络与双层层次注意力,并用最大聚合压缩关键几何信息、Gram-Schmidt 解码位姿。KITTI Odometry 实验显示其相对多路配准/位姿图优化在若干序列上降低误差,尤其旋转精度更好,但泛化到更大窗口和 SLAM 回环替代仍待验证。

Application-driven Validation of Posteriors in Inverse Problems Figure 1
arXiv preprint2023-09-18

Application-driven Validation of Posteriors in Inverse Problems

PAGE 1

aGerman Cancer Research Center (DKFZ) Heidelberg, Heidelberg University, Im Neuenheimer Feld 205, Heidelberg, 69120, Germany, cGerman Cancer Research Center (DKFZ) Heidelberg, University Medical Center Heidelberg, Im Neuenheimer Feld 460, Heidelberg, 69120, Germany, eVisual Learning Lab, Interdisciplinary Center for Scientific Computing (IWR), Heidelberg, Germany, fGerman Cancer Research Center (DKFZ) Heidelberg, Interactive Machine Learning Group, Im Neuenheimer Feld 280, Heidelberg, 69120, Germany, gDepartment of Informatics, Goethe University Frankfurt, Frankfurt, Germany, hDepartment of Medicine, Goethe University Frankfurt, Frankfurt, Germany, jGerman Cancer Research Center (DKFZ), Im Neuenheimer Feld 280, Heidelberg, 69120, Germany, kFrankfurt Cancer Institute, Frankfurt, Germany

6D位姿估计

针对6D位姿估计等逆问题中“一图多解”导致MAP或回归式评估掩盖小概率但关键解的问题,论文提出应用驱动的后验验证框架,将后验模态视作目标检测中的实例,设计模态定位、匹配与AP/F1等指标。作者在复数开根玩具任务、术中2D/3D配准位姿估计和光声参数量化中展示,该框架能揭示传统指标看不出的多模态方法优势,使评估更贴近实际决策需求。

RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy Figure 1
arXiv preprint2023-09-18

RIDE: Self-Supervised Learning of Rotation-Equivariant Keypoint Detection and Invariant Description for Endoscopy

Mert Asim Karaoglu, Viktoria Markova, Nassir Navab, Benjamin Busam, Alexander Ladikos

6D位姿估计

针对内窥镜场景没有固定“正向”、相机常发生大幅旋转且光照/纹理复杂导致学习式特征匹配失效的问题,RIDE将可转向群等变CNN用于联合关键点检测与描述,通过等变检测和群对齐生成旋转不变描述,并以单应增强自监督训练、无需人工标注。实验在改造的SCARED上取得内窥镜匹配与相对位姿估计SOTA,在SuPeR组织跟踪上表现有竞争力,且大旋转鲁棒性优于常见学习式方法。

Sparse and Privacy-enhanced Representation for Human Pose Estimation Figure 1
arXiv preprint2023-09-18

Sparse and Privacy-enhanced Representation for Human Pose Estimation

PAGE 1, Ting-Ying Lin1

Vision Science Lab, National Tsing Hua University

6D位姿估计人体姿态

面向智能家居等边缘端人体姿态估计中的隐私泄露与计算开销问题,论文用专有运动向量传感器直接采集稀疏边缘图与双向运动向量,认为边缘保留身体轮廓、运动向量补足快速动作信息,并以稀疏卷积融合处理。作者构建 SPHP 数据集;融合方法优于单模态,最高相对提升 11%,稀疏卷积使 FLOPs 降低 96%、推理加速约 13 倍,且在人脸识别与用户研究中显示一定隐私增强效果。

RenderIH: A Large-scale Synthetic Dataset for 3D Interacting Hand Pose Estimation Figure 1
ICCV 20232023-09-17

RenderIH: A Large-scale Synthetic Dataset for 3D Interacting Hand Pose Estimation

Lijun Li, Linrui Tian, Xindi Zhang, Qi Wang, Bang Zhang, Mengyuan Liu, Chen Chen

Alibaba Group, Shanghai Artificial Intelligence Laboratory, Key Laboratory of Machine Perception, Shenzhen Graduate School, Peking University, Center for Research in Computer Vision, University of

6D位姿估计手部姿态仿真到现实数据集/基准

针对交互双手真实数据标注困难、现有合成数据姿态不自然且纹理/背景单一的问题,RenderIH 用吸引与防穿透约束、解剖约束和判别器生成自然双手姿态,并结合 HDR 背景、动态光照与多肤色纹理渲染 100 万张图像。实验显示其预训练可将误差从 6.76mm 降至 5.79mm,且配合 TransHand 达到当时 SOTA;增益可能主要来自更大规模和更真实的数据分布。

Optimal Initialization Strategies for Range-Only Trajectory Estimation Figure 1
arXiv preprint2023-09-16

Optimal Initialization Strategies for Range-Only Trajectory Estimation

Abhishek Goudar 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Angela P. Schoellig 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT

6D位姿估计

针对仅测距位姿/轨迹估计中非凸量测模型易使高斯牛顿等局部求解器陷入坏初始化的问题,论文将静态多标签位姿和短时常速度动态轨迹初始化表述为可计算的半定规划凸松弛,用于先求可靠初值再交给局部优化。仿真与地面/空中机器人实验证明,该初始化误差低于常规局部求解器,并在中等测距噪声下可恢复全局最优;局限是紧松弛依赖冗余约束,当前主要适合低维短时状态。

DynaMoN: Motion-Aware Fast And Robust Camera Localization for Dynamic NeRF Figure 1
arXiv preprint2023-09-16

DynaMoN: Motion-Aware Fast And Robust Camera Localization for Dynamic NeRF

Nicolas Schischka, Hannah Schieber, Mert Asim Karaoglu, Melih Gorgulu, Florian Grötzner, Alexander Ladikos, Nassir Navab, Daniel Roth, Benjamin Busam

6D位姿估计三维重建

动态场景中物体运动与相机运动耦合会使 SfM/静态 NeRF-SLAM 位姿不稳,进而影响动态 NeRF 重建。DynaMoN 将语义分割与通用运动掩码结合用于初始定位,并在训练中采用偏静态区域的 ray sampling 与 NeRF/位姿交替优化来细化轨迹。在 TUM RGB-D 与 BONN RGB-D Dynamic 上,其相机轨迹精度和新视角合成质量均优于对比方法,训练时间也较同类动态定位+NVS方案减少。

Outram: One-shot Global Localization via Triangulated Scene Graph and Global Outlier Pruning Figure 1
arXiv preprint2023-09-16

Outram: One-shot Global Localization via Triangulated Scene Graph and Global Outlier Pruning

PAGE 1, Pengyu Yin1, Haozhi Cao1, Thien-Minh Nguyen1, Shenghai Yuan1, Shuyang Zhang2, Kangcheng Liu1

6D位姿估计

本文针对单帧 LiDAR 全局定位中“候选检索”和“位姿对应生成”割裂导致的子结构歧义问题,提出 Outram:用三角化 3D 场景图子结构直接与全局地图生成局部一致对应,再通过图论式全局外点剔除筛选内点并估计位姿。实验在多个大规模户外数据集上显示其鲁棒性优于若干基于回环检测的全局定位方法,但代价是尚难达到实时性能。

Towards Robust and Smooth 3D Multi-Person Pose Estimation from Monocular Videos in the Wild Figure 1
arXiv preprint2023-09-15

Towards Robust and Smooth 3D Multi-Person Pose Estimation from Monocular Videos in the Wild

PAGE 1, Sungchan Park

Seoul National University

6D位姿估计

本文针对野外单目视频多人3D姿态估计在未知视角、遮挡和时间抖动下不稳定的问题,提出POTR-3D:以Transformer做序列到序列2D-to-3D lifting,并通过几何感知数据增强合成多视角、含地面与遮挡的多人训练样本。实验显示其在公开基准达到SOTA,并在重遮挡和野外视频中输出更平滑、鲁棒的3D姿态。

YCB-Ev: Event-vision dataset for 6DoF object pose estimation Figure 1
arXiv preprint2023-09-15

YCB-Ev: Event-vision dataset for 6DoF object pose estimation

Pavel Rojtberg, Thomas Pöllabauer

Thomas Pöllabauer

6D位姿估计物体位姿事件相机数据集/基准

该工作针对事件相机缺少真实6DoF物体位姿基准、难以评估机器人高速感知的问题,构建YCB-Ev:同步采集RGB-D与事件流,覆盖21个YCB物体、21段序列和13,851帧,并通过RGB-D检测、时间插值与外参标定将位姿标注转到事件相机坐标系。主要结果是发布首个带6DoF真值的真实事件流数据集,并用新YCB-V序列检验BOP预训练方法的跨数据泛化。

Fast and Accurate Deep Loop Closing and Relocalization for Reliable LiDAR SLAM Figure 1
arXiv preprint2023-09-15

Fast and Accurate Deep Loop Closing and Relocalization for Reliable LiDAR SLAM

PAGE 1, Chenghao Shi∗, Xieyuanli Chen∗, Junhao Xiao, Bin Dai, Huimin Lu

6D位姿估计相机位姿点云

面向仅依赖 LiDAR 的长期 SLAM,论文针对回环检测纠漂与跟踪失败后重定位长期割裂、且6DoF配准常依赖耗时鲁棒估计的问题,提出统一的粗到细框架与多头 LCR-Net:共享编码器同时生成全局描述子和密集局部匹配,并用 3D-RoFormer++、VoteEncoder 强化几何上下文与关键点覆盖。多数据集实验显示其在候选检索、闭环配准和连续重定位上超过基线/SOTA,无需 RANSAC/ICP 仍适合在线 SLAM,并集成出具备深度回环与重定位能力的 LiDAR SLAM 系统。

Gradient based Grasp Pose Optimization on a NeRF that Approximates Grasp Success Figure 1
arXiv preprint2023-09-14

Gradient based Grasp Pose Optimization on a NeRF that Approximates Grasp Success

PAGE 1, Gergely S´oti1, Bj¨orn Hein1, Christian Wurll1

Hochschule Karlsruhe – University of Applied Sciences, Karlsruhe, Germany, Karlsruhe Institute of Technology, Karlsruhe, Germany

6D位姿估计三维重建

论文针对抓取方法常依赖目标位姿、离散候选或反复采样优化的问题,将抓取看作在连续位姿空间中最大化成功率的优化任务。作者在 VisionNeRF 场景表征上通过迁移学习训练可微的抓取成功估计器,直接把夹爪位姿映射到成功分数,并用梯度更新位姿而非渲染或离散搜索。在四个仿真 3DoF 抓取任务中,预训练 NeRF 和多视角目标明显降低误差,最佳模型距有效抓取位姿平均约 3mm,并展示了对新物体的泛化潜力。

TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecasting Figure 1
arXiv preprint2023-09-14

TEMPO: Efficient Multi-View Pose Estimation, Tracking, and Forecasting

PAGE 1, Rohan Choudhury

Robotics Institute, Carnegie Mellon University

6D位姿估计多视角

TEMPO针对多视角多人3D姿态中体素/Transformer方法精度高但计算重、且多为单帧推理的问题,将各视角2D特征反投影到3D体积后先做人检测与跨帧关联,再用轻量循环结构按人融合时空特征,同时输出当前姿态、跟踪身份和未来姿态。其核心取舍是用递归时空聚合替代昂贵3D/4D卷积,在CMU Panoptic上较TesseTrack降低约10% MPJPE并实现33倍FPS提升,且在多数据集迁移中无需场景微调仍有竞争力。

Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation Figure 1
arXiv preprint2023-09-14

Towards Robust and Unconstrained Full Range of Rotation Head Pose Estimation

PAGE 1

6D位姿估计

针对现有头部姿态估计多局限于正脸小角度、在无约束场景中遇到大旋转易失效的问题,论文用旋转矩阵的连续6D表示替代欧拉角/四元数,并结合SO(3)测地损失与由CMU Panoptic扩展300W-LP得到的全旋转训练数据。实验显示该模型在多个公开数据集上误差低于现有方法,同时显著扩大可预测头部朝向范围。

EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large-Scale Visual Localization Figure 1
arXiv preprint2023-09-14

EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large-Scale Visual Localization

PAGE 1, Minjung Kim

Seoul National University

6D位姿估计相机位姿

EP2P-Loc针对大规模视觉定位中2D图像与3D点云表征差异导致匹配内点少、位姿细化困难的问题,采用先检索点云子图、再对3D点做2D patch分类,并用位置编码恢复精确像素坐标的粗到细流程;同时引入不可见点移除和可微PnP端到端训练。其在基于2D-3D-S与KITTI构建的室内外基准上优于既有视觉定位和图像到点云配准方法。

Unleashing the Power of Depth and Pose Estimation Neural Networks by Designing Compatible Endoscopic Images Figure 1
arXiv preprint2023-09-14

Unleashing the Power of Depth and Pose Estimation Neural Networks by Designing Compatible Endoscopic Images

PAGE 1, Junyang Wu1 Yun Gu1

Shanghai Jiao Tong University

6D位姿估计彩色深度

针对内窥镜图像高光伪影、特征稀疏导致自监督深度与位姿网络易局部过拟合的问题,论文不再主要改网络结构,而是提升图像与CNN的兼容性:引入MIM遮挡建模增强全局上下文感知,并设计轻量增强网络融合原图细节与重建图稳定性。三套公开数据和一个院内数据实验显示该策略显著提升基线,并可作为数据增强改善传统特征匹配稳定性。

LInKs "Lifting Independent Keypoints" -- Partial Pose Lifting for Occlusion Handling with Improved Accuracy in 2D-3D Human Pose Estimation Figure 1
arXiv preprint2023-09-13

LInKs "Lifting Independent Keypoints" -- Partial Pose Lifting for Occlusion Handling with Improved Accuracy in 2D-3D Human Pose Estimation

PAGE 1, Peter Hardy, Hansung Kim

University of Southampton

6D位姿估计手部姿态人体姿态

该文针对单目2D到3D人体姿态提升在遮挡或关键点缺失时几乎失效的问题,提出LInKs:先将可见的躯干、腿和左右肢体等子骨架独立提升到3D,再在3D空间补全缺失关节,以减少长程关键点耦合和2D补全误差传播;同时用自定义采样改进normalizing flow训练。Human3.6M上无遮挡重建误差较前作降低7.9%,多种遮挡场景下也优于在2D空间补全的方案。

3D Active Metric-Semantic SLAM Figure 1
arXiv preprint2023-09-13

3D Active Metric-Semantic SLAM

Yuezhan Tao, Xu Liu, Igor Spasojevic, Saurav Agarwal, Vijay Kumar

6D位姿估计相机位姿

针对GPS拒止、多楼层室内探索中VIO漂移会同时破坏定位与语义地图的问题,本文把探索与降不确定性统一到主动度量-语义SLAM框架中:用稀疏语义地标进行主动语义回环,并以COP规划在探索收益和回环利用间取舍。真实无人机实验显示,加入SLC后平移误差降逾90%、偏航误差降约75%,位姿与语义地图不确定性也显著降低。

ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completion Figure 1
RA-L2023-09-11

ViHOPE: Visuotactile In-Hand Object 6D Pose Estimation with Shape Completion

Hongyu Li, Snehal Dikhale, Soshi Iba, Nawid Jamali

6D位姿估计物体位姿手部姿态

面向灵巧手抓持中物体被手部严重遮挡、仅靠视觉或直接回归难以稳定估计6D位姿的问题,ViHOPE将视觉、触觉与部分深度形状结合,先用体素表示和条件GAN显式补全物体形状,再把补全形状潜变量与视觉特征联合优化位姿。实验在合成YCB数据和真实机器人上验证:形状补全IoU较SOTA提升265%、Chamfer Distance降低88%,位姿位置误差和角度误差分别降低35%和64%,消融表明主要增益来自显式形状补全。

Towards Intuitive HMI for UAV Control Figure 1
arXiv preprint2023-09-11

Towards Intuitive HMI for UAV Control

PAGE 1, Filip Zori´c

University of Zagreb

6D位姿估计航天器

该论文面向无人机进入大众应用后新手操控门槛高的问题,尝试用人体姿态估计将操作者手臂连续动作映射为类似摇杆的 UAV 控制指令,并在第一视角仿真迷宫任务中与传统摇杆对比,采用 raw NASA-TLX 和定性反馈评估负荷;但给定文本未充分说明最终性能差异与显著性结果。

FreeMan: Towards Benchmarking 3D Human Pose Estimation in the Wild Figure 1
arXiv preprint2023-09-12

FreeMan: Towards Benchmarking 3D Human Pose Estimation in the Wild

Bingliang Li, Wenbo Gou, Danqi Yan, Ailing Zeng, Yijun Gao, Junle Wang, Yanqing Jing, Shenzhen Tencent IDEA jiongwang@link, fengyuyang1@link.cuhk.edu.cn, ruimao.zhang@ieee.org

The Chinese University of Hong Kong, Shenzhen, Tencent

6D位姿估计人体姿态数据集/基准

FreeMan针对现有3D人体姿态数据多来自受控实验室、难以反映真实场景中视角、尺度、光照和背景变化的问题,构建了一个由8部智能手机同步采集的大规模多视角基准,包含1100万帧、8000段序列、40名被试和10类场景,并配套半自动标注与错误检测流程。实验覆盖单目、2D到3D、多视角估计等任务,显示该数据集对现有方法更具挑战性,且在室内外数据上的迁移性更好,增益可能主要来自数据规模与场景多样性。

Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimation Figure 1
arXiv preprint2023-09-09

Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimation

PAGE 1, Boyuan Jiang1, Lei Hu1, 2 Shihong Xia1

Institute of Computing Technology, Chinese Academy of Sciences, University of Chinese Academy of Sciences

6D位姿估计人体姿态多视角

本文针对多视角3D人体姿态估计对相机标定和固定外参依赖强、难以泛化到野外相机布局的问题,提出可嵌入现有标定方法的概率三角化模块,用相机位姿分布替代确定外参,并通过2D特征、重投影误差与蒙特卡洛采样迭代更新,使3D监督可端到端反传。Human3.6M和CMU Panoptic实验显示,其优于未标定方法,并接近标定SOTA,但仍限于单人场景。

Mirror-Aware Neural Humans Figure 1
arXiv preprint2023-09-09

Mirror-Aware Neural Humans

Daniel Ajisafe, James Tang, Shih-Yang Su, Bastian Wandt, Helge Rhodin (dajisafe, shihyang, rhodin)@cs.ubc.ca, tangytob@student.ubc.ca

The University of British Columbia, Linköping University

6D位姿估计

单目人体动捕受深度歧义限制,多相机又昂贵;本文利用普通镜子提供同步第二视角,从2D关键点自动标定相机与镜面、提升3D骨架,并将关节NeRF扩展为可处理真实人与镜像遮挡的分层镜面模型。实验表明,该流程能在复杂镜面场景中重建人体姿态、形状和外观,优于不建模身体或遮挡的变体。

Robot Localization and Mapping Final Report -- Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry Figure 1
arXiv preprint2023-09-08

Robot Localization and Mapping Final Report -- Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry

PAGE 1

Akankshya Kar, Sajal Maheshwari, Shamit Lal, Vinay Sameer Raja Kadi

6D位姿估计相机位姿机器人操作

该报告针对传统VO/SLAM在低纹理、动态场景中易失效,以及自监督深度VO存在深度/位姿模糊和轨迹漂移的问题,基于SFMLearner引入光流编码与LSTM建模时序上下文,并用GAN、WGAN和PatchGAN的对抗损失提升视图合成真实性,从而间接改善深度和相机位姿估计。文中进行了组件消融和与传统几何方法的对比讨论,但可见片段未充分说明定量增益,具体性能提升来源仍不清。

ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation Figure 1
arXiv preprint2023-09-07

ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation

Hui Zhang 1, 2 ⁣ * 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 * end_FLOATSUPERSCRIPT, Sammy Christen 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Zicong Fan 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Luocheng Zheng 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Jemin Hwangbo 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Jie Song 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Otmar Hilliges 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT ETH Zurich, Technology (KAIST

6D位姿估计

面向真实操作中常见的双手抓取、搬移并打开/闭合铰接物体,ArtiGrasp将该问题建模为物理仿真中的强化学习控制:用单个手姿态参考驱动全局腕部与局部手指,并通过从固定物体单手练习到非固定物体双手协作的课程学习获得精细接触控制。在Dynamic Object Grasping and Articulation任务上,相比改造的近邻基线约有5倍成功率提升,且能接收带噪的图像位姿估计输入,但对未见物体泛化仍只做了概念验证。

An automated, high-resolution phenotypic assay for adult Brugia malayi and microfilaria Figure 1
arXiv preprint2023-09-05

An automated, high-resolution phenotypic assay for adult Brugia malayi and microfilaria

PAGE 1, Upender Kalwa1, Yunsoo Park1, Michael J. Kimber2, Santosh Pandey1

Department of Electrical and Computer Engineering, College of Engineering, Iowa State, University; Ames, Iowa, USA, Department of Biomedical Sciences, College of Veterinary Medicine, Iowa State University

6D位姿估计

为解决淋巴丝虫成虫对现有药物不敏感且传统体外运动评分主观、低维的问题,本文提出 BrugiaTracker 多参数表型检测:成虫用质心速度、曲率、角速度等六指标,小丝虫用74个骨架关键点估计姿态与弯曲。三种驱虫药实验显示,多数指标给出一致剂量响应,并能跟踪自遮挡、omega 转弯等复杂运动;但通量较低,体内转化效果文中未充分说明。

A Robust Localization Solution for an Uncrewed Ground Vehicle in Unstructured Outdoor GNSS-Denied Environments Figure 1
arXiv preprint2023-09-05

A Robust Localization Solution for an Uncrewed Ground Vehicle in Unstructured Outdoor GNSS-Denied Environments

W. Jacob Wagner, Isaac Blankenau, Maribel DeLaTorre, Amartya Purushottam, Ahmet Soylemezoglu

Engineer Research and Development Center (ERDC)

6D位姿估计

面向无 GNSS、非结构化户外场景中 UGV 长距离单程导航易漂移的问题,论文提出 TRAELS,将两类地形参考导航与轮速计、IMU 通过双 EKF 融合,并加入轮滑剔除、航向偏置估计和标定流程,以替代依赖回环的 SLAM。实测显示,在几何与地表特征足够的环境中中位绝对轨迹误差稳定低于 3 m,并可在特征稀疏段后从较大漂移中恢复。

GO-SLAM: Global Optimization for Consistent 3D Instant Reconstruction Figure 1
arXiv preprint2023-09-05

GO-SLAM: Global Optimization for Consistent 3D Instant Reconstruction

PAGE 1, Paris, 2023. ©IEEE

Department of Computer Science and Engineering (DISI), University of Bologna, Italy

6D位姿估计相机位姿三维重建

GO-SLAM针对NeRF式稠密SLAM在长序列中缺少在线全局优化、相机漂移累积并导致重建变形的问题,提出将学习型前端跟踪、实时回环检测、在线全局BA与多分辨率哈希隐式表面即时更新结合的框架,使位姿和三维地图随历史关键帧共同校正。实验显示其在合成与真实数据上较iMAP、NICE-SLAM、DROID-SLAM等提升跟踪鲁棒性和重建精度,并可支持单目、双目和RGB-D输入。

DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimation Figure 1
IROS 20232023-09-05

DR-Pose: A Two-stage Deformation-and-Registration Pipeline for Category-level 6D Object Pose Estimation

Lei Zhou, Zhiyang Liu, Runze Gan, Haozhe Wang, Marcelo H. Ang

6D位姿估计物体位姿类别级位姿

DR-Pose针对类别级6D位姿中形状先验方法把“先验形变”和“点云注册”放在单阶段联合优化、易相互牵制的问题,提出两阶段流程:先用点云补全恢复遮挡/未观测部分来指导类别形状先验形变,再基于形变结果用带位置感知特征与尺度预测的注册网络估计NOCS表示。实验显示其在CAMERA25和REAL275上优于已有形状先验方法,尤其在更严格指标下提升明显。

On the Query Strategies for Efficient Online Active Distillation Figure 1
arXiv preprint2023-09-04

On the Query Strategies for Efficient Online Active Distillation

PAGE 1, Michele Boldo⋆

Department of Computer Science, University of Verona, Verona, Italy, Department of Engineering for Innovation Medicine, University of Verona, Verona, Italy

6D位姿估计

针对深度模型在边缘端进行人体姿态估计时训练数据、标注与算力开销过高的问题,本文比较了在线主动蒸馏中的帧查询策略,并同时在离线微调与基于教师软标签的持续学习场景下评估。核心洞察是,简单的随机/均匀采样通常比不确定性等复杂策略更稳健;误差驱动在较高采样率下略优但依赖难以获得的准确损失估计。结果表明低采样率可支持实时边缘适配,但部分策略会低于不微调基线。

DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusion Figure 1
arXiv preprint2023-09-04

DiffHPE: Robust, Coherent 3D Human Pose Lifting with Diffusion

Cédric Rommel, Eduardo Valle, Mickaël Chen, Souhaiel Khalfaoui, Renaud Marlet, Matthieu Cord, Patrick Pérez

Recod.ai Lab, School of Electrical and Computing Engineering, University of Campinas, Brazil

6D位姿估计人体姿态

针对单目2D到3D人体姿态提升中深度歧义、遮挡和时序不稳定问题,DiffHPE将DDPM用于姿态lifting,并提出用冻结的监督式MixSTE作为条件的DiffHPE-Wrapper,以扩散去噪细化预测而非完全替代监督模型。在Human3.6M上,该组合比单独扩散或监督基线更准确,并在训练/测试遮挡模式不匹配时保持更强鲁棒性,同时改善左右对称性和时间一致性;代价是推理计算开销更高。

Refined Temporal Pyramidal Compression-and-Amplification Transformer for 3D Human Pose Estimation Figure 1
arXiv preprint2023-09-06

Refined Temporal Pyramidal Compression-and-Amplification Transformer for 3D Human Pose Estimation

PAGE 1, Hanbing Liu1, Wangmeng Xiang2, Jun-Yan He2, Zhi-Qi Cheng3

Tsinghua University, Institute for Intelligent Computing, Alibaba Group, Carnegie Mellon University

6D位姿估计人体姿态

针对视频 3D 人体姿态估计中 Transformer 注意力未充分利用块内多尺度时序信息与块间交互的问题,论文提出 RTPCA:在注意力中引入 TPCA 时序金字塔压缩-放大以增强 K/V 表示,并用 XLR 跨层连接相邻块的 K/V。实验在 Human3.6M、HumanEva-I、MPI-INF-3DHP 上显示其在 MPJPE 与推理延迟上优于多种基线,且计算开销较小。

SKoPe3D: A Synthetic Dataset for Vehicle Keypoint Perception in 3D from Traffic Monitoring Cameras Figure 1
arXiv preprint2023-09-04

SKoPe3D: A Synthetic Dataset for Vehicle Keypoint Perception in 3D from Traffic Monitoring Cameras

Himanshu Pahadia 1 ⁣ * 1 ^ start_FLOATSUPERSCRIPT 1 * end_FLOATSUPERSCRIPT, Duo Lu 2 ⁣ * 2 ^ start_FLOATSUPERSCRIPT 2 * end_FLOATSUPERSCRIPT, Bharatesh Chakravarthi 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计仿真到现实数据集/基准

面向路侧单目交通监控中的车辆3D定位与姿态估计,论文指出现有关键点数据多来自车载前视视角,难以覆盖路侧视角、遮挡和天气光照变化。SKoPe3D用CARLA构建可自动生成3D车辆关键点标注的合成数据集,包含28个场景、2.5万余图像、15万车辆实例和490万关键点,并以Keypoint R-CNN给出基线,实验显示其可用于车辆关键点检测且具备一定合成到真实迁移潜力。

BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking Figure 1
arXiv preprint2023-09-03

BodySLAM++: Fast and Tightly-Coupled Visual-Inertial Camera and Human Motion Tracking

PAGE 1, Dorian F. Henning1, Christopher Choi1, Simon Schaefer2, Stefan Leutenegger1

6D位姿估计相机位姿

面向人机协作、AR/VR等需要实时、全局一致人体6D位姿与姿态的场景,BodySLAM++将OKVIS2视觉惯性SLAM扩展为紧耦合因子图,同时优化相机位姿、静态路标与SMPL人体网格,并引入学习的人体运动模型做在线跟踪。在自建含真值的立体VI数据集上,相比基线人体关节误差降低26%,相机轨迹误差降低12%,并在i7 CPU上达到15 FPS以上。

Mitigating Motion Blur for Robust 3D Baseball Player Pose Modeling for Pitch Analysis Figure 1
arXiv preprint2023-09-02

Mitigating Motion Blur for Robust 3D Baseball Player Pose Modeling for Pitch Analysis

PAGE 1, Jerrin Bright

University of Waterloo

6D位姿估计

该文面向30fps棒球转播视频中投手高速动作带来的局部运动模糊与自遮挡问题,认为复杂去模糊流水线并非必要,提出用定向合成运动模糊增强结合网络野外视频数据,提升2D到3D姿态及人体网格建模的鲁棒性。实验显示其在测试集上使2D、3D姿态损失分别降低54.2%和36.2%,接入现有SOTA姿态估计器平均提升29.2%。

Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture Figure 1
arXiv preprint2023-09-01

Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

PAGE 1, Shaohua Pan

School of software and BNRist, Tsinghua University, OPPO Research Institute

6D位姿估计人体姿态

针对单目视觉在遮挡、弱光、出视野时失效以及稀疏 IMU 易产生全局漂移的问题,论文提出实时融合单目图像与少量 IMU 的人体动捕框架。核心在于双坐标分支:可见时在相机坐标系融合视觉与惯性,不可靠时在人体根坐标系利用 IMU 估计局部姿态,并用融合结果反馈校正隐状态。实验显示其在全局朝向和局部姿态上优于视觉、IMU 及已有融合方法。

EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild Figure 1
arXiv preprint2023-08-31

EMDB: The Electromagnetic Database of Global 3D Human Pose and Shape in the Wild

PAGE 1, Manuel Kaufmann1

ETH Z¨urich, Department of Computer Science, Meta Reality Labs

6D位姿估计人体姿态

针对移动相机下野外人体三维姿态缺少带全局轨迹高精标注的问题,EMDB用可穿戴无线电磁传感器与手持 iPhone 采集数据,并通过EMP多阶段优化融合6DoF电磁测量、RGB-D/相机位姿和神经隐式人体模型,得到SMPL形状、姿态及相机/人体根节点轨迹。数据含10人81段约105k帧,MVS评估显示约2.3 cm位置误差、10.6°角度误差,并用于检验现有单目局部与全局姿态方法。

SA6D: Self-Adaptive Few-Shot 6D Pose Estimator for Novel and Occluded Objects Figure 1
arXiv preprint2023-08-31

SA6D: Self-Adaptive Few-Shot 6D Pose Estimator for Novel and Occluded Objects

PAGE 1, Ning Gao1

Bosch Center for Artificial Intelligence

6D位姿估计

面向机器人桌面抓取中新物体不断出现且常被遮挡的问题,SA6D将少量带位姿的杂乱RGB-D参考图用于测试时自适应:通过对比学习分割目标并构建规范点云,再结合几何引导的ROI、Gen6D粗估计和ICP细化。实验显示其在LineMOD-OCC、HomeBrewedDB等真实遮挡场景显著优于现有少样本方法,并能用更少参考图泛化到新物体。

Two-Stage Violence Detection Using ViTPose and Classification Models at Smart Airports Figure 1
arXiv preprint2023-08-30

Two-Stage Violence Detection Using ViTPose and Classification Models at Smart Airports

İrem Üstek, Jay Desai, Iván López Torrecillas, Sofiane Abadou, Jinjie Wang, Quentin Fever, Sandhya Rani Kasthuri, Yang Xing, Weisi Guo, Antonios Tsourdos

6D位姿估计

面向机场监控中人工发现暴力事件慢、异常帧稀少的问题,论文将检测拆成“人体检测/跟踪+ViTPose关键点估计”和“CNN-BiLSTM时序分类”,用骨架特征替代原始图像以降低计算与背景干扰。系统在AIRTLab数据上训练并接入SAAB SAFE、进行实时摄像头端到端测试,展示可实时报警;但文中量化精度和相对增益未充分说明。

SignDiff: Learning Diffusion Models for American Sign Language Production Figure 1
arXiv preprint2023-08-30

SignDiff: Learning Diffusion Models for American Sign Language Production

Sen Fang, Chunyu Sui, Yanghao Zhou, Xuedong Zhang Hongbin Zhong, Yapeng Tian

Rutgers University, Columbia University, National University of Singapore, Victoria University

6D位姿估计

针对美国手语生成中大规模数据处理困难、文本到骨架长序列不稳定以及骨架到真人视频渲染质量不足的问题,SignDiff将文本到姿态的Fast-SLP与姿态条件扩散渲染结合,并引入FR-Net构造类DensePose条件以强化帧级语义—姿态对应、减少手指伪影。在How2Sign上给出ASLP基线BLEU-4为17.19/12.85,在PHOENIX14T取得SOTA,SSIM较既有方法提升约10个百分点;但部分增益可能来自How2Sign规模与Stable Diffusion预训练。

Learning Structure-from-Motion with Graph Attention Networks Figure 1
arXiv preprint2023-08-30

Learning Structure-from-Motion with Graph Attention Networks

Lucas Brynte, José Pedro Iglesias, Carl Olsson

Chalmers University of Technology

6D位姿估计

针对传统 SfM 依赖成对位姿、姿态平均、三角化等手工子模块且 BA 需要良好初始化、运行较慢的问题,本文用图注意力网络直接从多视角 2D 关键点轨迹回归相机位姿与 3D 点,学习可泛化的 SfM 先验,并可接 BA 精修。实验显示其优于既有学习式方法,精度可接近 COLMAP,同时推理/重建约快 5–10 倍;但最终质量仍依赖 BA,泛化到更大数据仍是限制。

Reconstructing Groups of People with Hypergraph Relational Reasoning Figure 1
arXiv preprint2023-08-30

Reconstructing Groups of People with Hypergraph Relational Reasoning

PAGE 1, Buzhen Huang1

Southeast University, China, Huawei Noah’s Ark Lab

6D位姿估计

本文针对大规模拥挤场景中多人网格重建受遮挡、尺度变化和绝对深度歧义影响的问题,利用人群中常见的集体运动与交互相似性,引入多尺度超图关系推理,在紧凑个体特征和边框位置上建模个体—群组高阶关系,并回归相机坐标下的人体网格;作者还为 Panda 与 CrowdPose 构建伪 3D 标注,实验显示在拥挤和常规场景均优于多种基线。

3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking Figure 1
arXiv preprint2023-08-29

3D-MuPPET: 3D Multi-Pigeon Pose Estimation and Tracking

Urs Waldmann, Alex Hoi Hang Chan, Hemal Naik, Máté Nagy, Iain D. Couzin, Oliver Deussen, Bastian Goldluecke, Fumihiro Kano

Department of Computer and Information Science, University of Konstanz, Germany, Department of Collective Behavior, Max Planck Institute of Animal Behavior, Konstanz, Department of Biology, University of Konstanz, Germany, Department of Ecology of Animal Societies, Max Planck Institute of Animal Behavior, MTA-ELTE ‘Lend¨ulet’ Collective Behaviour Research Group, Hungarian Academy of

6D位姿估计

针对多动物群体缺少可用的三维无标记姿态与身份跟踪基准,3D-MuPPET将多视角2D关键点/框检测、跨视角身份初始化、2D在线跟踪与三角化结合,可跟踪最多10只鸽子。其精度接近现有3D姿态方法,速度达2D 9.45 fps、3D 1.89 fps,并展示了单鸽训练迁移到多鸽及户外场景的可行性。

Spatio-temporal MLP-graph network for 3D human pose estimation Figure 1
arXiv preprint2023-08-29

Spatio-temporal MLP-graph network for 3D human pose estimation

PAGE 1, Tanvir Hassan

Concordia University

6D位姿估计人体姿态

该文针对GCN人体3D姿态估计常偏重空间关节关系、难利用时序且易过平滑/参数膨胀的问题,提出MLP-GraphWJ mixer:用关节混合MLP建模全局时空依赖,用基于隐式公平化图滤波的加权Jacobi传播建模局部骨架关系,并引入权重与邻接调制学习非固定关节连接。在两个基准数据集上优于近期方法,同时保持较小模型规模。

Pose-Free Neural Radiance Fields via Implicit Pose Regularization Figure 1
arXiv preprint2023-08-29

Pose-Free Neural Radiance Fields via Implicit Pose Regularization

PAGE 1, Jiahui Zhang1

Nanyang Technological University, Max Planck Institute for Informatics, Wenzhou University, UCAS-Terminus AI Lab, UCAS

6D位姿估计

本文针对无位姿多视图图像训练 NeRF 时,现有方法的位姿估计器仅用渲染图训练、在真实图像上受域差影响而易陷入联合优化局部最优的问题,提出 IR-NeRF:构建场景 codebook 隐式编码场景特征与位姿分布,并用位姿引导重建约束细化真实图像位姿估计。实验在合成与真实数据集上显示,其新视角合成质量和位姿鲁棒性优于 GNeRF 等基线。

R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Cameras Figure 1
arXiv preprint2023-08-28

R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Cameras

PAGE 1, Aron Schmied1

ETH Z¨urich, Microsoft

6D位姿估计三维重建

面向自动驾驶/机器人中仅用多相机替代昂贵多传感器进行动态场景稠密重建的需求,R3D3将跨相机与时间共视约束纳入特征相关和多相机稠密BA,同时用带不确定性的深度细化网络补足运动物体、弱纹理区域的几何失效。该迭代闭环在DDAD和NuScenes多相机深度基准上达到当时SOTA,并较单目SLAM表现出更好的精度与鲁棒性。

Video-Based Hand Pose Estimation for Remote Assessment of Bradykinesia in Parkinson's Disease Figure 1
arXiv preprint2023-08-28

Video-Based Hand Pose Estimation for Remote Assessment of Bradykinesia in Parkinson's Disease

PAGE 1, Gabriela T. Acevedo Trebbau1, Andrea Bandini2, Diego L. Guarin1

Department of Applied Physiology and Kinesiology, University of Florida, Gainesville, FL, Interdisciplinary Research Center “Health Science” – Scuola Superiore Sant’Anna, Pisa, Italy

6D位姿估计手部姿态

为验证远程问诊视频能否可靠支持帕金森运动迟缓自动评估,论文比较7种现成手部姿态估计模型在手指敲击任务中跟踪拇指与食指的表现,核心洞察是视频采集条件本身会显著影响下游医学特征可靠性。结果显示,仅3个模型在本地高质量录制中精度较好,Zoom流媒体下精度明显下降,且动作越快误差越大;PD患者的10项运动迟缓特征在本地视频中多具高可靠性,在流媒体视频中多为较差到中等。

Active Pose Refinement for Textureless Shiny Objects using the Structured Light Camera Figure 1
arXiv preprint2023-08-28

Active Pose Refinement for Textureless Shiny Objects using the Structured Light Camera

PAGE 1, Jun Yang, Jian Yao, Steven L. Waslander

6D位姿估计

针对结构光相机在无纹理高反光物体上因饱和、低信噪比和互反射导致深度缺失、进而削弱6D位姿精修的问题,本文将深度不确定性显式纳入SDF优化式位姿精修,并通过可微/在线渲染预测未来视角测量不确定性,以最小化位姿不确定性选择NBV。在ROBI真实数据集上,该方法在相同深度输入下优于ICP,且相比启发式视角策略用更少视角达到较高精度。

CPFES: Physical Fitness Evaluation Based on Canadian Agility and Movement Skill Assessment Figure 1
arXiv preprint2023-08-28

CPFES: Physical Fitness Evaluation Based on Canadian Agility and Movement Skill Assessment

PAGE 1, Pengcheng Dong1, Xiaojin Mao2, Lixia Fan2, Wenbo Wan1, Jiande Sun1

School of Information Science and Engineering, Shandong Normal University, Jinan, China

6D位姿估计

针对儿童 CAMSA 体能评估依赖人工、耗时且主观性强的问题,本文提出 CPFES,用 YOLOv5 检测测试场地标志物、BlazePose 提取人体关键点,并按七类动作规则设计姿态评价模块自动打分。实验将系统评分与人工评价对比,显示较高准确率,但具体数据规模与泛化范围文中未充分说明。

LDL: Line Distance Functions for Panoramic Localization Figure 1
arXiv preprint2023-08-27

LDL: Line Distance Functions for Panoramic Localization

PAGE 1, Junho Kim1, Changwoon Choi1, Hojun Jang1, Young Min Kim1

Dept. of Electrical and Computer Engineering, Seoul National University, Interdisciplinary Program in Artificial Intelligence and INMC, Seoul National University

6D位姿估计

这篇论文针对全景视觉定位中依赖全局特征或彩色点云导致的计算开销大、对光照变化敏感问题,提出用线段作为主要几何线索。核心是构建2D/3D线距离函数,并按主方向分解以增强区分度,从而无需显式线匹配即可快速筛选粗位姿,再用局部特征与PnP-RANSAC精化。实验显示其在室内场景、物体布局变化和强光照变化下与基线竞争,同时候选位姿搜索达到毫秒级、快于全局特征比较。

Prior-guided Source-free Domain Adaptation for Human Pose Estimation Figure 1
arXiv preprint2023-08-26

Prior-guided Source-free Domain Adaptation for Human Pose Estimation

PAGE 1

University of California, Riverside, AWS AI Labs

6D位姿估计人体姿态仿真到现实

针对人体姿态域自适应常需保留带隐私风险的源域图像、且存储计算开销高的问题,论文研究仅用源模型和无标注目标数据的源自由适配。其POST在Mean Teacher自训练中同时约束预测与特征一致性,并引入由姿态坐标学习的人体先验来过滤不合理伪标签。实验显示其在三类跨域场景中明显优于直接迁移源模型,性能接近仍使用源数据的UDA方法。

Vision-Based Human Pose Estimation via Deep Learning: A Survey Figure 1
arXiv preprint2023-08-26

Vision-Based Human Pose Estimation via Deep Learning: A Survey

PAGE 1, VOL. 53, NO. 1, FEBRUARY 2023

6D位姿估计人体姿态综述

针对深度学习人体姿态估计已有工作分散、常只覆盖2D或3D单一方向的问题,本文系统梳理视觉HPE的网络范式、姿态表示、数据集与指标,并按单人/多人、图像/视频、单目/多视角/多模态建立分类。核心洞察是热图表示、专用骨干与时序/图结构建模推动性能提升;主要结果是给出代表方法对比、应用版图及基于文献计量的趋势与遮挡、拥挤、三维标注等挑战总结。

POCO: 3D Pose and Shape Estimation with Confidence Figure 1
arXiv preprint2023-08-24

POCO: 3D Pose and Shape Estimation with Confidence

PAGE 1, Sai Kumar Dwivedi1

Dimitrios Tzionas3, Max Planck Institute for Intelligent Systems, T¨ubingen, Germany, Inria, ´Ecole normale sup´erieure, CNRS, PSL Research University, France, University of Amsterdam, the Netherlands

6D位姿估计

POCO关注单图3D人体姿态与形状回归在遮挡、模糊或分布外姿态下“错而不自知”的问题。其核心是在HMR、PARE、CLIFF等回归器上加入单次前向即可输出不确定性的训练框架,并用图像条件化的基密度函数与姿态条件化尺度的双重条件策略,使置信度更贴近重建误差。实验显示其在3DPW、3DOH上带来小但稳定的精度提升,并可用于筛选伪标签自训练和视频中不可靠帧修补。

Certifiably Optimal Rotation and Pose Estimation Based on the Cayley Map Figure 1
arXiv preprint2023-08-23

Certifiably Optimal Rotation and Pose Estimation Based on the Cayley Map

Timothy D. Barfoot affiliationmark, Connor Holmes affiliationmark, and Frederike Dümbgen affiliationmark

Robotics Institute, University of Toronto

6D位姿估计

针对机器人/视觉中旋转与位姿估计常因非凸性依赖初值、且既有可认证松弛多假设各向同性弦距噪声的问题,论文以 Cayley 映射刻画李代数各向异性噪声,将旋转/位姿平均和轨迹估计转成 QCQP 并松弛为 SDP,同时识别冗余约束。结果显示在实际噪声水平下可由对偶性事后认证全局最优,但大规模 SDP 的扩展性仍受限。

Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shape Figure 1
arXiv preprint2023-08-22

Animal3D: A Comprehensive Dataset of 3D Animal Pose and Shape

Jiacong Xu, Yi Zhang, Jiawei Peng, Wufei Ma, Artur Jesslen, Pengliang Ji Qixin Hu, Jiehua Zhang, Qihao Liu, Jiahao Wang, Wei Ji, Chen Wang Xiaoding Yuan, Prakhar Kaushik, Guofeng Zhang, Jie Liu, Yushan Xie Yawen Cui, Alan Yuille

Johns Hopkins University East China Normal University Beihang University, HUST University of Oulu University of Alberta Tsinghua University UCLA, City University of Hong Kong Max Planck Institute for Informatics University of Freiburg

6D位姿估计数据集/基准

针对动物三维姿态与形状研究缺少跨物种、高质量3D标注数据的问题,Animal3D构建了覆盖40种哺乳动物的3379张图像数据集,提供26个关键点及基于SMAL模型拟合的姿态和形状参数,并设置监督学习、合成到真实迁移和人类模型微调三类基线。实验显示跨物种动物3D重建仍明显困难,现有方法泛化不足,但合成预训练能带来性能提升。

TrackFlow: Multi-Object Tracking with Normalizing Flows Figure 1
arXiv preprint2023-08-22

TrackFlow: Multi-Object Tracking with Normalizing Flows

PAGE 1, Gianluca Mancusi1

University of Modena and Reggio Emilia, Italy

6D位姿估计物体位姿

TrackFlow针对tracking-by-detection中多模态关联代价难以手工加权的问题,将2D位移、外观/姿态或粗略3D距离等线索的融合建模为正确关联的条件联合密度估计,并用Normalizing Flow输出负对数似然作为统一匹配代价,同时引入场景上下文以适应不同动态。实验在MOTSynth、MOT17、MOT20上显示,该代价可替换传统IoU/位移度量并稳定提升多种跟踪器;但具体增益在多大程度来自合成数据训练的距离估计器仍需结合消融判断。

A LiDAR-Inertial SLAM Tightly-Coupled with Dropout-Tolerant GNSS Fusion for Autonomous Mine Service Vehicles Figure 1
arXiv preprint2023-08-22

A LiDAR-Inertial SLAM Tightly-Coupled with Dropout-Tolerant GNSS Fusion for Autonomous Mine Service Vehicles

PAGE 1

> REPLACE THIS LINE WITH YOUR MANUSCRIPT ID NUMBER (DOUBLE-CLICK HERE TO EDIT) <

6D位姿估计相机位姿点云

面向矿区服务车在隧道中 GNSS 长时间中断、视觉退化和几何退化导致定位漂移的问题,论文提出双 LiDAR-IMU-轮速-GNSS 紧耦合 SLAM:前端用 ESKF 并行融合多传感器并以 surfel 配准替代常规特征点,后端以位姿图联合优化并通过回环重初始化校正断星期间累积漂移。实矿测试显示系统可在数十分钟 GNSS dropout 下保持米级精度,6.6 km 行驶后漂移约 1.86 m。

PoseGraphNet++: Enriching 3D Human Pose with Orientation Estimation Figure 1
arXiv preprint2023-08-22

PoseGraphNet++: Enriching 3D Human Pose with Orientation Estimation

Soubarna Banik12, Edvard Avagyan2, Sayantan Auddy3 Alejandro Mendoza García4, Alois Knoll2

6D位姿估计人体姿态

针对骨架式3D人体姿态通常只估计关节位置、难以确定骨骼轴向旋转的问题,PGN++将2D关节与骨骼角度共同提升到3D,使用同时建模节点与边的GCN来利用关节—骨骼互依关系。在Human3.6M上位置和方向指标达到接近或相当于SoA,跨数据集泛化中位置优于已有方法、方向持平,消融显示边关系有助于提升位置预测。

Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Views Figure 1
arXiv preprint2023-08-22

Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Views

Wentian Qu, Zhaopeng Cui, Yinda Zhang, Chenyu Meng, Cuixia Ma, Xiaoming Deng, Hongan Wang

Institute of Software, Chinese Academy of Sciences, University of Chinese Academy of Sciences, State Key Lab of CAD&CG, Zhejiang University, Google

6D位姿估计手部姿态

针对稀疏视角下手-物交互中遮挡严重、手部形变大导致新视角合成和6D位姿估计困难的问题,论文提出 HO-NeRF:先离线分别学习手和物体的神经形状/外观先验,再在线用可微渲染联合拟合手姿与物体位姿,并引入 SDF 几何约束和稳定接触损失减少穿透、分离与接触滑移。实验显示其在手物位姿估计和少视角神经渲染质量上优于已有方法,并发布了配套 HandObject 数据集。

Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images Figure 1
arXiv preprint2023-08-21

Spectral Graphormer: Spectral Graph-based Transformer for Egocentric Two-Hand Reconstruction using Multi-View Color Images

PAGE 1, Tze Ho Elden Tse1

Google, University of Birmingham

6D位姿估计手部姿态多视角三维重建

面向 AR/VR 中自我视角、多视角 RGB 下双手及前臂的绝对位姿与高保真网格重建,论文指出现有单视角/参数化方法难以处理双手交互、遮挡和物理合理性。其核心是用软注意力做区域化多视角特征融合,并将谱图拉普拉斯引入 Transformer 与粗到细图解码器,推理时再用优化减少自穿透。作者构建大规模合成数据并采集真实多相机数据,实验显示合成训练模型可泛化到真实场景,重建更平滑逼真且具实时 AR/VR 潜力。

Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data Figure 1
ICCV 20232023-08-21

Polarimetric Information for Multi-Modal 6D Pose Estimation of Photometrically Challenging Objects with Limited Data

Patrick Ruhkamp, Daoyi Gao, HyunJun Jung, Nassir Navab, Benjamin Busam

6D位姿估计

这篇论文针对无纹理、反光、透明等物体上 RGB/RGB-D 深度与外观线索失效的问题,引入偏振成像为 6D 位姿估计提供表面法线等几何先验。核心做法是从 DoP/AoP 的物理模型生成可行法线并融合进监督网络,同时用可逆偏振物理模型与可微渲染构造自监督信号,减少真实标注依赖。文中报告该多模态与自监督方案在光度困难物体上相比 RGB/RGB-D 基线取得明显位姿精度提升。

GaitPT: Skeletons Are All You Need For Gait Recognition Figure 1
arXiv preprint2023-08-21

GaitPT: Skeletons Are All You Need For Gait Recognition

Andy Cătrună, Adrian Cosma, Computer Science, Romania catruna.andy@gmail.com, ioan_adrian.cosma@upb.ro, emilian.radoi@upb.ro

Faculty of Automatic Control and Computer Science, University Politehnica of Bucharest, Romania

6D位姿估计人体姿态

针对传统步态识别依赖轮廓外观、存在隐私泄露且易混入衣着体型信息的问题,GaitPT只使用姿态估计得到的人体骨架序列,并以符合解剖结构的金字塔 Transformer 分层建模关节局部到全身的时空运动。实验在 CASIA-B、GREW、Gait3D 上均优于既有骨架方法,其中 CASIA-B 平均准确率82.6%,GREW Rank-1达52.16%,但性能也明显受上游姿态估计质量影响。

Approximately Equivariant Graph Networks Figure 1
arXiv preprint2023-08-21

Approximately Equivariant Graph Networks

PAGE 1, Ningyuan (Teresa) Huang

Johns Hopkins University, Technion – Israel Institute of Technology

6D位姿估计

这篇论文针对固定图上学习时,传统 GNN 的“节点重标号”等变性与 CNN 式主动对称并不等价的问题,提出用图自同构及由图粗化诱导的近似对称来选择等变约束。核心洞察是对称群大小决定表达力与估计正则性的偏差—方差权衡;在图像修复、交通预测和人体姿态估计实验中,性能通常来自介于真实自同构群与全置换群之间的适度近似对称。

In-Rack Test Tube Pose Estimation Using RGB-D Data Figure 1
arXiv preprint2023-08-21

In-Rack Test Tube Pose Estimation Using RGB-D Data

PAGE 1, Hao Chen1∗, Weiwei Wan1, Masaki Matsushita2, Takeyuki Kotaka2, Kensuke Harada13

6D位姿估计点云彩色深度

面向生物医疗自动化中试管抓取对可靠定位的需求,论文针对架内试管密集遮挡、透明材质导致深度点云噪声和缺失的问题,提出RGB-D两阶段框架:先用YOLOv5检测试管与试管架,再通过点云配准估计架位姿,并把槽位布局作为先验约束,用圆柱特征优化拟合试管6D位姿。实验表明该约束能在点云不完整时提升架内试管检测与位姿估计鲁棒性,但具体增益幅度文中片段未充分说明。

Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Video Figure 1
arXiv preprint2023-08-20

Co-Evolution of Pose and Mesh for 3D Human Body Estimation from Video

PAGE 1, Yingxuan You1

Key Laboratory of Machine Perception, Shenzhen Graduate School, Peking University, Department of Computer Science, ETH Z¨urich

6D位姿估计

针对视频中3D人体网格恢复在逐帧精度与运动平滑性之间的矛盾,论文认为问题来自耦合图像特征和SMPL参数空间表达受限,提出PMCE以3D姿态为中介,将任务拆为视频3D姿态估计与基于姿态/时序图像特征的非参数网格顶点回归,并用图像引导AdaLN实现姿态—网格协同演化。实验在3DPW、Human3.6M和MPI-INF-3DHP上优于既有方法,3DPW上MPJPE降12.1%、PVE降8.4%、加速度误差降8.5%。

OCHID-Fi: Occlusion-Robust Hand Pose Estimation in 3D via RF-Vision Figure 1
arXiv preprint2023-08-20

OCHID-Fi: Occlusion-Robust Hand Pose Estimation in 3D via RF-Vision

PAGE 1, Shujie Zhang1, Tianyue Zheng1, Zhe Chen2, Jingzhi Hu1

Nanyang Technological University, Fudan University

6D位姿估计手部姿态

针对相机手部姿态估计受视线和遮挡限制的问题,OCHID-Fi用宽带RF信号估计被木板、塑料、纸板等遮挡后的3D手部关键点。其核心是用同步视觉/RF数据和预训练视觉HPE进行跨模态监督,再以复值OCH-Net建模RF特征,并通过对抗学习把LoS知识迁移到无标注遮挡域。实验显示其在正常场景接近相机方法,在遮挡场景仍保持相近精度并具备一定跨障碍泛化能力。

3D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation Figure 1
arXiv preprint2023-08-19

3D-Aware Neural Body Fitting for Occlusion Robust 3D Human Pose Estimation

PAGE 1, Yi Zhang1∗

Johns Hopkins University, Beihang University, Max Planck Institute for Informatics, University of Freiburg

6D位姿估计人体姿态

针对单目3D人体姿态估计在遮挡下回归方法易失效、传统拟合又受2D-3D歧义限制的问题,论文提出3DNBF:用高斯椭球体积表示的Neural Body Volumes在深特征空间做分析-合成拟合,并通过对比学习获得包含局部3D姿态信息的特征。实验在3DPW、遮挡及对抗遮挡协议上显示,其在遮挡场景显著优于回归和优化式基线,同时保持常规场景SOTA表现。

Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation Figure 1
arXiv preprint2023-08-19

Pseudo Flow Consistency for Self-Supervised 6D Object Pose Estimation

PAGE 1, Yang Hai 1

State Key Laboratory of ISN, Xidian University

6D位姿估计物体位姿

针对自监督6D位姿估计常依赖深度图或精确2D掩码、难以在纯RGB场景落地的问题,本文先用目标3D模型渲染的合成图训练获得粗位姿,再在教师—学生框架中把伪位姿转化为像素级光流监督,并利用多视角合成—真实图像对的几何一致性动态筛选高质量伪标签。实验在LINEMOD、Occluded-LINEMOD和YCB-V上显著优于已有自监督方法,且无需2D标注或额外深度。

UniAP: Towards Universal Animal Perception in Vision via Few-shot Learning Figure 1
arXiv preprint2023-08-19

UniAP: Towards Universal Animal Perception in Vision via Few-shot Learning

PAGE 1, Meiqi Sun1

Zhejiang University, University of Washington, Donghua University

6D位姿估计

针对动物物种多、稀有类标注少且姿态估计、分割、分类任务语义不一致的问题,UniAP将支持图像及其关键点/掩码等标签作为 few-shot 提示,通过Transformer图像编码、轻量标签编码、匹配模块和多头解码器统一输出多任务结果。论文在多种动物数据集上验证其可迁移到少样本乃至未见物种,但具体增益幅度需结合实验表判断。

Scene-Aware Feature Matching Figure 1
arXiv preprint2023-08-22

Scene-Aware Feature Matching

PAGE 1, Xiaoyong Lu, Yaping Yan, Tong Wei, Songlin Du

Southeast University, Nanjing, China

6D位姿估计

针对传统特征匹配过度依赖点级纹理、在大视角和光照变化下易退化的问题,SAM引入可由匹配监督学习的group tokens,将图像点特征与场景分组信息通过Transformer联合建模,并用多层级得分指导点级对应。实验覆盖单应估计、位姿估计和图像匹配,报告达到SOTA,同时分组可视化提升了可解释性;但额外分组模块带来一定计算开销。

PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation Figure 1
arXiv preprint2023-08-18

PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation

PAGE 1, Hanbing Liu∗

Tsinghua University, DAMO Academy, Alibaba Group, Carnegie Mellon University, University of Washington, Zhejiang University

6D位姿估计人体姿态仿真到现实

针对3D人体姿态估计迁移到新场景时缺少目标域2D-3D配对、且单视角姿态存在多解的问题,PoSynDA用类扩散的多假设姿态合成生成目标域3D伪标签,并结合目标相机/尺度解耦的源域增强、师生训练与低秩适配来对齐分布。实验在Human3.6M、MPI-INF-3DHP等基准上优于既有无监督域适应方法,目标域无3D标注时MPJPE约58.2mm,接近目标域监督训练的MixSTE 57.9mm。

Improving 3D Pose Estimation for Sign Language Figure 1
arXiv preprint2023-08-18

Improving 3D Pose Estimation for Sign Language

PAGE 1, Maksym Ivashechkin, Oscar Mendez, Richard Bowden

University of Surrey, Centre for Vision, Speech and Signal Processing (CVSSP), Stag Hill, University Campus, Guildford GU2 XH, UK

6D位姿估计

针对手语中快速手部运动、手手/手脸交互导致通用姿态估计易失效的问题,论文将2D关键点经多个MLP预测关节欧拉角与骨长,再用带人体层级和关节约束的PyTorch前向运动学层生成合法3D骨架。实验显示其在关节误差和视觉效果上明显优于MediaPipe,并能跨数据集和手语泛化,CPU单图约100–200毫秒。

Denoising Diffusion for 3D Hand Pose Estimation from Images Figure 1
arXiv preprint2023-08-18

Denoising Diffusion for 3D Hand Pose Estimation from Images

PAGE 1, Maksym Ivashechkin, Oscar Mendez, Richard Bowden

University of Surrey, United Kingdom

6D位姿估计手部姿态

针对单目图像中手部尺寸小、运动模糊和双手交互导致2D检测易失效、3D抬升误差累积的问题,论文提出从图像特征直接回归3D手姿态的去噪扩散框架,并加入显式正向运动学层约束骨长和关节角;有序列时再用Transformer利用时间上下文抑制抖动。作者在多个数据集上给出定量与定性结果,报告其鲁棒性、泛化和精度达到当时先进水平。

ResQ: Residual Quantization for Video Perception Figure 1
arXiv preprint2023-08-18

ResQ: Residual Quantization for Video Perception

Davide Abati, Haitam Ben Yahia, Markus Nagel, Amirhossein Habibian

Qualcomm AI Research

6D位姿估计

面向资源受限设备上的实时视频感知,论文指出逐帧量化忽略了相邻帧激活的时间冗余。核心洞察是帧间残差方差更小、量化误差更低,因此提出 ResQ:关键帧用较高精度,后续残差用低精度,并可按残差大小动态调节 bit-width。在语义分割、视频目标分割和人体姿态估计上,ResQ 相比标准量化和多种高效视频方法取得更好的精度—计算量折中;但其需传播中间表示,存在内存和硬件实现开销。

MovePose: A High-performance Human Pose Estimation Algorithm on Mobile and Edge Devices Figure 1
arXiv preprint2023-08-17

MovePose: A High-performance Human Pose Estimation Algorithm on Mobile and Edge Devices

Dongyang Yu-yudongyang2022@gmail.com, Haoyue Zhang-hz625@cornell.edu, Ruisheng Zhao-rathenzrs@gmail.com, Guoqi Chen-276851182@qq.com, Wangpeng An-anwangpeng@gmail.com, Yanhong Yang-yyh@cueb.edu.cn

6D位姿估计人体姿态

MovePose针对移动端/边缘设备上人体姿态估计难以兼顾精度、延迟与本地隐私的问题,设计轻量CNN,并用可学习反卷积替代简单上采样、引入大核卷积扩大感受野,以及采用SimCC式坐标分类降低回归复杂度。其在COCO验证集达到68.0 mAP,在i9 CPU约69+ FPS、RTX3090约452+ FPS、骁龙8+ 4G安卓手机约11+ FPS;但各模块相对增益与真实多设备泛化仍需更多说明。

Pedestrian Environment Model for Automated Driving Figure 1
arXiv preprint2023-08-17

Pedestrian Environment Model for Automated Driving

PAGE 1, Adrian Holzbock1, Alexander Tsaregorodtsev1, Vasileios Belagiannis2

6D位姿估计

自动驾驶现有栅格图或目标列表难以表达行人手势与意图,影响人车安全交互。论文提出仅用单目相机和自定位构建行人环境模型:先估计2D人体骨架,再经匈牙利匹配与自车运动补偿跟踪,并融合连续帧恢复全局3D位置与姿态。在CARLA和nuScenes上相对位置误差约16%,近距离误差低于2米,消融显示位置细化是主要精度来源。

Exploiting Point-Wise Attention in 6D Object Pose Estimation Based on Bidirectional Prediction Figure 1
arXiv preprint2023-08-17

Exploiting Point-Wise Attention in 6D Object Pose Estimation Based on Bidirectional Prediction

PAGE 1, Yuhao Yang∗, Jun Wu∗, Yue Wang, Guangjian Zhang, Rong Xiong

6D位姿估计物体位姿

该文针对实例级6D位姿估计中过度依赖观测质量、遮挡下CAD先验利用不足的问题,提出双向对应预测网络:同时预测场景到模型与模型到场景的匹配,并用点级几何注意力显式建模两类点云的相关性;另以伪孪生网络减小特征分布差异带来的注意力噪声。在LineMOD、YCB-Video和Occ-LineMOD上,该方法较多种SOTA取得更高精度,尤其在严重遮挡场景鲁棒性提升明显。

View Consistent Purification for Accurate Cross-View Localization Figure 1
arXiv preprint2023-08-16

View Consistent Purification for Accurate Cross-View Localization

PAGE 1, Shan Wang1

Australian National University

6D位姿估计

针对自动驾驶中 GPS/SLAM 精度或成本受限、跨视角定位易受动态物体和季节变化干扰的问题,论文提出 PureACL:用车载单/多相机与卫星图进行稀疏视觉匹配,通过视角一致的地面关键点净化、去除离地目标,并引入相机内外参空间嵌入降低匹配歧义,再用可微 LM 优化 3DoF 位姿。在 KITTI 与 Ford Multi-AV Seasonal 上优于既有方法,中位横纵向误差低于 0.5m、航向误差低于 2°。

Learning Better Keypoints for Multi-Object 6DoF Pose Estimation Figure 1
arXiv preprint2023-08-15

Learning Better Keypoints for Multi-Object 6DoF Pose Estimation

PAGE 1, Yangzheng Wu, Michael Greenspan

RCV Lab, Dept. of Electrical and Computer Engineering, Ingenuity Labs, Queen’s University, Kingston, Ontario, Canada

6D位姿估计物体位姿

针对6DoF位姿估计中关键点长期由FPS或包围盒角点等启发式规则选取、只利用几何且可能不利于投票回归的问题,论文提出KeyGNet,用图网络结合颜色与几何学习预定义关键点,并以Wasserstein投票分布相似性和离散性联合约束,使关键点既分散又易回归。在7个数据集、3种投票式方法上均提升精度,Occlusion LINEMOD上PVN3D的ADD(S)提升16.4%,BOP核心数据集AR提升约1%到21.5%,并缩小单物体到多物体训练的性能差距。

Group Pose: A Simple Baseline for End-to-End Multi-person Pose Estimation Figure 1
arXiv preprint2023-08-14

Group Pose: A Simple Baseline for End-to-End Multi-person Pose Estimation

PAGE 1, Huan Liu1, 3* Qiang Chen2* Zichang Tan2

Institute of Information Science, Beijing Jiaotong University, Beijing Key Laboratory of Advanced Information Science and Network Technology, Beijing, China

6D位姿估计

针对现有 DETR 式多人姿态估计依赖复杂解码器、训练优化较重的问题,Group Pose 将每个人的 K 个关键点视为 N×K 个查询预测,并用实例查询为整个人体打分;核心洞察是跨实例且不同类型查询的交互帮助有限,因此用实例内自注意力和同类型跨实例自注意力替代全局自注意力。实验显示其无需人体框监督,在 MS COCO 与 CrowdPose 上优于或接近带框监督的复杂端到端方法,并具备更快速度。

4DRVO-Net: Deep 4D Radar-Visual Odometry Using Multi-Modal and Multi-Scale Adaptive Fusion Figure 1
arXiv preprint2023-08-12

4DRVO-Net: Deep 4D Radar-Visual Odometry Using Multi-Modal and Multi-Scale Adaptive Fusion

PAGE 1, Guirong Zhuo, Shouyi Lu, Huanyu Zhou, Lianqing Zheng, Mingyu Zhou, Lu Xiong∗

6D位姿估计相机位姿

针对4D雷达点云稀疏噪声大、雷达与相机关联不足以及动态物体干扰导致里程计误差的问题,4DRVO-Net以PWC式金字塔逐级位姿细化为框架,引入Radar-PointNet++、基于可变形注意力的自适应雷达-相机融合和速度引导点置信度估计。在VoD和自建数据集上,多数序列优于学习式与几何式基线,性能接近无建图优化的64线LiDAR A-LOAM。

Aggressive Aerial Grasping using a Soft Drone with Onboard Perception Figure 1
arXiv preprint2023-08-11

Aggressive Aerial Grasping using a Soft Drone with Onboard Perception

PAGE 1, Samuel Ubellacker1∗, Aaron Ray1, James M. Bern2, Jared Strader1, Luca Carlone1

Massachusetts Institute of Technology, Williams College

6D位姿估计航天器

针对高速空中抓取中刚性机械手需精确定位、接触冲击大且常依赖动捕的问题,论文将被动闭合的腱驱软夹爪与机载感知结合,用语义关键点、鲁棒3D位姿估计和平滑器驱动最小snap轨迹与自适应控制。系统在180次飞行中实现室内外多物体全机载视觉抓取,静态目标速度达2.0 m/s,并在动捕辅助下抓取0.3 m/s移动目标。

VERF: Runtime Monitoring of Pose Estimation with Neural Radiance Fields Figure 1
arXiv preprint2023-08-11

VERF: Runtime Monitoring of Pose Estimation with Neural Radiance Fields

PAGE 1, Dominic Maggio, Courtney Mario, Luca Carlone

6D位姿估计

针对单目相机位姿估计在自动驾驶、机器人和航天等高风险场景中缺乏独立运行时正确性监测的问题,VERF利用场景NeRF渲染新视角来判断估计位姿是否落在给定误差阈值内,并给出置信度;其VERF-Light通过三视图光流一致性消除尺度歧义,VERF-PnP则渲染NeRF双目图像并结合PnP/RANSAC。实验覆盖LLFF、Unitree A1和Blue Origin亚轨道火箭数据,显示方法可跨尺度工作,并在3090 GPU上低于0.5秒完成监测。

Toward Globally Optimal State Estimation Using Automatically Tightened Semidefinite Relaxations Figure 1
arXiv preprint2023-08-10

Toward Globally Optimal State Estimation Using Automatically Tightened Semidefinite Relaxations

Frederike Dümbgen, Connor Holmes, Ben Agro, Timothy D. Barfoot

6D位姿估计

机器人状态估计中的非线性最小二乘常依赖局部优化,而SDP松弛要达到全局最优又需人工寻找冗余约束。本文提出AUTOTIGHT与AUTOTEMPLATE,用采样自动判定/生成足以收紧松弛的约束模板,并扩展到更大问题。其在距离定位和立体相机位姿估计的仿真与真实数据上验证,可复现既有松弛且通常用更少约束获得代价紧性;部分场景未达到秩紧性。

How-to Augmented Lagrangian on Factor Graphs Figure 1
arXiv preprint2023-08-10

How-to Augmented Lagrangian on Factor Graphs

PAGE 1, Barbara Bazzana 1

6D位姿估计

针对传统因子图求解器主要处理无约束最小二乘、难以直接覆盖最优控制等带约束机器人问题,本文将增广拉格朗日封装为可插入图中的约束因子,使现有迭代最小二乘框架能统一处理等式/不等式约束。作者在位姿估计、旋转同步和伪全向平台MPC上验证,结果可与领域专用方法相当,真实机器人实验显示相较IPOPT有运行时间优势。

Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation Figure 1
arXiv preprint2023-08-10

Deep Fusion Transformer Network with Weighted Vector-Wise Keypoints Voting for Robust 6D Object Pose Estimation

PAGE 1, Jun Zhou1, Kai Chen2, Linlin Xu3, Qi Dou2, Jing Qin1

The Hong Kong Polytechnic University, The Chinese University of Hong Kong, University of Waterloo

6D位姿估计物体位姿

该文针对单帧 RGB-D 6D 位姿估计中颜色与深度难以有效融合、遮挡/反光/弱纹理导致特征缺失的问题,提出 DFTr 跨模态 Transformer,在多尺度上建模外观与几何的全局语义相关性;同时用带权向量式、非迭代投票替代传统关键点聚类以提升定位效率。实验在 MP6D、YCB-Video、LineMOD 和 Occlusion LineMOD 上优于多种 SOTA,且无需后处理,推理速度较 PVN3D/FFB6D 更快。

Robust Localization with Visual-Inertial Odometry Constraints for Markerless Mobile AR Figure 1
arXiv preprint2023-08-10

Robust Localization with Visual-Inertial Odometry Constraints for Markerless Mobile AR

PAGE 1, Changkun Liu

HKUST

6D位姿估计相机位姿

面向无标记移动 AR,论文针对 VIO 只能给相对位姿且会漂移、APR 快但易出现大误差的问题,提出 VIO-APR:用短时可靠的 ARKit VIO 相对运动检测 APR 预测可信度,并以筛选出的参考位姿修正漂移。作者采集含图像、SfM 真值和移动端 VIO 的室内外数据集,在 PoseNet、MS-Transformer 上验证,最高将中位位置/姿态误差降低 36%/29%,高精度帧比例最高提升 112%,Unity 原型端侧推理低于 100ms。

Double-chain Constraints for 3D Human Pose Estimation in Images and Videos Figure 1
arXiv preprint2023-08-10

Double-chain Constraints for 3D Human Pose Estimation in Images and Videos

PAGE 1, Hongbo Kang, Yong Wang, Mengyuan Liu, Doudou Wu, Peng Liu, Wenming Yang, Senior Member, IEEE

6D位姿估计人体姿态

针对由2D骨架提升到3D人体姿态时深度歧义强、单帧信息不足且GCN/Transformer分别偏局部或偏全局的问题,论文提出DC-GCT,用局部到全局与全局到局部双链约束结合GCN局部模块、自注意力全局模块和特征交互,并以目标帧嵌入低成本引入时序信息。在Human3.6M和MPI-INF-3DHP上取得SOTA,且在CPN检测2D输入下Human3.6M各动作类别均领先。

SEM-GAT: Explainable Semantic Pose Estimation using Learned Graph Attention Figure 1
arXiv preprint2023-08-07

SEM-GAT: Explainable Semantic Pose Estimation using Learned Graph Attention

PAGE 1, Efimia Panagiotaki1, Daniele De Martini2, Georgi Pramatarov2, Matthew Gadd2, Lars Kunze1

Cognitive Robotics Group and Mobile Robotics Group, Oxford Robotics Institute, Department of Engineering Science, University of Oxford, UK

6D位姿估计

针对激光点云配准中传统关键点匹配难以利用语义关系、动态图或全连接图计算负担较大的问题,SEM-GAT将语义实例与局部几何形态构造成轻量静态图,并用图注意力与跨图注意力为候选对应点赋置信度,再经加权SVD估计相对位姿。其在KITTI里程计上达到与基准方法相近的配准精度,同时轨迹更平滑、参数更少,并可通过注意力分析解释哪些语义结构贡献更大。

A Horse with no Labels: Self-Supervised Horse Pose Estimation from Unlabelled Images and Synthetic Prior Figure 1
arXiv preprint2023-08-07

A Horse with no Labels: Self-Supervised Horse Pose Estimation from Unlabelled Images and Synthetic Prior

PAGE 1, Jose Sosa, David Hogg

School of Computing, University of Leeds

6D位姿估计仿真到现实

针对动物3D姿态标注稀缺且合成到真实常依赖监督训练的问题,本文将人体自监督框架迁移到马,核心是仅用未标注真实图像和少量由CAD生成的2D姿态先验,通过对抗约束与几何一致性同时学习2D/3D姿态,无需真实姿态标注、合成图像或复杂3D模型。实验在Weizmann马图像上2D姿态PCK@0.05均值达43.50,优于同设定2D自监督基线,并能定性生成合理3D姿态且泛化到斑马。

Source-free Domain Adaptive Human Pose Estimation Figure 1
arXiv preprint2023-08-06

Source-free Domain Adaptive Human Pose Estimation

PAGE 1, Qucheng Peng, Ce Zheng, Chen Chen

Center for Research in Computer Vision, University of Central Florida

6D位姿估计人体姿态

针对合成数据训练的人体姿态模型迁移到真实域时需访问源数据、存在隐私与安全风险的问题,本文提出无源域自适应HPE任务,并设计源模型-中间模型-目标模型框架:一方面固定/调节源端知识以缓解遗忘和噪声,另一方面构建姿态空间概率表示,结合姿态对比学习与信息最大化降低关键点稀疏性。多个人体与手部姿态迁移基准上,该方法较现有DA和无源DA改造基线取得明显提升。

Diffusion-Augmented Depth Prediction with Sparse Annotations Figure 1
arXiv preprint2023-08-04

Diffusion-Augmented Depth Prediction with Sparse Annotations

PAGE 1, Jiaqi Li

School of AIA, Huazhong University, of Science and Technology, S-Lab, Nanyang Technological, University, Adobe Research

6D位姿估计彩色深度

本文针对自动驾驶中 LiDAR 深度标注极稀疏导致监督深度模型过拟合有效像素、产生物体凹陷和条纹伪影的问题,提出 DADP:在现有单目深度预测器旁加入类似扩散去噪的噪声预测器,利用其结构感知特征补足空间完整性,并设计对象引导完整性损失强化物体区域结构。该方法无需位姿估计或多相机,在 nuScenes、DDAD、KITTI 上提升深度结构与鲁棒性,并可插拔改进 DPT、MiDaS 等模型。

DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field Figure 1
arXiv preprint2023-08-04

DTF-Net: Category-Level Pose Estimation and Shape Reconstruction via Deformable Template Field

PAGE 1, Haowen Wang∗

State Key Laboratory of Networking, and Switching Technology, Beijing University of Posts and, Midea Group, Shanghai, China

6D位姿估计类别级位姿三维重建

论文针对开放场景中未见实例的类别级6D位姿估计与三维重建,指出静态类别先验难以覆盖类内形变且姿态与形变耦合会干扰特征学习。DTF-Net用可变形模板场以隐式神经场建模类别模板与实例几何变形,并共享这些特征进行位姿回归,同时加入多模态特征提取实现端到端推理。实验在REAL275和CAMERA25上优于既有方法,并展示可用于真实机械臂抓取。

Robust Self-Supervised Extrinsic Self-Calibration Figure 1
arXiv preprint2023-08-07

Robust Self-Supervised Extrinsic Self-Calibration

PAGE 1, Takayuki Kanai, Igor Vasiljevic, Vitor Guizilini, Adrien Gaidon, Rares Ambrus

Toyota Research Institute (TRI), Los Altos, CA

6D位姿估计

多相机自监督深度学习依赖精确外参,而传统标定需靶标或耗时 SfM/BA,难以适应车辆长期部署。论文提出 SESC:先用速度监督得到尺度一致的深度与自运动网络,再以光度一致性优化外参,并与深度、位姿联合训练。DDAD/KITTI 实验显示其在多种驾驶场景中比 COLMAP 更稳健,且联合自标定可进一步提升深度估计,但部分序列失效原因仍需结合场景分析。

Sim-to-Real Vision-depth Fusion CNNs for Robust Pose Estimation Aboard Autonomous Nano-quadcopter Figure 1
arXiv preprint2023-08-03

Sim-to-Real Vision-depth Fusion CNNs for Robust Pose Estimation Aboard Autonomous Nano-quadcopter

PAGE 1, ©2023 IEEE

6D位姿估计彩色深度仿真到现实

针对纳米四旋翼算力、载荷和传感器极受限,单目人体相对位姿估计鲁棒性不足的问题,论文在 Crazyflie 上加入 8×8 ToF 深度传感器,并设计仅用 Webots 仿真数据训练的彩色/深度融合轻量 CNN。通过强光照增强、标签均衡和多环境配置实现 sim-to-real,模型可在 GAP8 上以约45Hz、92mW运行;实地测试相较单目基线将水平位置和朝向平均误差分别降低58%和51%。

Active Acoustic Sensing for Robot Manipulation Figure 1
IROS 20232023-08-03

Active Acoustic Sensing for Robot Manipulation

Shihan Lu, Heather Culbertson

6D位姿估计机器人操作

针对视觉/触觉难以感知物体内部状态、融合系统不够紧凑的问题,论文把主动声学引入机器人夹爪:一侧振动激励、另一侧压电麦克风接收穿过物体后的波形,利用共振随材料、形状、抓取点和接触状态变化的物理关联来推断操作状态。实验对比实物与模态仿真信号,并在物体识别和抓取位置估计上做概念验证;但更大规模任务中的定量收益文中未充分说明。

HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructions Figure 1
arXiv preprint2023-08-02

HANDAL: A Dataset of Real-World Manipulable Object Categories with Pose Annotations, Affordances, and Reconstructions

PAGE 1

Andrew Guo, Bowen Wen, Jianhe Yuan, Jonathan Tremblay, Stephen Tyree, Jeffrey Smith, Stan Birchfield, NVIDIA

6D位姿估计手部姿态数据集/基准三维重建

面向机器人从简单抓取走向功能性操作时缺少可规模化标注的真实3D数据,HANDAL聚焦带手柄、适合操作的工具/厨具等类别,用普通相机与半自动流程生成跨视频对齐的6D位姿、尺度、分割、把手可供性和三维重建。数据集包含17类212个真实物体、约2.2k视频和308k标注帧,并含静态与人工操作动态场景;文中主要贡献是数据规模与标注完整性,未充分说明算法性能增益。

Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenes Figure 1
arXiv preprint2023-08-01

Human-M3: A Multi-view Multi-modal Dataset for 3D Human Pose Estimation in Outdoor Scenes

Bohao Fan, Siqi Wang, Wenxuan Guo, Wenzhao Zheng, Jianjiang Feng, Jie Zhou

Beijing National Research Center for Information Science and Technology, China, Department of Automation, Tsinghua University, China

6D位姿估计人体姿态数据集/基准多视角

针对室外 3D 人体姿态数据多为单模态、单视角或单人且标注易受定位/匹配误差影响的问题,Human-M3 构建了多相机+LiDAR的多视角、多模态、多人体数据集,并用点云检测跟踪辅助生成更可靠真值。数据含 89.6K 有效姿态,基准评测显示任务具挑战性,作者的多模态方法也验证了融合 RGB 与点云对姿态估计的优势。

Markerless human pose estimation for biomedical applications: a survey Figure 1
Frontiers in Computer Science 5, (2023): 11531602023-08-01

Markerless human pose estimation for biomedical applications: a survey

Andrea Avogaro, Federico Cunico, Bodo Rosenhahn, Francesco Setti

Department of Computer Science, University of Verona, Verona, Italy, Institute for Information Processing, Leibniz University Hannover, Hannover, Department of Engineering for Innovation Medicine, University of Verona, Verona

6D位姿估计人体姿态医学/手术综述

面向临床运动评估中有标记 MoCap 昂贵、侵入且难以远程部署的问题,本文系统梳理无标记人体姿态估计在生物医学中的适用性,而非提出新算法。核心洞察是按2D/3D、传感器、单/多人、实时性等特征评估其临床价值,并总结25类HPE方法和40余项在发育评估、神经肌肉康复、步态与姿态分析中的研究。结论认为其可降低诊疗与康复门槛、支持院外远程医疗,但精度和鲁棒性仍弱于标记式系统,关节速度、加速度和力等变量估计仍限制临床采用。

Kidnapping Deep Learning-based Multirotors using Optimized Flying Adversarial Patches Figure 1
arXiv preprint2023-08-01

Kidnapping Deep Learning-based Multirotors using Optimized Flying Adversarial Patches

PAGE 1, Pia Hanfeld1, Khaled Wahba2, Marina M.-C. H¨ohne3, Michael Bussmann1, Wolfgang H¨onig2

6D位姿估计

针对多旋翼依赖视觉深度网络进行人体/目标位姿估计、易被域外图像诱导而影响控制的问题,本文提出“飞行对抗补丁”:由攻击无人机携带多个可打印补丁,并联合优化补丁内容及其在相机图像中的位置,配合攻击策略操纵受害机轨迹。实验表明混合优化优于联合、拆分和固定位置基线,方法可随补丁数量扩展,并在双机真实飞行中使原本跟随人的无人机转而跟随攻击者设定轨迹。

Fine-Grained Sports, Yoga, and Dance Postures Recognition: A Benchmark Analysis Figure 1
arXiv preprint2023-08-01

Fine-Grained Sports, Yoga, and Dance Postures Recognition: A Benchmark Analysis

PAGE 1, JOURNAL OF LATEX CLASS FILES, VOL. 00, NO. 0, FEB 2023

Asish Bera, Member, IEEE, Mita Nasipuri, Life Senior Member, IEEE

6D位姿估计数据集/基准

该文针对体育、瑜伽、舞蹈细粒度姿态类别类间差异小、类内变化大且缺少公开基准的问题,构建 Sports-102 与 Dance-12,并联合 Yoga-82/107 评测。方法上提出在常规 CNN 上加入多尺度 patch-based attention 与随机擦除,以建模局部语义关联。实验称在 Yoga-82/107 达到 SOTA,其他数据集表现较好;但任务更接近姿态图像分类而非严格 6D 位姿估计。

Lightweight Super-Resolution Head for Human Pose Estimation Figure 1
arXiv preprint2023-07-31

Lightweight Super-Resolution Head for Human Pose Estimation

PAGE 1, Haonan Wang

State Key Laboratory for Novel Software Technology, Nanjing University

6D位姿估计人体姿态

本文针对热图式人体姿态估计在低分辨率热图上存在量化误差、依赖后处理或昂贵上采样的问题,将骨干网络视为退化过程,把热图预测重表述为超分辨率任务。其提出轻量 SR head,并在 SRPose 中由低分辨率热图与退化特征逐级恢复到高分辨率热图,同时用于中间监督。COCO、MPII 和 CrowdPose 实验显示,该方法可提升对应 top-down 方法,SR head 也能增强 bottom-up 方法。

DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation Figure 1
ICCV 20232023-07-31

DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimation

Runyang Feng, Yixing Gao, Tze Ho Elden Tse, Xueqing Ma, Hyung Jin Chang

School of Artificial Intelligence, Jilin University, Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Ministry of Education, China, School of Computer Science, University of Birmingham

6D位姿估计人体姿态

视频人体姿态估计中,扩散模型需同时处理跨帧时序依赖并抑制背景等无关线索。DiffPose将关键点热图生成建模为条件去噪过程,用时空表征学习器聚合多帧证据,并通过基于查找的多尺度特征交互把表示集中到关节区域;推理时还可融合多次采样、调整去噪步数而无需重训。在PoseTrack2017/2018/21上取得新的SOTA,尤其提升困难关节的鲁棒性。

Touch if it's transparent! ACTOR: Active Tactile-based Category-Level Transparent Object Reconstruction Figure 1
arXiv preprint2023-07-30

Touch if it's transparent! ACTOR: Active Tactile-based Category-Level Transparent Object Reconstruction

PAGE 1, Prajval Kumar Murali, Bernd Porr, Mohsen Kaboli

6D位姿估计类别级位姿三维重建

针对透明物体因非朗伯表面导致视觉重建和位姿感知不可靠的问题,ACTOR改用主动触觉获取稀疏接触点,并用ShapeNet同类合成点云自监督训练带自注意力编码器和上采样解码器的重建网络,以降低真实触觉数据需求;同时以信息增益选择下一次触摸,并扩展TIQF做类别级6D位姿与尺度估计。真实机器人实验显示其在触觉重建和位姿估计上优于GPIS等基线,但具体增益中合成数据先验贡献占比文中未充分说明。

Successive Pose Estimation and Beam Tracking for mmWave Vehicular Communication Systems Figure 1
arXiv preprint2023-07-30

Successive Pose Estimation and Beam Tracking for mmWave Vehicular Communication Systems

PAGE 1, Cen Liu∗, Guangxu Zhu, Fan Liu, Yuanwei Liu, Kaibin Huang

National University of Singapore, Singapore, Shenzhen Research Institute of Big Data, Shenzhen, China, Southern University of Science and Technology, Shenzhen, China, Queen Mary University of London, London, U.K, The University of Hong Kong, Hong Kong

6D位姿估计

面向高速车联网毫米波通信中频繁波束训练开销过高的问题,论文提出SPEBT流程:先用车载毫米波雷达点云经Fast-CFEAR估计车辆2D位置与航向角,再将位姿输入扩展卡尔曼滤波器跟踪LoS信道波束。其洞察是利用雷达在恶劣天气、弱光和GNSS受限场景下的稳健自定位来辅助通信。基于Oxford Radar RobotCar等真实感知数据的仿真显示,方法能给出较准位姿与波束跟踪结果,并将平均波束训练占比降至5%以下。

Iterative Graph Filtering Network for 3D Human Pose Estimation Figure 1
arXiv preprint2023-07-29

Iterative Graph Filtering Network for 3D Human Pose Estimation

PAGE 1, Zaedul Islam, A. Ben Hamza

Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada

6D位姿估计人体姿态

针对GCN用于3D人体姿态估计时共享权重难以刻画复杂关节关系、深层易丢失输入信息和过平滑的问题,论文从带拉普拉斯正则的图滤波Gauss-Seidel迭代推导出GS-Net,并结合权重/邻接调制、跳连和类ConvNeXt卷积块做2D到3D lifting。在两个标准数据集上优于多种基线并达到SOTA,消融显示邻接调制与跳连是主要增益来源。

HandMIM: Pose-Aware Self-Supervised Learning for 3D Hand Mesh Estimation Figure 1
arXiv preprint2023-07-29

HandMIM: Pose-Aware Self-Supervised Learning for 3D Hand Mesh Estimation

PAGE 1, Zuyan Liu

ByteDance

6D位姿估计手部姿态

针对3D手网格标注昂贵、现有半/自监督方法依赖检测器或难以让MIM适配位姿回归的问题,HandMIM将教师-学生自蒸馏与遮挡图像建模结合,引入伪关键点对齐学习跨视角的位姿等变语义,并同时做token恢复和像素重建;微调时仅用vanilla ViT接PyMAF回归MANO参数。在FreiHAND和HO3Dv2上分别达到6.29mm、8.00mm PAVPE,并显著提升不同规模ViT的PAJPE。

Effective Whole-body Pose Estimation with Two-stages Distillation Figure 1
arXiv preprint2023-07-29

Effective Whole-body Pose Estimation with Two-stages Distillation

PAGE 1, Zhendong Yang1

Tsinghua Shenzhen International Graduate School, International Digital Economy Academy (IDEA)

6D位姿估计人体姿态

面向全身姿态估计中手、脸等小尺度关键点难定位、标注数据不足且部署需轻量化的问题,DWPose在RTMPose上提出两阶段蒸馏:先用教师中间特征和包含可见/不可见关键点的logits训练学生并衰减蒸馏权重,再冻结骨干进行头部自蒸馏,并引入UBody增强手势与表情多样性。在COCO-WholeBody上,RTMPose-l AP由64.8%提升到66.5%,超过65.3%的RTMPose-x教师模型。

TrackAgent: 6D Object Tracking via Reinforcement Learning Figure 1
arXiv preprint2023-07-28

TrackAgent: 6D Object Tracking via Reinforcement Learning

PAGE 1, Konstantin R¨ohrl1, Dominik Bauer1, Timothy Patten3, Markus Vincze1

Columbia University, United States, Abyss Solutions Pty Ltd, Australia

6D位姿估计物体位姿

针对动态场景中6D物体跟踪易受漂移、丢失后恢复困难且RGB(D)方法复杂/依赖大量序列数据的问题,TrackAgent将任务简化为仅用深度点云的强化学习对齐:联合帧间配准与帧到模型细化,并用渲染掩码传播和策略不确定性触发重初始化。在YCB-Video上达到深度跟踪SOTA,显著优于单独配准或细化,并缩小了与RGBD跟踪器的差距。

Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation Figure 1
arXiv preprint2023-07-28

Revisiting Fully Convolutional Geometric Features for Object 6D Pose Estimation

Italy

6D位姿估计物体位姿

本文针对6D位姿估计中过度依赖关键点或端到端姿态回归、而点级判别特征学习不足的问题,将FCGF改造为FCGF6D:用稀疏卷积统一处理彩色点云,面向物体/场景异构点云修改 hardest contrastive loss,并通过遮挡相关增强和训练策略提升合成到真实泛化。方法可在整场景上为每个数据集训练单模型,LMO上ADD(S)-0.1d提升3.5,YCBV上ADD-S AUC提升0.8;消融显示主要增益来自损失、RGB输入和优化器调整。

Robust Visual Sim-to-Real Transfer for Robotic Manipulation Figure 1
arXiv preprint2023-07-28

Robust Visual Sim-to-Real Transfer for Robotic Manipulation

PAGE 1, Ricardo Garcia1, Robin Strudel1, Shizhe Chen1, Etienne Arlaud1, Ivan Laptev1, Cordelia Schmid1

6D位姿估计机器人操作仿真到现实

针对仿真训练视觉操作策略在真实机器人上易因外观差异失效的问题,论文系统研究视觉域随机化,并提出用离线立方体定位代理任务选择纹理、光照、物体颜色和相机参数,从而避免反复真实机器人调参。该设置在堆叠、装配、推扫、绳形塑等七类任务上可直接迁移,真实机器人平均成功率达93%,且对真实场景外观变化的鲁棒性优于有限真实数据训练的策略。

Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving Figure 1
arXiv preprint2023-07-27

Weakly Supervised Multi-Modal 3D Human Body Pose Estimation for Autonomous Driving

Peter Bauer, Arij Bouazizi, Ulrich Kressel, Fabian B. Flohr

6D位姿估计人体姿态

面向自动驾驶中行人/骑行者姿态理解,论文针对户外3D人体关键点标注昂贵且跨域数据不适配的问题,提出相机2D关键点与稀疏LiDAR点云的高层融合网络,并用现成2D检测器和LiDAR投影生成伪标签,在目标数据集上无需2D/3D关键点标注训练。Waymo实验显示弱监督设置较既有方法最高提升约13%,监督设置也达到当时SOTA。

CBGL: Fast Monte Carlo Passive Global Localisation of 2D LIDAR Sensor Figure 1
arXiv preprint2023-07-28

CBGL: Fast Monte Carlo Passive Global Localisation of 2D LIDAR Sensor

Alexandros Filotheou

Aristotle University of Thessaloniki, Thessaloniki, Greece

6D位姿估计点云

针对移动机器人初始位姿未知且不希望通过主动运动采集额外信息的全局定位问题,CBGL 用单次 Monte Carlo 生成大量2D LiDAR位姿假设,并利用 CAER 指标从真实/虚拟扫描中排序误差层级,再以 scan-to-map-scan 匹配细化估计。实测与仿真表明其在不同环境和传感器条件下,比既有全局定位方法有更高位姿发现率且运行更快。

Deep Robust Multi-Robot Re-localisation in Natural Environments Figure 1
IROS 20232023-07-26

Deep Robust Multi-Robot Re-localisation in Natural Environments

Milad Ramezani, Ethan Griffiths, Maryam Haghighat, Alex Pitt, Peyman Moghadam

Milad Ramezani1, Ethan Griffiths1,2, Maryam Haghighat2, Alex Pitt1, Peyman Moghadam1,2

6D位姿估计机器人操作

面向森林等自然环境中单一视觉或激光易因外观变化、结构重复而重定位失败的问题,论文提出 R3Loc:先用 EgoNN 在 Wildcat 生成的激光子图中做地点检索与 6DoF 相对位姿估计,再引入自监督图像-激光 2D-3D 特征匹配作为假设验证,判断估计变换是否错位。离线大规模自然数据和真实机器人在线实验表明,该跨模态验证能提升多机器人重定位的鲁棒性。

Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Prior Figure 1
arXiv preprint2023-07-25

Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Prior

PAGE 1, Jose Sosa1, Sharn Perry2, Jane Alty2, David Hogg1

School of Computing, University of Leeds, United Kingdom, Wicking Dementia Research and Education Centre, College of Health and, Medicine, University of Tasmania, Australia

6D位姿估计仿真到现实

针对动物行为视频大量缺少姿态标注、监督式鼠类姿态估计训练成本高的问题,本文将人类自监督2D姿态GAN框架改造到小鼠骨架,并用合成3D小鼠模型生成未配对2D姿态先验,从而在未标注真实图像上训练。实验在新小鼠视频数据集上与人工标注真值和监督式动物姿态方法比较,结果显示无配对训练数据下仍具可用表现,并在马图像上给出跨物种适配的定性潜力。

TransNet: Transparent Object Manipulation Through Category-Level Pose Estimation Figure 1
arXiv preprint2023-07-23

TransNet: Transparent Object Manipulation Through Category-Level Pose Estimation

PAGE 1, Huijie Zhang1

6D位姿估计类别级位姿机器人操作

透明物体因外观依赖背景且深度传感器常失效,给抓取、倒液等操作所需的6D位姿带来困难。TransNet抓住同类透明物体形态更相似的洞察,转向类别级位姿估计,通过实例分割、局部深度补全、表面法线估计与Pointformer特征嵌入联合预测6D位姿和尺度。实验显示其在大型透明物体数据集上优于类别级基线,并能支撑机器人完成拾放和倒液任务。

FDCT: Fast Depth Completion for Transparent Objects Figure 1
IEEE Robotics and Automation Letters (RA-L), 20232023-07-23

FDCT: Fast Depth Completion for Transparent Objects

Tianan Li, Zhehan Chen, Huan Liu, Chen Wang

6D位姿估计彩色深度

透明物体因反射、折射导致RGB-D深度缺失或噪声大,现有补全方法又常依赖多网络或全局优化,难以实时部署。FDCT以原始RGB-D为输入,通过轻量化端到端结构、低层特征融合分支、跨层快捷连接和抑制过拟合的损失函数,在利用边缘等局部线索的同时控制计算量。实验显示其约70 FPS运行,精度较SOTA至少提升16%,并能改善透明物体位姿估计与抓取表现。

Challenges for Monocular 6D Object Pose Estimation in Robotics Figure 1
arXiv preprint2023-07-22

Challenges for Monocular 6D Object Pose Estimation in Robotics

Stefan Thalhammer * —, Dominik Bauer * —, Peter Hönig * —, Jean-Baptiste Weibel * —, José García-Rodríguez * —, Markus Vincze * —

6D位姿估计物体位姿机器人操作数据集/基准

本文聚焦机器人操作中的单目 6D 物体位姿估计,动机是 RGB 传感器低成本且适合开放场景,但既有综述范围过宽,难以暴露单目方法的机器人特有难题。作者梳理近年机器人与视觉论文及常用数据集,指出封闭世界下域迁移等问题已较充分研究,而遮挡、位姿表示、类别级/新物体、多物体、折射材料与不确定性仍是关键瓶颈;并强调需要更真实基准、场景级与本体推理及降低算法生态成本。

Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlap Figure 1
arXiv preprint2023-07-22

Pyramid Semantic Graph-based Global Point Cloud Registration with Low Overlap

PAGE 1, Zhijian Qiao, Zehuan Yu, Huan Yin, Shaojie Shen

6D位姿估计点云

针对机器人重定位、闭环等全局点云配准中因视角变化和遮挡导致的低重叠、高外点问题,本文提出 Pagor:用语义地标缩小稠密点云规模,并以多一致性阈值构建金字塔语义图,生成多个候选位姿,再用 GNC 与稠密几何验证筛选结果。自采室内数据和 KITTI 实验显示,其在低重叠、语义质量不高时取得最高配准成功率。

Robot Structure Prior Guided Temporal Attention for Camera-to-Robot Pose Estimation from Image Sequence Figure 1
arXiv preprint2023-07-22

Robot Structure Prior Guided Temporal Attention for Camera-to-Robot Pose Estimation from Image Sequence

PAGE 1, Yang Tian* 1, Jiyao Zhang* 1, Zekai Yin* 1, Hao Dong† 1

Center on Frontiers of Computing Studies, School of Computer Science, Peking University, Beijing Academy of Artificial Intelligence, National Key Laboratory for Multimedia Information Processing, School of CS, PKU

6D位姿估计机器人操作

面向在线手眼标定中单目图像易受机械臂自遮挡和视角歧义影响的问题,SGTAPose利用连续帧中相机到机器人位姿近似不变的特点,引入机器人结构先验进行时序特征对齐与交叉注意力融合,再由关键点PnP并结合结构约束迭代细化位姿。论文在合成、真实数据和抓取任务中优于既有在线方法及传统手眼标定,报告36 FPS实时速度和约5mm级多帧标定误差。

LAMP: Leveraging Language Prompts for Multi-person Pose Estimation Figure 1
arXiv preprint2023-07-21

LAMP: Leveraging Language Prompts for Multi-person Pose Estimation

Shengnan Hu, Ce Zheng, Zixiang Zhou, Chen Chen, Gita Sukthankar

6D位姿估计

面向社交机器人在拥挤场景中理解周围行人的需求,论文聚焦多人姿态估计中遮挡关节和实例分离困难。LAMP 将 CLIP 文本提示引入单阶段姿态估计,用实例级提示描述人物位置与遮挡状态,用关节级提示对齐身体关键点,并通过图文相关性监督增强视觉特征。实验在 OCHuman 和 CrowdPose 上优于既有单阶段和自底向上方法,并接近强自顶向下方法,消融显示两类提示均有贡献。

YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimation Figure 1
arXiv preprint2023-07-21

YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimation

PAGE 1, Arul Selvam Periyasamy, Arash Amini, Vladimir Tsaturyan, Sven Behnke

Autonomous Intelligent Systems, University of Bonn, Germany

6D位姿估计

面向机器人抓取等场景中多物体6D位姿需实时且端到端估计的问题,YOLOPose V2将DETR式集合预测用于单目RGB位姿估计,直接回归2D关键点,并用可学习MLP替代传统PnP估计旋转、另设平移头;论文还分析object query的区域专化现象,并探索更小训练集的精度代价。在YCB-Video上其精度接近主流方法,同时报告最快推理速度。

KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimation Figure 1
arXiv preprint2023-07-21

KVN: Keypoints Voting Network with Differentiable RANSAC for Stereo Pose Estimation

Ivano Donadi, Alberto Pretto

Manuscript received: July 16, 2023; Revised

6D位姿估计多视角

针对单目缺深度、RGB-D难处理透明/反光物体,以及传统RANSAC+PnP不可微导致关键点对应难以按最终误差训练的问题,KVN在PVNet中加入可微RANSAC层,并用不确定性驱动的多视角PnP融合双目关键点。其在公开TOD和自建透明餐具TTD数据集上达到SOTA,消融显示可微RANSAC对精度提升贡献明显。

Semantically-enhanced Deep Collision Prediction for Autonomous Navigation using Aerial Robots Figure 1
arXiv preprint2023-07-21

Semantically-enhanced Deep Collision Prediction for Autonomous Navigation using Aerial Robots

PAGE 1, Mihir Kulkarni, Huan Nguyen, Kostas Alexis

6D位姿估计机器人操作航天器

针对无人机在杂乱场景中依赖高精地图、完整位姿且难以感知细杆/电线等薄障碍的问题,论文提出语义增强VAE,将真实与仿真深度图压缩为保留薄障碍和无效深度信息鲁棒性的潜表示,再结合部分运动状态训练不确定性感知3D碰撞预测网络,为运动基元打分。仿真和两组真实实验显示其相较端到端ORACLE基线在含多类薄障碍环境中导航更稳健。

SimCol3D -- 3D Reconstruction during Colonoscopy Challenge Figure 1
arXiv preprint2023-07-20

SimCol3D -- 3D Reconstruction during Colonoscopy Challenge

Anita Rau, Sophia Bano, Yueming Jin, Pablo Azagra, Javier Morlana, Rawen Kader, Edward Sanderson, Bogdan J. Matuszewski, Jae Young Lee, Dong-Jae Lee, Erez Posner, Netanel Frank, Varshini Elangovan, Sista Raviteja, Zhengwen Li, Jiquan Liu, Seenivasan Lalithkumar, Mobarakol Islam, Hongliang Ren, Laurence B. Lovat, José M.M. Montiel, Danail Stoyanov

Department of Biomedical Data Science, Stanford University, Stanford, California, USA, National University of Singapore, Singapore, University of Zaragoza, Zaragoza, Spain, Computer Vision and Machine Learning (CVML) Group, University of Central Lancashire, Preston, UK, Korea Advanced Institute of Science and Technology, Daejeon, Korea, College of Engineering, Guindy, India, Indian Institute of Technology Kharagpur, Kharagpur, India, Imperial College London, London, UK, The Chinese University of Hong Kong, HK, China

6D位姿估计数据集/基准三维重建

针对结肠镜视频中光照伪影、组织形变和真实深度/位姿标注稀缺导致三维重建困难的问题,SimCol3D构建了面向单目结肠镜深度预测与6D相机位姿估计的EndoVis基准,包含合成与真实序列并设置三项子任务。挑战结果显示,合成图像上的深度估计已较稳定可解,但无论合成还是真实场景的位姿估计仍表现不足,是后续重建系统的主要瓶颈。

MSQNet: Actor-agnostic Action Recognition with Multi-modal Query Figure 1
arXiv preprint2023-07-20

MSQNet: Actor-agnostic Action Recognition with Multi-modal Query

Anindya Mondal, Sauradip Nag, Joaquin M Prada, Xiatian Zhu, Anjan Dutta

6D位姿估计

针对现有动作识别依赖人或动物专用姿态估计、难以处理多主体差异和多标签共现的问题,MSQNet将多标签动作分类改写为DETR式目标检测任务,用视觉特征与类别文本构造多模态语义查询,从而避免显式6D/骨架类姿态建模。实验在5个公开人类与动物动作基准上均优于专用方法,最高提升约50%。

POV-Surgery: A Dataset for Egocentric Hand and Tool Pose Estimation During Surgical Activities Figure 1
arXiv preprint2023-07-19

POV-Surgery: A Dataset for Egocentric Hand and Tool Pose Estimation During Surgical Activities

PAGE 1, Rui Wang, Sophokles Ktistakis, Siwei Zhang, Mirko Meboldt, Quentin

Lohmeyer ETH Zurich, Zurich, Switzerland

6D位姿估计手部姿态数据集/基准医学/手术

面向MR导航、技能评估和机器人辅助手术中的第一视角手—器械6D/3D位姿估计,论文指出真实手术因血迹手套、反光金属器械和遮挡而难以标注。其核心是用多视角动捕、手—工具抓取生成与渲染构建时序合成数据集POV-Surgery,含53段、88329帧RGB-D及姿态/分割标注。实验显示现有SOTA在该场景受限,经该数据微调后在合成与真实手术样例上均显著提升,但增益可能主要来自领域数据补足。

ActionPrompt: Action-Guided 3D Human Pose Estimation With Text and Pose Prompting Figure 1
arXiv preprint2023-07-18

ActionPrompt: Action-Guided 3D Human Pose Estimation With Text and Pose Prompting

PAGE 1, Hongwei Zheng∗, Han Li∗, Bowen Shi∗, Wenrui Dai∗, Botao Wang, Yu Sun, Min Guo, Hongkai Xiong∗

Shanghai Jiao Tong University, Shanghai, China, Qualcomm AI Research, Shanghai, China

6D位姿估计人体姿态

该文针对视频式 2D-to-3D 人体姿态估计只利用时序一致性、忽略动作先验导致深度歧义的问题,提出可插拔 Action Prompt Module:用动作文本提示引入 CLIP 类语言知识,并用动作特定姿态提示学习位置相关模式来细化特征。其在 VPose、A3DHP、MixSTE 等框架和 Human3.6M、HumanEva-I 上均带来稳定提升,平均 MPJPE 增益超过 5%,对高误差困难动作更明显。

Human Emergency Detection during Autonomous Hospital Transports Figure 1
arXiv preprint2023-07-17

Human Emergency Detection during Autonomous Hospital Transports

PAGE 1, Andreas Zachariae1, Julia Widera1, Frederik Plahl1, Bj¨orn Hein1, and

Karlsruhe University of Applied Sciences, Germany

6D位姿估计

论文面向医院自主转运中护士负担重且需保障患者安全的问题,提出仅用移动机器人上的 RGB-D 相机,经 OpenPose 提取人体关键点并训练分类器检测跌倒、昏迷等紧急状态;其主要贡献是发布含步行、助行器和轮椅场景的 PeTRA 数据集,并在动态多人环境中建立基线。结果显示,SVM 在步行场景单帧紧急召回率达 95.8%,但轮椅场景仅 62.2%,说明坐姿昏迷等细微异常仍是主要瓶颈。

Self-supervised Monocular Depth Estimation: Let's Talk About The Weather Figure 1
arXiv preprint2023-07-17

Self-supervised Monocular Depth Estimation: Let's Talk About The Weather

PAGE 1, Kieran Saunders

Aston University, Loughborough University

6D位姿估计彩色深度

针对自监督单目深度在KITTI等晴天数据上训练、遇到雨雾夜间等域偏移即失效的问题,本文指出普通增强会同时污染自监督输入和“标签”,并提出Robust-Depth:利用原图与增强图的对应关系,对深度和位姿加入伪监督一致性损失,配合天气/时间/裁剪等增强。实验显示其在KITTI保持或达到SotA,同时在DrivingStereo、Foggy CityScape和NuScenes-Night等恶劣条件上显著优于既有方法。

Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformer Figure 1
arXiv preprint2023-07-20

Boosting 3-DoF Ground-to-Satellite Camera Localization Accuracy via Geometry-Guided Cross-View Transformer

PAGE 1, Yujiao Shi1, Fei Wu1, Akhil Perincherry2, Ankit Vora2, Hongdong Li1

The Australian National University

6D位姿估计航天器

针对地面到卫星图像检索只能给出粗略相机位姿、且联合优化易陷入局部最小的问题,论文将3-DoF定位拆成旋转与平移两步:用几何引导跨视角Transformer合成俯视特征,并以神经位姿优化估计旋转,再通过不确定性引导的空间相关在全搜索空间生成车辆位置概率图。实验在多个基准优于现有方法,KITTI上1m横向定位成功率由35.54%升至76.44%,1°朝向成功率由19.64%升至99.10%。

Tightly-Coupled LiDAR-Visual SLAM Based on Geometric Features for Mobile Agents Figure 1
arXiv preprint2023-07-15

Tightly-Coupled LiDAR-Visual SLAM Based on Geometric Features for Mobile Agents

Ke Cao 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ruiping Liu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Ze Wang 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Kunyu Peng 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Jiaming Zhang 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Junwei Zheng 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Zhifeng Teng 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Kailun Yang 2, 2 ^ start_FLOATSUPERSCRIPT 2, end_FLOATSUPERSCRIPT, Rainer Stiefelhagen 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计相机位姿点云

面向移动机器人在弱光、运动模糊或退化场景中单一视觉/激光 SLAM 易失效的问题,论文提出相机-LiDAR 紧耦合框架,以球坐标统一时空对齐线、面等几何特征;用激光深度与语义补充视觉线地标,并在 BA 中加入线方向约束,同时用视觉整线修正激光局部线特征、剔除外点。M2DGR 室内外实验显示其位姿估计较 PLP-SLAM、MULLS、LVI-SAM 等更准确且更稳健。

Haptic-guided assisted telemanipulation approach for grasping desired objects from heaps Figure 1
arXiv preprint2023-07-13

Haptic-guided assisted telemanipulation approach for grasping desired objects from heaps

PAGE 1, Maxime Adjigble

Extreme Robotics Laboratory, University of Birmingham

6D位姿估计机器人操作

面向从杂乱堆叠中远程抓取指定物体时反馈不足、6DoF 控制复杂和抓取选择困难的问题,本文将基于谱表示的目标6D位姿估计、仅针对用户选中物体的 SpectGRASP 抓取规划、考虑夹爪位置与姿态的动态重排序,以及力/位置混合触觉引导控制集成到双边遥操作中。真实7DoF协作臂实验表明,该系统能辅助操作者完成杂乱场景清理,但量化效率增益幅度文中未充分说明。

Improving 2D Human Pose Estimation across Unseen Camera Views with Synthetic Data Figure 1
arXiv preprint2023-07-13

Improving 2D Human Pose Estimation across Unseen Camera Views with Synthetic Data

Miroslav Purkrabek

Visual Recognition Group, Department of Cybernetics, Czech Technical University in Prague

6D位姿估计人体姿态仿真到现实

现有2D人体姿态数据多来自正/侧/背等常见视角,导致俯视、仰视等极端相机视角下泛化不足。论文提出基于SMPL的RePoGen,强调可控生成稀有视角与更宽分布姿态,甚至不强求完全解剖合理。将其合成数据加入COCO微调ViTPose后,在顶/底视真实测试集上优于既有方法,同时基本不损害常见视角性能。

Deep learning-based estimation of whole-body kinematics from multi-view images Figure 1
arXiv preprint2023-07-12

Deep learning-based estimation of whole-body kinematics from multi-view images

Kien X. Nguyen, Liying Zheng, Ashley L. Hawke, Robert E. Carey, Scott P. Breloff, Kang Li, Xi Peng

Department of Computer & Information Science, University of Delaware, Newark, DE, USA, Health Effects Laboratory Division, National Institute for Occupational Safety and Health, Morgantown, WV, USA, Department of Orthopaedics, Rutgers New Jersey Medical School, Newark, New Jersey, USA

6D位姿估计人体姿态多视角

该文针对职业工效与损伤风险评估中仅估计3D关节位置不足、逆运动学求角度不唯一且难恢复肢段轴向旋转的问题,提出从同步多视角图像端到端直接估计全身关节角。方法将2D特征反投影为体素表示,并把旋转监督映射到连续且唯一的SO(3)空间;同时构建屋顶作业运动学数据集。实验在Roofing与Human3.6M上分别达到7.19°和8.41°平均角度误差。

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Figure 1
arXiv preprint2023-07-12

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human

PAGE 1, Pose Estimation from Monocular Video

The Hong Kong Polytechnic University, Shenzhen University

6D位姿估计

论文针对单目视频2D到3D人体姿态提升中,现有方法偏重估计2D姿态而未充分利用真实2D姿态下的结构建模问题,提出GLA-GCN:用自适应GCN建模全局时空骨架表示,并通过独立连接层回溯各关节局部特征。其在Human3.6M、HumanEva-I和MPI-INF-3DHP上相对SOTA最高降低约3%、17%、14%误差,但主要结论依赖GT 2D输入。

TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinement Figure 1
arXiv preprint2023-07-09

TransPose: A Transformer-based 6D Object Pose Estimation Network with Depth Refinement

Mahmoud Abdulsalam 5, Nabil Aouf

Department of Engineering, School of Science and Technology, City, University of London, ECV1 HB London, United Kingdom

6D位姿估计物体位姿彩色深度

面向机器人抓取尤其农业采摘中仅凭视觉获得精确6D位姿的需求,TransPose将DETR式Transformer检测/回归与轻量单目深度估计结合:先由RGB图像预测目标中心、ROI和初始位姿,再用估计深度块细化平移与最终6D位姿。论文在YCB-Video和自建水果数据上报告优于多种既有方法,但具体增益中深度细化与网络结构各自贡献仍需更多消融支撑。

ResMatch: Residual Attention Learning for Local Feature Matching Figure 1
arXiv preprint2023-07-11

ResMatch: Residual Attention Learning for Local Feature Matching

Yuxin Deng, Jiayi Ma

the Electronic Information School, Wuhan University, Wuhan, 430072, China (e-mail

6D位姿估计

针对 SuperGlue 等注意力特征匹配方法缺少可解释性且全局注意力开销高的问题,ResMatch 将交叉注意力解释为匹配、自注意力解释为基于场一致性的过滤,并把描述子相似度与相对位置作为旁路先验注入注意力分数,使网络学习残差匹配/过滤函数;sResMatch 进一步用 KNN 邻域稀疏注意力把复杂度降至 O(kN)。实验覆盖特征匹配、位姿估计和视觉定位,显示性能优于基线且稀疏版在效率与精度间更均衡。

Proximity and Visuotactile Point Cloud Fusion for Contact Patches in Extreme Deformation Figure 1
arXiv preprint2023-07-07

Proximity and Visuotactile Point Cloud Fusion for Contact Patches in Extreme Deformation

Jessica Yin, Paarth Shah, Naveen Kuppuswamy, Andrew Beaulieu, Avinash Uttamchandani, Alejandro Castro, James Pikul, Russ Tedrake

Foundation Emerging Frontiers in Research and Innovation

6D位姿估计点云

针对传统视触觉传感在大形变下依赖小变形力学模型、难以可靠分割接触斑的问题,本文利用选择性透光软膜同时获取近距深度点云与触觉点云,将两者交叠直接视为接触区域,绕开膜力学建模。在10%、60%和100%+应变实验中,该融合方法平均接触几何RMSE低于2.8 mm,优于近距、触觉阈值和力学模型基线,并用于闭环控制与位姿估计。

Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimation Figure 1
arXiv preprint2023-07-07

Back to Optimization: Diffusion-based Zero-Shot 3D Human Pose Estimation

Zhongyu Jiang, Zhuoran Zhou, Lei Li, Wenhao Chai, Cheng-Yen Yang, Jenq-Neng Hwang

University of Washington1, University of Copenhagen2

6D位姿估计人体姿态

本文针对学习式3D人体姿态估计在跨域和野外场景中会隐式绑定相机内参与数据集姿态先验、泛化下降的问题,提出ZeDO:在推理时把预训练扩散姿态生成模型作为人体约束/去噪先验,并与最小化2D关键点重投影误差的逐例优化循环结合,实现无需2D-3D或图像-3D配对训练的零样本估计。实验中多假设版本在Human3.6M达minMPJPE 51.4mm,单假设跨数据集在3DPW达PA-MPJPE 40.3mm。

Equivariant Single View Pose Prediction Via Induced and Restricted Representations Figure 1
arXiv preprint2023-07-07

Equivariant Single View Pose Prediction Via Induced and Restricted Representations

Owen Howell, David Klee, Ondrej Biza, Linfeng Zhao, Robin Walters

Department of Electrical and Computer Engineering, Northeastern University, Boston MA, Khoury College of Computer Sciences, Northeastern University, Boston MA

6D位姿估计

这篇论文针对单目图像难以直接施加 SO(3) 等变性的问题,指出从 2D 学习 3D 表示至少应满足由平面内旋转诱导的 SO(2) 一致性约束。作者用诱导/限制表示统一刻画从平面特征到球面信号的等变投影,并提出可学习的 induction/restriction 层,证明既有多种姿态网络是其特例。实验在 PASCAL3D+ 与 SYMSOL 的姿态估计上达到 SOTA。

RCDN -- Robust X-Corner Detection Algorithm based on Advanced CNN Model Figure 1
arXiv preprint2023-07-07

RCDN -- Robust X-Corner Detection Algorithm based on Advanced CNN Model

PAGE 1, Ben Chen, Caihua Xiong, Quanlin Lim, Zhonghua Wan

State Key Laboratory of Digital Manufacturing Equipment and Technology, Huazhong University of, Science and Technology, Wuhan, Hubei 430074, China

6D位姿估计

针对棋盘格 X-corner 在相机标定、位姿估计等任务中易受畸变、极端姿态、噪声和遮挡影响的问题,RCDN 将角点检测建模为像素级 FCN 响应预测,并结合类 focal loss、阈值/NMS/聚类后处理、混合亚像素细化与改进区域生长恢复棋盘。真实和合成实验显示其检测率、亚像素精度和鲁棒性优于常用方法,并在标定与位姿估计中获得更低重投影误差。

Self-supervised Optimization of Hand Pose Estimation using Anatomical Features and Iterative Learning Figure 1
arXiv preprint2023-07-06

Self-supervised Optimization of Hand Pose Estimation using Anatomical Features and Iterative Learning

Christian Jauch1, Timo Leitritz1, Marco F. Huber12

Machine Vision and Signal Processing, Fraunhofer Institute for Manufacturing Engineering and Automation IPA, Institute of Industrial Manufacturing and Management IFF, University of Stuttgart, Germany

6D位姿估计手部姿态

面向手工装配中戴手套、遮挡等场景导致手部姿态估计不稳、进而限制基于姿态的活动识别,论文提出一种少人工参与的自监督适配流程:用通用手姿态模型生成伪标签,再结合手部解剖约束、置信度阈值与时间一致性筛选数据并迭代重训练。作者在公开标注数据上调参后,将最佳组合用于未标注装配视频,并通过下游活动识别验证其有效性,但具体性能增益幅度在给定片段中未充分说明。

A Real-time Human Pose Estimation Approach for Optimal Sensor Placement in Sensor-based Human Activity Recognition Figure 1
arXiv preprint2023-07-06

A Real-time Human Pose Estimation Approach for Optimal Sensor Placement in Sensor-based Human Activity Recognition

Orhan Konak, Alexander Wischmann, Robin van de Water, Bert Arnrich

Hasso Plattner Institute, University of Potsdam

6D位姿估计人体姿态

针对传感器式人体活动识别中可穿戴 IMU 放置依赖经验、试采成本高且视频标注涉及隐私的问题,论文用实时 2D 人体姿态将目标活动视频转为骨架关键点,并据此推荐传感器位置,同时作为多模态输入。护理场景中 10 名受试者、13 类活动的可行性实验显示,4 个推荐位置中 3 个与 CNN-LSTM 最优结果一致,Kendall’s tau 为 0.8,多模态最高提升 F1 约 4.4%。

Secure Deep Learning-based Distributed Intelligence on Pocket-sized Drones Figure 1
arXiv preprint2023-07-04

Secure Deep Learning-based Distributed Intelligence on Pocket-sized Drones

Elia Cereda Alessandro Giusti Daniele Palossi

IIS, ETH Zurich, Switzerland

6D位姿估计

针对口袋级无人机算力/功耗不足、难以本地运行大视觉位姿网络且边雾卸载存在通信与雾端不可信风险,本文将 MobileNetV2 改造成压缩—多分支骨干—归约的分布式结构:无人机执行首尾阶段,并随机冗余计算一个子分支来校验雾端结果,异常时回退到 PULP-Frontnet。实验显示,相比全本地基线 R² 平均提升 0.19,攻击可在 2 秒内以 95% 概率检出,闭环控制误差也下降约三成。

Joint Coordinate Regression and Association For Multi-Person Pose Estimation, A Pure Neural Network Approach Figure 1
arXiv preprint2023-07-03

Joint Coordinate Regression and Association For Multi-Person Pose Estimation, A Pure Neural Network Approach

Wangpeng An Email: anwangpeng@gmail.com, Li Zhang Email: zhang-li@bjfu.edu.cn, Yufeng Yao Email: yaoyufeng@bjfu.edu.cn

6D位姿估计

针对多人姿态估计中 top-down 依赖检测器、bottom-up 需启发式分组且现有端到端方法仍含热图/NMS等后处理的问题,JCRA 用 Transformer 直接回归人体关节点坐标并完成关联,配合对称编码器—解码器实现真正单阶段输出。其在 COCO、CrowdPose 上报告优于同类端到端方法,COCO 达 69.2 mAP,推理较既有 bottom-up SOTA 加速 78%,但中等尺度人体精度仍有提升空间。

Automatic Solver Generator for Systems of Laurent Polynomial Equations Figure 1
arXiv preprint2023-07-01

Automatic Solver Generator for Systems of Laurent Polynomial Equations

PAGE 1, arXiv:2307.00320v1 [cs.CV] 1 Jul 2023

6D位姿估计

面向6D位姿/几何视觉中需在RANSAC内反复快速求解的Laurent多项式族,本文提出自动生成消元模板的方法,通过检查给定多项式是否足以构造动作矩阵,并利用单项式集合操作与有限域高斯消元,支持正维分量和自动发现部分p重对称以缩小模板。在三视图三角化、半广义混合位姿和TOA自标定等最小问题上,生成求解器保持数值精度,速度多数超过或接近现有方法,部分位姿问题快20–30倍。

SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation Figure 1
arXiv preprint2023-07-01

SyMFM6D: Symmetry-aware Multi-directional Fusion for Multi-View 6D Object Pose Estimation

Fabian Duffhauss 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Sebastian Koch 1, 3 1 3 ^ start_FLOATSUPERSCRIPT 1, 3 end_FLOATSUPERSCRIPT, Hanna Ziesche 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Gerhard Neumann 4 4 ^ start_FLOATSUPERSCRIPT 4 end_FLOATSUPERSCRIPT

6D位姿估计物体位姿多视角

针对单视角6D位姿估计易受遮挡和物体对称性歧义影响的问题,SyMFM6D从任意数量RGB-D视角中进行多方向深度融合,同时预测实例分割与3D关键点,并用对称感知目标训练关键点以避免多解平均。实验显示其在单视角和多视角设置均超过已有方法,且对相机标定误差和动态相机配置更鲁棒。

GIRA: Gaussian Mixture Models for Inference and Robot Autonomy Figure 1
arXiv preprint2023-06-30

GIRA: Gaussian Mixture Models for Inference and Robot Autonomy

Kshitij Goel, Wennie Tabib

6D位姿估计机器人操作高斯泼溅

机器人在大规模探索和精细操作中需要同时兼顾地图压缩、重建精度与位姿推断,而现有感知系统常以多条流水线重复处理同一传感数据。GIRA用高斯混合模型统一点云建模、占据建模和GMM间配准,并开源CPU/GPU实现。实验显示其GMM学习在桌面平台可较CPU实现快一个数量级以上,论文称相对已有CPU实现达10–100倍,但嵌入式平台增益会随算力与内存约束下降。

Towards the extraction of robust sign embeddings for low resource sign language recognition Figure 1
arXiv preprint2023-06-30

Towards the extraction of robust sign embeddings for low resource sign language recognition

PAGE 1, Mathieu De Coster

IDLab-AIRO – Ghent University – imec, SFI Lero & Trinity College Dublin, Ireland

6D位姿估计

论文针对真实低资源手语识别中姿态估计器易受域偏移、遮挡和缺失关键点影响,导致关键点模型弱于图像模型的问题,比较 OpenPose、MMPose 与 MediaPipe,并提出关键点归一化、缺失值填补及可迁移的 SignPose2Vec 姿态嵌入。实验表明该嵌入能提升关键点式 SLR,并在跨手语、仅微调分类头或多语训练时保持竞争力,微调迁移模型优于仅用目标语训练的模型。

Fusion of Visual-Inertial Odometry with LiDAR Relative Localization for Cooperative Guidance of a Micro-Scale Aerial Vehicle Figure 1
arXiv preprint2023-06-30

Fusion of Visual-Inertial Odometry with LiDAR Relative Localization for Cooperative Guidance of a Micro-Scale Aerial Vehicle

VÁCLAV PRITZL1, MATOUŠ VRBA1, PETR ŠTĚPÁN1, and MARTIN SASKA1

Multi-robot Systems Group, Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Technická 2, Prague, 166 27, Czech Republic

6D位姿估计相机位姿点云航天器

面向无 GNSS、狭窄或感知退化环境中微型无人机易受 VIO 漂移影响、而 3D LiDAR 平台又过大的矛盾,论文提出异构双机协作定位与引导:由搭载 LiDAR 的主机融合对从机的相对检测和从机 VIO,估计其在主机 SLAM 坐标系下的 4-DOF 位姿并下发轨迹。实验显示该方法相较原始 VIO 明显降低漂移,平均 3D ATE 达 0.28 m,并在真实协同建图中验证了引导微型无人机进入大平台难以到达区域的可行性。

Locking On: Leveraging Dynamic Vehicle-Imposed Motion Constraints to Improve Visual Localization Figure 1
arXiv preprint2023-06-30

Locking On: Leveraging Dynamic Vehicle-Imposed Motion Constraints to Improve Visual Localization

Stephen Hausler2, Sourav Garg2, Punarjay Chakravarty4, Shubham Shrivastava3, Ankit Vora3, Michael Milford * ^ start_FLOATSUPERSCRIPT * end_FLOATSUPERSCRIPT 2

6D位姿估计相机位姿

面向自动驾驶中单帧PnP视觉定位易受匹配和建图误差影响、通常丢弃动态物体的问题,论文提出把前方动态车辆的跨帧相对位置稳定性转化为轻量运动约束,并注入EKF位姿滤波,而非完整估计动态物体位姿。在Ford AV 42 km数据上,该约束约35%时间被触发,相比PnP及普通PnP+IMU滤波在0.25–5 m容差下提升召回,触发时改进更明显。

ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models Figure 1
arXiv preprint2023-06-29

ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models

Weihao Cheng, Yan-Pei Cao, Ying Shan ARC Lab, Tencent PCG whcheng@tencent.com, caoyanpei@gmail.com, yingsshan@tencent.com

ARC Lab, Tencent PCG

6D位姿估计相机位姿

稀疏、随手拍物体图像常缺少视角重叠,使 SfM 和需标注训练的位姿网络难以泛化。ID-Pose 的关键洞察是反向利用 Zero-1-to-3 的视角条件扩散先验:把相对位姿作为优化变量,以噪声预测误差驱动梯度下降,并用探索-精修及三视图三角关系提升稳定性。该零训练方法在 NAVI、OmniObject3D、ABO、CO3D 上优于现有方法,但计算开销较大且受限于球面相机假设。

Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation Figure 1
arXiv preprint2023-06-29

Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation

Zhongwei Qiu 1, 3 1 3 ^ start_FLOATSUPERSCRIPT 1, 3 end_FLOATSUPERSCRIPT, Qiansheng Yang 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Jian Wang 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Xiyu Wang 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Chang Xu 3 3 ^ start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT, Dongmei Fu 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Kun Yao 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Junyu Han 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Errui Ding 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Jingdong Wang 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT, Technology Beijing, 2 2 ^ start_FLOATSUPERSCRIPT 2 end_FLOATSUPERSCRIPT Baidu

{}^{3} start_FLOATSUPERSCRIPT 3 end_FLOATSUPERSCRIPT University of Sydney

6D位姿估计人体姿态

针对传统2D人体姿态估计依赖判别式热图回归、后处理受初始热图质量限制的问题,论文提出 DiffusionPose,将关键点热图估计改写为从噪声热图逐步去噪生成的扩散过程,并引入人体结构条件的 SGDD/高分辨率 SGDD 提升热图质量。在 COCO、CrowdPose 和 AI Challenge 上分别带来 1.6、1.2、1.2 mAP 增益,但推理步数导致计算量线性增加。

Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objects Figure 1
arXiv preprint2023-06-28

Hierarchical Graph Neural Networks for Proprioceptive 6D Pose Estimation of In-hand Objects

Alireza Rezazadeh 1, 2 1 2 ^ start_FLOATSUPERSCRIPT 1, 2 end_FLOATSUPERSCRIPT, Soshi Iba 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT, Nawid Jamali 1 1 ^ start_FLOATSUPERSCRIPT 1 end_FLOATSUPERSCRIPT

6D位姿估计手部姿态

针对手内操作中视觉特征缺失或遮挡会削弱6D位姿估计、且既有方法少用手指本体位置信息的问题,论文将RGB-D与触觉构造成视觉图和触觉图,并通过层次化GNN在模态内/跨模态传递消息,把几何结构和手指位置共同编码。实验在YCB物体子集上较现有方法提升精度与遮挡鲁棒性,并在真实机器人上展示了定性迁移效果。

Data-Link: High Fidelity Manufacturing Datasets for Model2Real Transfer under Industrial Settings Figure 1
arXiv preprint2023-06-09

Data-Link: High Fidelity Manufacturing Datasets for Model2Real Transfer under Industrial Settings

PAGE 1, Sunny Katyara, Mohammad Mujtahid, Court Edmondson

6D位姿估计数据集/基准

面向工业抓取中真实6D位姿标注成本高、通用数据集缺少制造场景的问题,Data-Link提出从真实物体提取纹理、材质、形状与惯性参数,并在Unity数字孪生中生成带域随机化的60类制造物体合成数据,用于训练PoseCNN、PVNet和DOPE。实验显示合成训练后迁移到真实物体的姿态准确率超过90%、MAE低于5%,但真实抓取规划仍需因未建模动力学继续调参。

Counter-Hypothetical Particle Filters for Single Object Pose Tracking Figure 1
arXiv preprint2023-05-28

Counter-Hypothetical Particle Filters for Single Object Pose Tracking

Elizabeth A. Olson, Jana Pavlasek, Jasmine A. Berry, Odest Chadwicke Jenkins

Elizabeth A. Olson, University of Michigan, Ann Arbor, MI, USA

6D位姿估计物体位姿

该文针对6D物体位姿跟踪中粒子滤波在高维空间易发生粒子匮乏、导致真实位姿模式塌缩且重采样频率难以手调的问题,提出Counter-Hypothetical Particle Filter:在常规似然外独立估计“反假设”似然,为每个粒子赋予疑度,并用粒子集的信心与怀疑总量自适应决定重激活比例。在YCB Video单物体跟踪实验中,整体性能与常规抗匮乏方法相当,并在高遮挡、仅RGB输入场景下取得更好精度。

Enhanced 6D Pose Estimation for Robotic Fruit Picking Figure 1
arXiv preprint2023-05-25

Enhanced 6D Pose Estimation for Robotic Fruit Picking

PAGE 1, Marco Costanzo, Marco De Simone, Sara Federico, Ciro Natale, Salvatore Pirozzi

6D位姿估计机器人操作

针对水果尺寸和形状差异导致实例级 6D 位姿估计在抓取中失准的问题,本文在仅用合成数据训练的 DOPE/PnP 结果后加入 RGB-D 深度优化,通过同时调整 CAD 模型尺度与距离来估计真实苹果尺寸,并结合力/触觉闭环控制最小夹持力。多种尺寸苹果抓取实验表明,该流程相比标准 6D 位姿估计显著提高成功抓取率,尤其适用于与训练 CAD 尺寸差异较大的水果。

You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example Figure 1
arXiv preprint2023-05-22

You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example

PAGE 1, Walter Goodwin, Ioannis Havoutis, Ingmar Posner

Oxford Robotics Institute, University of Oxford

6D位姿估计类别级位姿

面向机器人操作中对未知物体快速获得6D位姿的需求,本文针对传统实例级方法依赖CAD/标注数据、类别级方法数据成本高的问题,提出仅观察同类一个参考物体的训练-free多视角表示:利用预训练ViT特征和RGB-D多视角对应进行类别级匹配与位姿求解。实验显示其显著优于既有one-shot/zero-shot基线,参考建模约10秒,在线估计超过15Hz,并可用于连续学习中新类别的自动采集与后续操作。

Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose Figure 1
IJCAI 20232023-05-18

Manifold-Aware Self-Training for Unsupervised Domain Adaptation on Regressing 6D Object Pose

Yichen Zhang, Jiehong Lin, Ke Chen, Zelin Xu, Yaowei Wang, Kui Jia

South China University of Technology, Peng Cheng Laboratory

6D位姿估计物体位姿仿真到现实

针对6D物体位姿中合成到真实的无监督域适应,论文指出连续回归目标的累积相关性与分段流形结构未被充分利用。MAST将位姿回归拆为离散锚点粗分类与局部残差细化,并用累积目标相关正则约束跨域特征。三项公开基准上优于既有UDA位姿回归方法,说明其对特征尺度不一致更稳健。

RelPose++: Recovering 6D Poses from Sparse-view Observations Figure 1
arXiv preprint2023-05-08

RelPose++: Recovering 6D Poses from Sparse-view Observations

Amy Lin

Carnegie Mellon University

6D位姿估计

该文瞄准稀疏视角(2–8张)下神经重建依赖相机6D位姿却难以获取的问题。RelPose++在RelPose的成对相对旋转分布上加入多图像Transformer上下文,以利用额外视角消解对称/少纹理歧义,并通过以光轴交点为中心的坐标系解耦旋转不确定性与平移预测。模型在CO3D已见、未见类别及零样本数据上优于既有方法,旋转精度约提升10%,且可直接支撑稀疏视角3D重建。

Uncovering the Background-Induced bias in RGB based 6-DoF Object Pose Estimation Figure 1
arXiv preprint2023-04-17

Uncovering the Background-Induced bias in RGB based 6-DoF Object Pose Estimation

PAGE 1, Govi

RESEARCH, Department of Physics, University of Modena and Reggio

6D位姿估计物体位姿

本文关注 RGB 6D 位姿估计在 Linemod 等带 ArUco 标记数据集上的“背景诱导偏差”:标记和固定棋盘在真实部署中通常不存在,却可能被网络当作捷径。作者以 EfficientPose 为案例,结合定量实验、显著性图和基于 Linemod 几何处理的新数据集,揭示模型注意力会部分落在标记/背景上,性能因此受测试场景影响,并指出数据增强等策略可缓解但不能忽视该偏差。

CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objects Figure 1
arXiv preprint2023-03-28

CARTO: Category and Joint Agnostic Reconstruction of ARTiculated Objects

PAGE 1, Nick Heppert1, Muhammad Zubair Irshad2, Sergey Zakharov3, Katherine Liu3

University of Freiburg, Georgia Institute of Technology, Toyota Research Institute (TRI), Stanford University

6D位姿估计三维重建

CARTO针对单帧观测下关节物体需同时估计形状、6D位姿、尺度与关节状态,而传统两阶段流程复杂且难扩展的问题,提出类别与关节类型无关的隐式SDF重建框架,通过解耦形状码和关节码并加入物理正则,结合双目RGB编码器一次前向完成多物体检测与重建。其多类别解码器接近单类专用解码器精度,在新实例上相较两阶段方法将mAP 3D IoU50绝对提升20.4%,并可从仿真迁移到真实物体。

Prior-free Category-level Pose Estimation with Implicit Space Transformation Figure 1
arXiv preprint2023-03-23

Prior-free Category-level Pose Estimation with Implicit Space Transformation

PAGE 1

The University of Hong Kong, The Chinese University of Hong Kong

6D位姿估计类别级位姿

本文针对类别级6D位姿估计依赖大量类别3D先验、实践中难获取的问题,指出先验方法性能关键并非模板本身,而是变形过程建立了相机空间与规范世界空间的对应。作者提出无先验的IST-Net,在特征层隐式完成空间变换,并用训练期的相机/世界空间增强器提供位姿敏感与几何约束。实验在REAL275和Wild6D上显示其作为prior-free方法达到或超过多种先验方法,并在REAL275具备更快推理速度。

6D Object Pose Estimation from Approximate 3D Models for Orbital Robotics Figure 1
arXiv preprint2023-06-21

6D Object Pose Estimation from Approximate 3D Models for Orbital Robotics

PAGE 1, Maximilian Ulmer1, Maximilian Durner1, Martin Sundermeyer1, Manuel Stoiber1, Rudolph Triebel1

6D位姿估计物体位姿机器人操作

面向在轨服务/碎片清除中单目相机需在强反光、过曝和低信噪比下估计翻滚卫星位姿,本文提出 EagerNet:从近似 CAD 模型学习稠密 2D-3D 对应,同时预测像素级对应误差以筛除不可靠点,生成多 PnP 假设,并结合学习特征的区域式迭代细化与后验选择。实验显示其在 SPEED+ 上达到当时 SOTA,并赢得 SPEC2021 post-mortem,且对模型误差更鲁棒。

Rigidity-Aware Detection for 6D Object Pose Estimation Figure 1
arXiv preprint2023-03-22

Rigidity-Aware Detection for 6D Object Pose Estimation

PAGE 1, Yang Hai 1

State Key Laboratory of ISN, Xidian University, EPFL

6D位姿估计物体位姿

针对6D位姿估计中常用通用检测器在重遮挡杂乱场景下易因中心区域被遮挡而给姿态网络提供错误RoI的问题,论文利用目标刚体这一先验,提出基于可见性图的正样本采样:用最小障碍距离估计框内各位置可见概率,让所有可见部件参与框预测,并在推理时融合多处局部预测。实验覆盖7个BOP相关数据集,检测显著优于FCOS/PAA等基线,接入PFA-Pose后在多项6D位姿指标上达到或刷新SOTA。

Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation Figure 1
arXiv preprint2023-03-22

Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation

PAGE 1, Heng Yang, Marco Pavone

NVIDIA Research, Code available

6D位姿估计物体位姿

面向机器人等安全关键场景,论文针对两阶段6D位姿估计缺少可证明误差与不确定性的问题,将保形预测用于关键点热图,生成具覆盖概率的圆/椭圆预测集,并把几何约束传播为位姿不确定集PURSE;再用RANSAG求平均位姿、半定松弛给最坏旋转/平移误差上界。LineMOD Occlusion上验证覆盖概率和误差界有效,精度与稀疏关键点方法相当或更好,但预测集大时界可能保守。

Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimation Figure 1
arXiv preprint2023-03-21

Linear-Covariance Loss for End-to-End Learning of 6D Pose Estimation

Yinlin Hu MagicLeap yhu@magicleap.com, Mathieu Salzmann EPFL, ClearSpace mathieu.salzmann@epfl.ch

Beihang University, EPFL, ClearSpace

6D位姿估计

针对2D-3D对应点方法中PnP不可微或可微PnP“先求解再监督”会因平均效应给单个对应点带来误导梯度的问题,论文提出在真实位姿附近线性化PnP,并用所得位姿分布的对角协方差构造LC损失,从训练阶段同时关注最终位姿与对应点质量。该损失可用于稀疏和稠密对应、含加权PnP的框架,在LM-O与YCB-Video上稳定提升精度,并结合ZebraPose取得当时SOTA;但仍需额外对应点监督,不能从零学习结构。

SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations Figure 1
arXiv preprint2023-03-18

SOCS: Semantically-aware Object Coordinate Space for Category-Level 6D Object Pose Estimation under Large Shape Variations

Boyan Wan, Yifei Shi, Kai Xu

National University of Defense Technology

6D位姿估计物体位姿类别级位姿

针对类别级 6D 位姿中 NOCS 依赖刚性全局对齐、在类内形状差异大时语义对应混乱的问题,SOCS 用语义关键点引导非刚性 warp 到均值形状,构建更一致的物体坐标空间,并配合多尺度坐标注意力网络做稠密回归。实验显示其在 NOCS-REAL275 和 ModelNet40-partial 上优于已有方法,5°5cm 提升 5.6%,大形变与遮挡场景更稳健。

Depth-based 6DoF Object Pose Estimation using Swin Transformer Figure 1
arXiv preprint2023-03-03

Depth-based 6DoF Object Pose Estimation using Swin Transformer

PAGE 1, Zhujun Li1, Ioannis Stamos2

6D位姿估计物体位姿彩色深度

针对弱光、低纹理场景中 RGB 外观不可靠、纯点云方法又未充分利用深度图二维结构的问题,论文提出 SwinDePose:将深度图表面法线与相机三轴夹角编码成类 RGB 图像,用 Swin Transformer 提取全局几何特征,并与 RandLA-Net 点云特征融合,联合做语义分割和 3D 关键点定位,再以最小二乘恢复 6D 位姿;在 LineMod 与 Occlusion LineMod 上优于当时深度输入方法。

Canonical mapping as a general-purpose object descriptor for robotic manipulation Figure 1
arXiv preprint2023-03-02

Canonical mapping as a general-purpose object descriptor for robotic manipulation

PAGE 1, Benjamin Joffe, Konrad Ahlin

6D位姿估计机器人操作

针对传统6D位姿描述偏任务化、难处理铰接或软变形物体的问题,论文提出用 canonical mapping 将图像像素密集对应到规范3D网格,作为可在运行时转换为整体或部件6D位姿的通用描述符。作者结合手机摄影测量、合成数据渲染与自动标注训练流程,尽量减少人工建模成本,并在软玩具的双臂操作实验中展示其可支持部件定位和操作策略调整;但评估规模较小,泛化到更多类别的效果文中未充分说明。

MSDA: Monocular Self-supervised Domain Adaptation for 6D Object Pose Estimation Figure 1
arXiv preprint2023-02-14

MSDA: Monocular Self-supervised Domain Adaptation for 6D Object Pose Estimation

PAGE 1, Dingding Cai1, Janne Heikkilä2, Esa Rahtu1

Tampere University, Finland, University of Oulu, Finland

6D位姿估计物体位姿仿真到现实

针对真实6D位姿标注昂贵、纯合成训练存在仿真到现实域差的问题,MSDA在SC6D上先用合成RGB预训练,再用无真实位姿标签的真实RGB(-D)自监督微调;关键是用姿态感知增强学习RGB一致性,并用深度引导伪标签约束z轴距离,避免在线可微渲染和对称先验。YCB-Video实验显示其超过Self6D++及部分全监督方法,并接近全监督微调性能。

Model-Based Underwater 6D Pose Estimation from RGB Figure 1
arXiv preprint2023-02-14

Model-Based Underwater 6D Pose Estimation from RGB

PAGE 1

6D位姿估计

面向水下机器人干预中低能见度、散射和缺乏可靠3D传感带来的位姿感知难题,论文提出仅用RGB的模型驱动6D位姿流程:先用YOLOv4做目标检测,再用增强自编码器结合CAD先验估计姿态,以应对对称、弱纹理和遮挡;同时发布含33,920个合成场景与10个真实场景的数据集。BOP评测中相较同类端到端方法精度约提升8%,并在水下机械臂到达任务中验证了实际可用性。

A Projective Geometric View for 6D Pose Estimation in mmWave MIMO Systems Figure 1
arXiv preprint2023-02-02

A Projective Geometric View for 6D Pose Estimation in mmWave MIMO Systems

PAGE 1, Shengqiang Shen Member, IEEE, Henk Wymeersch Senior Member

6D位姿估计

面向5G/毫米波MIMO中无需外部传感器的用户三维位置与姿态联合估计,论文把AoA/AoD与计算机视觉的透视投影模型对应起来,将多基站AoA位姿估计转化为PnP问题,并用本质矩阵建模单基站多径SLAM。仿真显示闭式与迭代估计器接近CRB,SLAM在无LoS或LoS/NLoS未知时仍有效。

Collision-aware In-hand 6D Object Pose Estimation using Multiple Vision-based Tactile Sensors Figure 1
arXiv preprint2023-01-31

Collision-aware In-hand 6D Object Pose Estimation using Multiple Vision-based Tactile Sensors

PAGE 1, Gabriele M. Caddeo1, Nicola A. Piga1, Fabrizio Bottarel1, Lorenzo Natale1

6D位姿估计物体位姿手部姿态

面向机器人手内操作中仅凭触觉估计物体6D位姿的问题,本文针对多个视觉触觉传感器接触标准尺寸物体时局部触觉不再具备强物体特异性的难点,提出用物体无关的仿真触觉图像训练CNN编码接触斑块,结合几何筛选、梯度下降位姿优化与碰撞惩罚排序。DIGIT与YCB仿真实验中,87.5%的估计与实际接触兼容,平均位置误差约2厘米,并优于纯几何基线。

RGB-D-Based Categorical Object Pose and Shape Estimation: Methods, Datasets, and Evaluation Figure 1
arXiv preprint2023-01-19

RGB-D-Based Categorical Object Pose and Shape Estimation: Methods, Datasets, and Evaluation

Leonard Bruns, Patric Jensfelt

aDivision of Robotics, Perception and Learning (RPL), KTH Royal Institute of Technology, Teknikringen

6D位姿估计物体位姿点云彩色深度数据集/基准

面向机器人抓取/规划中“只看到部分 RGB-D 却需要类别级位姿与完整形状”的问题,本文不是提出单一网络,而是系统梳理现有方法并指出常用 CAMERA/REAL 与 AP、Chamfer 等评测存在直立物体偏置和可解释性不足。作者为 Redwood 补充自由姿态标注,提出更清晰的位姿与 F-score 形状评测工具箱;公平测试显示多种 SOTA 对非受限朝向泛化较差,性能很大程度依赖直立假设。

MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare Figure 1
arXiv preprint2022-12-13

MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare

PAGE 1

Yann Labb´e, NVIDIA, University of Washington

6D位姿估计未知物体

MegaPose面向机器人快速部署中“训练时未知、推理时才给CAD模型”的物体6D位姿估计问题,避免为每个新物体重新合成数据和训练。其核心是用多视角CAD渲染把形状与坐标系显式输入网络,并将粗位姿估计改为判断假设是否可由render-and-compare精修器修正,同时依赖大规模多样化合成数据训练。实验显示其在ModelNet、YCB-Video达到领先结果,在BOP 7个核心数据集上可接近需见过目标物体训练的方法,增益可能主要来自方法设计与数据规模共同作用。

Context-aware 6D Pose Estimation of Known Objects using RGB-D data Figure 1
arXiv preprint2022-12-11

Context-aware 6D Pose Estimation of Known Objects using RGB-D data

PAGE 1, Ankit Kumar, Priya Shukla, Vandana Kushwaha, G.C. Nandi

Center of Intelligent Robotics, Indian Institute of Information Technology Allahabad, Prayagraj, India

6D位姿估计点云彩色深度

面向机器人抓取等场景中遮挡、杂乱和光照变化下的已知物体6D位姿估计,本文在DenseFusion的RGB-D逐像素融合与迭代细化框架上引入“上下文”划分:按对称/非对称物体分别建模,并为非对称物体使用更深的估计器与细化器以适配更严格的姿态约束。在LineMOD上相对DenseFusion报告约3.2%精度提升,推理时间仍满足实时使用。

Category-Level 6D Object Pose Estimation with Flexible Vector-Based Rotation Representation Figure 1
arXiv preprint2023-01-30

Category-Level 6D Object Pose Estimation with Flexible Vector-Based Rotation Representation

PAGE 1, JOURNAL OF LATEX CLASS FILES, VOL. X, NO. X, XXXX 20XX

6D位姿估计物体位姿类别级位姿

针对类别级6D位姿中同类物体形状、颜色差异大且统一形状映射依赖大量数据的问题,论文提出FS-Net:仅用RGB做2D检测,基于深度点云的3D图卷积自编码器学习姿态特征,并用可调向量式FVR解耦旋转表示及在线3D形变增强提升泛化。实验显示其在类别级任务达到当时SOTA,约20 FPS,且FVR优于常见旋转表示。