Manipulating fragile deformable containers, such as disposable plastic cups filled with liquid, demands real-time grip-force adaptation within an extremely narrow force margin: insufficient force causes slip, while excessive force irreversibly deforms the thin wall. Existing approaches struggle to achieve such force-sensitive manipulation tasks. We propose a noise-statistics-based calibration-driven reflex control paradigm with vision-based tactile sensing: by analyzing the sensor's intrinsic noise characteristics (via a brief static-hold-and-unload protocol), we directly derive all controller thresholds, eliminating external force calibration, trial-and-error manual tuning, or material-specific physical models. Instantiating this paradigm, we present TactileReflex, a three-channel closed-loop controller that extracts three image-level proxies, shear intensity ($S_y$), contact intensity ($F_n$), and center of pressure ($C$), from dual visuo-tactile sensors and drives prioritized reflex channels at ~12 Hz for slip suppression, weight-adaptive release, and force protection. Each channel closes the loop directly on its proxy via noise-derived thresholds. Ablation demonstrates that only the full three-channel system is able to prevent irreversible container deformation (5/5 success vs. at most 1/5 for partial configurations). In a dynamic pouring task, fixed-effort baselines fail in all 10 attempts due to pose drift, while TactileReflex achieves 9/10 success across two water volumes. As a self-contained and interpretable controller, TactileReflex can serve as a plug-and-play safety layer beneath high-level manipulation pipelines, including haptic-free VR teleoperation and vision-language-action (VLA) policies.
翻译:操作易碎的可变形容器(例如装满液体的 disposable 塑料杯)需要在极窄的力裕度内实时调整抓取力:力不足会导致滑动,而力过大会不可逆地使薄壁变形。现有方法难以实现此类力敏感操作任务。我们提出了一种基于噪声统计校准驱动的反射控制范式,结合基于视觉的触觉传感:通过分析传感器固有的噪声特性(采用简短的静态保持与卸载协议),我们直接推导出所有控制器的阈值,从而消除了外部力校准、试错式手动调节或材料特定的物理模型。为实现此范式,我们设计了 TactileReflex,一种三通道闭环控制器,从双视觉-触觉传感器中提取三个图像级代理量——剪切强度 ($S_y$)、接触强度 ($F_n$) 和压力中心 ($C$),并以约 12 Hz 的频率驱动优先化的反射通道,用于抑制滑动、自适应重量释放和力保护。每个通道通过噪声推导的阈值直接在其代理量上进行闭环控制。消融实验表明,仅完整的三个通道系统能够防止容器不可逆变形(完全配置成功率为 5/5,而部分配置最多为 1/5)。在动态倒水任务中,固定力度的基线方法因位姿漂移在所有 10 次尝试中均失败,而 TactileReflex 在两种水量下实现了 9/10 的成功率。作为一种自包含且可解释的控制器,TactileReflex 可作为高层操作管线(包括无触觉 VR 远程操作和视觉-语言-动作 (VLA) 策略)的即插即用安全层。