Long-horizon surgical assistance requires humanoid robots to coordinate with evolving human activities while maintaining safety across planning and execution. We present RoboAssist, an agent-based framework for interactive human–humanoid planning that integrates workflow reasoning, task coordination, and cross-layer safety. At its core is an asymmetric dual-track representation that separates partially observed human process states from executable robot task sequences. By jointly updating human-process estimates, scene context, and task dependencies online, RoboAssist adapts the remaining robot plan as workflow requirements and environmental conditions evolve.
A cross-layer safety architecture combines preventive navigation regulation, reactive regulation during close-range handover, and independent whole-body runtime supervision. We demonstrate the framework on a Unitree G1 humanoid robot in long-horizon, multi-stage simulated surgical assistance scenarios encompassing multimodal interaction, instrument handling, medical material transport, navigation, and safe human–robot handover. Experiments show improved multi-stage task completion and dynamic adaptation over task-matched baselines, with the clearest gains under workflow-request changes.
Keywords: Robot Agent, Interactive Planning, Humanoid Assistance