GOSIM 2024 Europe AI & Agents Xavier Tao: dora-rs: Modern Dataflow for Robotics

In this talk, we show how allowing LLMs to modify robotic codebase at runtime enables new human-machine interaction. To achieve this, we use dora-rs, a robotic framework capable of changing code at runtime while keeping state, also known as hot-reloading. By pairing dora-rs with LLMs, we demonstrate that robots can be controlled and instructed with natural language to modify any aspect of the robot codebase. This approach allows new human-robot interactions that were previously inaccessible due to the limitations posed by the need to use existing predefined interfaces, thus paving the way to more sophisticated and wider use of robotic applications that can better understand and respond to human needs. #robotics #gosim #ai #gosimtechnical