Feasible and Stressful Trajectory Generation for Mobile Robots - ISSTA 2020

Authors: Carl Hildebrandt, Sebastian Elbaum, Nicola Bezzo, and Matthew Dwyer

This work was presented at The ACM SIGSOFT International Symposium on Software Testing and Analysis: https://conf.researchr.org/home/issta...

More information on our artifact, and a link to the paper can be found on the website: https://hildebrandt-carl.github.io/Ro...

Live Presentation:    • ISSTA 2020 Technical Papers: "Challen...  

Abstract: While executing nominal tests on mobile robots is required for their validation, such tests may overlook faults that arise under trajectories that accentuate certain aspects of the robot’s behavior. Uncovering such stressful trajectories is challenging as the input space for these systems, as they move, is extremely large, and the relation between a planned trajectory and its potential to induce stress can be subtle. To address this challenge we propose a frame- work that 1) integrates kinematic and dynamic physical models of the robot into the automated trajectory generation in order to generate valid trajectories, and 2) incorporates a parameterizable scoring model to efficiently generate physically valid yet stressful trajectories for a broad range of mobile robots. We evaluate our approach on four variants of a state-of-the-art quadrotor in a racing simulator. We find that, for non-trivial length trajectories, the incorporation of the kinematic and dynamic model is crucial to generate any valid trajectory, and that the approach with the best hand-crafted scoring model and with a trained scoring model can cause on average a 55.9% and 41.3% more stress than a random selection among valid trajectories. A follow-up study shows that the approach was able to induce similar stress on a deployed commercial quadrotor, with trajectories that deviated up to 6m from the intended ones.