Building robots, even for performing simple tasks, requires the designer to assess performance using various parameters. However, sometimes the best solution is not the one that performs best on average. Hence, other ways of evaluating performance are necessary. We ran a broad parameter sweep for an agent-based simulation of a robotic area coverage task with very simple agent controllers in four different task environments. Analysis of the results emphasizes the importance of considering the entire distribution across randomized starting conditions, and not just the mean overall performance, when assessing the effectiveness of parameter settings. Our findings indicate the potential for robotic system designers to constrain or specify the qualities of system performance distributions.

This content is only available as a PDF.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.