Scope
Reproducibility in robotics is still not mainstream. This situation hampers both the research process and the technology transfer of research results. Reproducibility of results is the cornerstone of the scientific method on which modern engineering is based.
This workshop will introduce the attendees to the most recent techniques, methodologies and best practices to be applied to make robotics research reproducible and measurable.
The workshop will collect from the community both i) r-articles (experimental replications) starting from published R-articles from IEEE Robotics and Automation Magazine (RAM) – the first and so far only robotics publishing venue managing a reproducible article process - and ii) ‘plans’ to submit R-Articles. R-These last are scientific papers describing a specific system/methodology with a particular emphasis on reproducibility of results: each R-Article is associated to a publicly available dataset with all the material required to replicate the experiments presented in the paper (code, collected experimental data, description of the hw/sw platform, instructions, …). Anybody willing to reproduce the experiments presented in a R-Article should then describe his/her own results in a r-article, to confirm or refute the original results.
The workshop will propose some methods for objective operational measuring of intelligent robot behaviors and will collect and discuss new ideas from the community.
Through this workshop, participants will gain both a deep appreciation of reproducibility’s critical role and practical tools for its realization in robotic tasks. The event will issue a call for reproducible articles and expression on interests (in form of extended 4-pages abstract) to write R-articles for IEEE RAM.
