Scoring and Standings

The ERL Service Robots is composed of multiple Local Tournaments, held in different research labs across Europe, with certified test beds, and a few competitions as part of Major Tournaments, such as RoboCup. Teams participate in a minimum of 2 tournaments (Local and/or Major) per year and get scores based on their performances. A final end of year score is computed for each team, per Task Benchmark (TBM) and Functionality Benchmark (FBM), using the best two participations in tournaments, and teams are ranked based on their final score. More information can be found on ERL Service Robots scoring system document.

Prizes for the top teams (per TBM and per FBM where they have participated) will be awarded during the next European Robotics Forum (ERF) in Edinburgh, 22-24 March 2017.

The current scoring and standings for the ERL Service Robots Challenge after the last local tournament (Peccioli, 30 January - 3 February 2017) are the ones below:

Task Benchmarks

TBM1:  Getting to know my home

TBM1-SR

A - Achievements
P - Penalties
Yellow indicates the team has the minimum required (2) participations

TBM4: Visit my home (Navigation)

TBM4-SR

 TBM5: GPSR

TBM5-SR

 

Functionality Benchmarks

FBM1: Object Perception

FBM1-SR

FBM3: Speech Understanding

FBM3-SR

FCR - Full Command Recognition
AC - Action Classification
WER - Word Error Rate
SR acc - Speech Recognition Accuracy