Reliability and Usefulness of the SKILLCOURT as a Computerized Agility and Motor–Cognitive Testing Tool

Abstract

ABSTRACT Introduction Agility and cognitive skills are essential in sports. However, standardized agility assessment tools often lack a reactive component, and cognitive assessments are performed using computer-based or paper-pencil tests. The SKILLCOURT is a newly developed testing and training device allowing agility and cognitive assessments in a more ecologically valid setting. This study evaluated the reliability and sensitivity to changes in performance (usefulness) of the SKILLCOURT technology. Methods In a test–retest (7 d, 3 months) design, 27 healthy adults (♀ = 12; age, 24.9 ± 3.3 yr) performed three trials of agility (Star Run, Random Star Run) and motor–cognitive tests (1-back, 2-back, executive function). Absolute and relative intersession and intrasession reliability was determined using the intraclass coefficient (ICC) and coefficient of variation (CV). A repeated-measures ANOVA was applied to identify potential learning effects between trials and test sessions. The smallest worthwhile change and typical error (TE) were calculated to investigate the intrasession and intersession usefulness of the tests. Results Agility tests revealed good relative and absolute intersession (ICC, 83–0.89; CV, 2.7%–4.1%) and intrasession (ICC, 7–0.84; CV, 2.4%–5.5%) reliability accompanied by adequate usefulness from test day 3 onward. Motor–cognitive tests showed good relative intersession reliability (ICC, 0.7–0.77) with marginal CV values (4.8%–8.6%). Adequate intrasession reliability and usefulness can be assumed from test day 2 (1-back test, executive function test) and day 3 (2-back test) onward. For all tests, learning effects were observed within and compared with test day 1. Conclusions The SKILLCOURT is a reliable diagnostic tool for assessing reactive agility and motor–cognitive performance. Because of learning effects, sufficient familiarization with the tests is required when used for diagnostic purposes.