Construct Validity and Test–Retest Reliability of the Test of Advanced Movement Skills with a Dual-Outcome Scoring System

The objective was to verify the construct validity and test–retest reliability of the Test of Advanced Movement Skills (TAMS) with an innovative dual-outcome scoring system. Three statistical approaches–confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), and item response theory analysis (IRT)–were applied to the data collected from 88 participants aged 9–12 years. Furthermore, 10 of them were randomly selected to examine the test–retest reliability by calculating intraclass correlation coefficients (ICC). The synthesis of findings from CFA, ESEM, and IRT analyses provides supportive evidence that two- and bi-factor structures demonstrated better model-data fit compared to the one-factor structure. An excellent level of test–retest reliability was confirmed in the TAMS (ICC =.96) and anthropometric instruments (ICC =.986–.998). We conclude that a composite score derived from the TAMS is sufficient and practical to measure one’s general competence in advanced movement skills during late childhood.