← Back to the chapter · Previous detail · Next detail →
Technical detail · Mobile Sensing: Features and Deployment
Validate the combined skill score
Validation of those derived metrics should preserve the statistical question. In the Orient simulator study, one-way ANOVA tested whether novice, intermediate, and expert groups differed; Pearson correlation compared equivalent Orient and camera-based metrics; and a least-squares linear regression could combine the useful metrics into an overall scoring function only after an equal train/test split. Document the scoring equation explicitly: a constant term plus weighted average acceleration, total duration, motion smoothness, angular distance, and ambidexterity. In the example record, acceleration raises the score, while duration, angular distance, and ambidexterity carry negative weights and motion smoothness is scaled by a very small coefficient because of its units. A leave-one-out validation view of the combined score still needs group evidence; the reported box plot separated novices from intermediates at p = 0.012, intermediates from experts at p = 0.001, and novices from experts at p < 0.001. The metrics describe several differences between groups. Experts had shorter task duration, lower total angular distance, lower motion-smoothness values, and higher average acceleration, while average speed was not a strong separator and ambidexterity separated experts from less experienced groups more weakly. That shape is a useful teaching point: skill evidence comes from a bundle of bounded movement metrics, p-values, and validation splits, not one attractive box plot.